Hey Folks 👋 I am looking at our test setup and feeling in bit of dire straits. Currently we develop under Windows and build on Linux servers. During the build we start required environment locally (mainly Zookeeper, Kafka and Flink), run tests against it and then tear it down at the end of the build. I'm trying to figure out what is the best way to incorporate Apache Pinot into this setup. Has anyone got experience or can recommend best practices for testing against Apache Pinot under Windows? Is it possible to run it locally under MS Windows 10 or start it directly from within JVM process?

You can start it in a JVM process. There are a bunch of commands that map to java classes i.e.

StartServer

,

StartBroker

,

StartController

So you could certainly start those all up in a JVM process and that’s what the QuickStart examples do. You can see that in here - https://github.com/apache/pinot/blob/master/pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/QuickstartRunner.java

Great, thanks @Mark Needham! At the moment we start embedded kafka (https://github.com/embeddedkafka/embedded-kafka) and flink directly inside forked JVM process. Normally would go docker but in this case unfortunately we don't have it available as windows runs as virtual machine.

I think Pinot will write its data into the

/tmp

dir unless you override it, so not quite as good as in memory. But maybe workable