Hi I am trying to put the dependency in my sbt fil...
# troubleshooting
e
Hi I am trying to put the dependency in my sbt file for pinot flink connector. But seems module is not available https://repo1.maven.org/maven2/org/apache/pinot/pinot-connectors/0.10.0/pinot-connectors-0.10.0.pom
k
@Xiang Fu Any reason we don't publish the flink connector? I can see the spark connector is there in maven.
x
cc @Yupeng Fu
I think it's just a miss in Pom file
1
it seems its not released
t
Hi folks.
I think it's just a miss in Pom file
So is the flink connector code on
master
supported (or otherwise officially) ready to go, and just not included in an official release yet? I've built it from source but not used it yet... should we rely on it? Thank you! (New to Pinot.)
e
Hi Timothy As per my understanding its not officially released. But you can still use it. I am doing same for Proto stream ingestion
thankyou 1
t
Thanks for the response. Ok, does it work with pinot server 0.10.0 or can it only be used with server built with unreleased code on
master
? We're not operating the Pinot ourselves, we're connecting to our own customers' Pinot installations (which we don't control). I wonder if a developer of this code would be willing to chime in here, perhaps @Yupeng Fu? Thank you!!
y
I think it can work with 0.10
It uses rest api to push the segment
e
@Timothy James please be aware that its flushes the segment in micro batch way. Its different than ingesting directly from Kafka. FYI

https://www.youtube.com/watch?v=0byVuWrwOhw

(28 Min onwards)
t
Thank you.
Hi folks. Any sense of how this unreleased solution from Pinot differs from https://github.com/apache/bahir-flink/tree/master/flink-connector-pinot ?