Hello 👋 im just started learning Pinot 😄 I have MYSQL database with dataset how can I populate Pinot with this data. I do not see any integration with MYSQL here https://docs.pinot.apache.org/basics/data-import. Could you advise on it? 😅

At the moment you can’t directly import data from MySQL. One way to do so would be something like debizium + Kafka -> Pinot

yeah I came here to mention debizium for this

Thanks @Srini Kadamati

there is another option if its one time

good point! Here are all the things I’ve done in the past for situations like this @karsen53 • CDC (debezium, Fivetran, airbyte, etc): For constant re-syncing multiple times an hour • Simple Python script: Sync small - medium sized dataset multiple times an hour • Spark ETL script: syncing large datasets once an hour / once a day • Export to parquet / CSV / JSON and import back: Syncing small - medium dataset like ~once These are all very rough back of the hand estimates but hopefully you get the idea!

Thanks @Srini Kadamati your instruction can go on the pinot docs verbatim 🙂 .

sure! happy to open a PR and expand. Maybe my summary can go as an overview here or something: https://docs.pinot.apache.org/basics/data-import

Thanks @Srini Kadamati

as a side note — it took me a while to figure out which Github repo (pinot-site or this one) was the right one for pinot documentation source code. Just some feedback 😅 it wasn’t clear in the Pinot github repo

Still, we need to make it more discoverable.

Thanks for all your answers! 😄

addressed feedback 🙂 https://github.com/pinot-contrib/pinot-docs/pull/105 Would appreciate a review!

@Jackie is this good to go ?

Yes, merged! Thanks for the contribution @Srini Kadamati

🎉 woot thanks y’all!