Is there a tool to load data and schema from postgres? I would like to get some data into pinot and see how it works for our data, but creating the schema/index manually is a bit of a pain as the tables have large number of columns.
k
Kishore G
01/10/2022, 10:26 PM
Hi Dash,
We dont have a tool to create Pinot Schema from Postgres table. One workaround is to export postgres to Avro and we have the ability t o create pinot schema from Avro file
d
Dash Debabrata
01/10/2022, 11:01 PM
Thanks, will try this out.
k
Kenny Bastani
01/18/2022, 8:49 PM
@User You might have already solved this, but I've built a little schema transformer for DDLs that will automatically generate the schema JSON. Let me know if you're interested and I'll put it up on GitHub somewhere.
d
Dash Debabrata
01/18/2022, 9:01 PM
I haven’t done it. The tool sounds interesting, will try it out if you made it avaliable.