Slackbot
04/18/2023, 8:14 PMdontu balu
04/18/2023, 8:37 PM"ioConfig": {
"type": "hadoop",
"inputSpec": {
"type": "static",
"inputFormat": "org.apache.druid.data.input.parquet.DruidParquetInputFormat",
"paths": "<path>",
"compressCodec": "zstd"
}
},
Should we install any packages on druid servers to be able to read these data?Gian Merlino
04/20/2023, 6:26 AM<http://org.apache.hadoop.io|org.apache.hadoop.io>.compress.ZStandardCodec is available from hadoop 2.9 onwards. we're currently using 2.8.2
We haven't been upgrading it since we more-or-less decided to keep it frozen in time, as people gradually move from hadoop onto native ingestion or MSQ
perhaps one of those (native or MSQ) would work for you too
or, you could try building a version of Druid with a later Hadoop.