https://pinot.apache.org/ logo
s

sagar

02/11/2021, 6:31 AM
Hi Team , I am running a job to import data form s3 from parquet ,getting this error
Copy code
2021/02/11 06:27:24.999 ERROR [SegmentGenerationJobRunner] [pool-2-thread-1] Failed to generate Pinot segment for file - <s3://xxxx/xxxx/xxxx.0.parq>
java.lang.IllegalArgumentException: INT96 not yet implemented.
x

Xiang Fu

02/11/2021, 6:32 AM
this is due to the int96 support is missing in parquet-avro lib, we are adding the native parquet support here: https://github.com/apache/incubator-pinot/pull/6525
should be available soon
for now, you can transform this field to int64. I think it’s timestamp in nano seconds right?
s

sagar

02/11/2021, 6:32 AM
ok thanx
yes its epoch time
when can we expect this parquet support , be available?
x

Xiang Fu

02/11/2021, 7:20 AM
Should be soon, this week or next week. @Sidd ^^