Hi Team , I am running a job to import data form s...
# troubleshootings
sagar
02/11/2021, 6:31 AMHi Team , I am running a job to import data form s3 from parquet ,getting this error
Copy code
2021/02/11 06:27:24.999 ERROR [SegmentGenerationJobRunner] [pool-2-thread-1] Failed to generate Pinot segment for file - <s3://xxxx/xxxx/xxxx.0.parq>
java.lang.IllegalArgumentException: INT96 not yet implemented.x
Xiang Fu
02/11/2021, 6:32 AM
this is due to the int96 support is missing in parquet-avro lib, we are adding the native parquet support here: https://github.com/apache/incubator-pinot/pull/6525
Xiang Fu
02/11/2021, 6:32 AM
should be available soon
Xiang Fu
02/11/2021, 6:32 AM
for now, you can transform this field to int64. I think it’s timestamp in nano seconds right?
s
sagar
02/11/2021, 6:32 AMok thanx
sagar
02/11/2021, 6:41 AMyes its epoch time
sagar
02/11/2021, 6:42 AMwhen can we expect this parquet support , be available?
x
Xiang Fu
02/11/2021, 7:20 AM
Should be soon, this week or next week. @Sidd ^^