is there a quicker way to create schema from data files. we have about 1200 columns and wondering if there is any jar that automatically creates a schema file for pinot

What format is the data in?

@Kartik Khare parquet

Ok. Not sure about that. We have one for Avro. @Xiang Fu is there a way to solve this?

I think you can read parquet file schema as Avro schema then do the conversion?

does the column order need to match the data file order in any way or pinot loads to the correct column based on name?

it doensn’t matter for column ordering