Hi everyone. I'm looking to see if I can get some advice on the best option to use for a Parquet S3 file sink if our base object is a simple POJO, not Avro generated object, and we need the batch FileSink bucket assigner to have access to the Java object in order to know the event time of the object to build the output S3 path. We're currently using

AvroParquetWriters.forReflectRecord

since it specifically returns back the

T

object we pass in, but we know this is the least efficient solution. I thought about switching to using

forGenericRecord

, but that method returns a

ParquetWriterFactory

of

GenericRecord

which means we no longer have access to the event time information of the record in our Bucket Assigner. Does anyone have any recommendations for how we can optimize this Parquet writer?