Hi, I have one use case and was wondering if anyon...
# troubleshooting
l
Hi, I have one use case and was wondering if anyone had similar requirements. I want to use
FileSource.forBulkFileFormat
to consume parquet data from S3. The source s3 bucket has hive style partitioning so I want to make sure that each source reader reads only a single partition. As far as I understand there’s no out of the box solution for this and I must look into implementing custom
FileEnumerator
and
FileSplitAssigner
?