Levani Kokhreidze
07/09/2024, 2:39 PMFileSource.forBulkFileFormat to consume parquet data from S3. The source s3 bucket has hive style partitioning so I want to make sure that each source reader reads only a single partition. As far as I understand there’s no out of the box solution for this and I must look into implementing custom FileEnumerator and FileSplitAssigner ?