Hi all, I’m using `FileSystem` connector to read a...
# troubleshooting
y
Hi all, I’m using
FileSystem
connector to read avro files from a path which may contain non avro files that have to be filtered out (no partitioning), what I assume is a common case. Is there an easy way to do it? I was looking for a way to pass custom file filter predicate to the default
NonSplittingRecursiveEnumerator
, or specify
FileEnumrator
provider to the
FileSource
without the need to implement custom connector, but it seems to be tricky because
FileSource.FileSourceBuilder
, which has a setter for the FileEnumerator, is initiated in private method in FileSystemTableSource.
Found the open PR that solves it: https://github.com/apache/flink/pull/22249