👋 Hello, team! I have a question about the readFile implementation. From the official docs: IMPLEMENTATION: Under the hood, Flink splits the file reading process into two sub-tasks: directory monitoring and data reading. Each of these sub-tasks is implemented by a separate entity. Monitoring is implemented by a single, non-parallel (parallelism = 1) task, while reading is performed by multiple tasks running in parallel. The parallelism of the latter is equal to job parallelism. The role of the single monitoring task is to scan the directory (periodically or only once depending on the

watchType

), find the files to be processed, divide them in splits, and assign these splits to the downstream readers. The readers are the ones who will read the actual data. Each split is read by only one reader, while a reader can read multiple splits, one-by-one. So what do you mean by readers here? Is it some kind of interdependent task under TM or something else?

FYI, it's probably better to look at the FileSource instead,

readFile

can be considered deprecated.

Thanks but actually my question was what do you mean by readers here under the hood @sap1ens #C03G7LJTS2G?