Hi What is the best way to create a table source f...
# troubleshooting
a
Hi What is the best way to create a table source from multiple input paths on Flink 1.16?
Copy code
String paths = "<s3://bucket/path/20231011/,s3://bucket/path/20231012/,s3://bucket/path/20231013/>"

tableEnv.createTemporaryTable("MyTable", TableDescriptor.forConnector("filesystem")
        .schema(schema)
        .option("path", inputPaths)
        .format(FormatDescriptor.forFormat("avro").build())
        .build());
Each path above has multiple avro files and I cannot use
<s3://bucket/path>
because I only want to read a particular range of folders.
Can someone help me here? It feels weird that why something so simple has to be so hard in Flink. This is so much easier in Spark so I think I am probably doing something wrong here?
m
I'm not sure that you can provide multiple input paths; I would need to check that.
a
The only solution we were able to find was to union the Tables and then use them. Not the best solution but works.