Hy guys.Can the same flink cluster connect to multiple S3 object storage service clusters? The endpoint, access-key, and secret-key are different. How to do that?

This is a good question. Those attributes are defined in the flink-conf.yaml, so it might be tricky?

You can use per-bucket configuration, e.g.

fs.s3a.bucket.<bucket_name>.access.key: XXX

https://hadoop.apache.org/docs/stable/hadoop-aws/tools/hadoop-aws/index.html#Configuring_different_S3_buckets_with_Per-Bucket_Configuration

Thank you all