Greetings, I think there is a flaw in `flink-s3-fs...
# troubleshooting
e
Greetings, I think there is a flaw in
flink-s3-fs-native
plugin design. For relatively small savepoints, it works without any issues, but if the savepoint is large, e.g. 100GB in size, then this part here: github.com/apache/flink/blob/…/NativeS3OutputStream.java#… will never complete in a timely manner. Could someone confirm or deny this?
g
maybe its better to post this on the mailing list, because its more likely to get a response there πŸ˜„
m
I think that was already flagged here github.com/apache/flink/pull/27187#… and that's why there's issues.apache.org/jira/browse/FLINK-39112