Hi - small question - when using file compaction, ...
# troubleshooting
s
AFAIK not really, unless you patch the connector
😢 1
m
Also, a related question: can the
.part
files be written to a different bucket than the
compacted-
files? This would help us when the destination bucket is in a different region to where the flink job runs. Instead of there being a
write parts -> read parts -> write compacted
sequence across regions, which is expensive, we'd just like to write and read the parts in one bucket and write the compacted file to another bucket.