Dear Flink Community, I have the following File Si...
# troubleshooting
m
Dear Flink Community, I have the following File Sink and I would like to make sure the intermediary files before compaction are not stored in S3 but rather on local disk. Can someone suggest if/how this could be done?
Copy code
FileSink<KafkaMessage> sink = FileSink
			.forBulkFormat(buildPath(context), new ZstdWriterFactory<KafkaMessage>())
			.withOutputFileConfig(outputFileConfig())
			.withRollingPolicy(new CustomCheckpointRollingPolicy<>(
				mbToBytes(context.getTargetFileSizeMB()),
				minToMillis(context.getMaxInactivityMinutes())))
			.withBucketAssigner(new CustomBucketAssigner())
			.enableCompact(
					FileCompactStrategy.Builder.newBuilder()
							.setSizeThreshold(100000)
							.enableCompactionOnCheckpoint(100)
							.build(),
					new ConcatFileCompactor())
			.build();