Jashwanth S J
09/11/2025, 10:45 AMEvents:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning SessionJobException 3m32s (x117 over 77m) Job Could not find a file system implementation for scheme 's3'. The scheme is directly supported by Flink through the following plugin(s): flink-s3-fs-hadoop, flink-s3-fs-presto. Please ensure that each plugin resides within its own subfolder within the plugins directory. See <https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/plugins/> for more information. If you want to use a Hadoop file system for that scheme, please add the scheme to the configuration fs.allowed-fallback-filesystems. For a full list of supported file systems, please see <https://nightlies.apache.org/flink/flink-docs-stable/ops/filesystems/>.Michał Slabik
09/11/2025, 10:49 AM./plugins directory as shown here: https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/filesystems/plugins/#file-systemsJashwanth S J
09/11/2025, 10:51 AMinitContainers:
- name: setup-certs-and-plugins
image: localhost:5000/alpine:latest
command:
- "sh"
- "-c"
- "wget -O /opt/flink/plugins/flink-s3-fs-hadoop-1.20.2.jar <https://repo1.maven.org/maven2/org/apache/flink/flink-s3-fs-hadoop/1.20.2/flink-s3-fs-hadoop-1.20.2.jar> && wget -O /opt/flink/plugins/flink-s3-fs-presto-1.20.2.jar <https://repo1.maven.org/maven2/org/apache/flink/flink-s3-fs-presto/1.20.2/flink-s3-fs-presto-1.20.2.jar>"
volumeMounts:
- name: cert-volume
mountPath: /usr/local/share/ca-certificates/
readOnly: true
- name: plugin-volume
mountPath: "/opt/flink/plugins"Michał Slabik
09/11/2025, 11:03 AMs3-fs-presto sub-directoryMichał Slabik
09/11/2025, 11:03 AMplugins directory should not be under /opt/flinkJashwanth S J
09/11/2025, 12:03 PMJashwanth S J
09/11/2025, 12:04 PMinitContainers:
- name: setup-certs-and-plugins
image: "alpine:latest"
command: ["sh", "-c", "wget -O /opt/flink/opt/flink-s3-fs-hadoop-1.16.1.jar <https://repo1.maven.org/maven2/org/apache/flink/flink-s3-fs-hadoop/1.16.1/flink-s3-fs-hadoop-1.16.1.jar> && wget -O /opt/flink/opt/flink-s3-fs-presto-1.16.1.jar <https://repo1.maven.org/maven2/org/apache/flink/flink-s3-fs-presto/1.16.1/flink-s3-fs-presto-1.16.1.jar>"]
volumeMounts:
- name: cert-volume
mountPath: /usr/local/share/ca-certificates/
readOnly: true
- name: plugin-volume
mountPath: "/opt/flink/opt"
containers:
- name: flink-main-container
env:
- name: ENABLE_BUILT_IN_PLUGINS
value: "flink-s3-fs-hadoop-1.16.1.jar;flink-s3-fs-presto-1.16.1.jar"Michał Slabik
09/11/2025, 12:15 PMENABLE_BUILT_IN_PLUGINS or copy plugins to ./plugins directory. Those 2 plugins are already in the flink image, no need to download it. FYI: https://nightlies.apache.org/flink/flink-docs-release-1.20/docs/deployment/resource-providers/standalone/docker/#using-filesystem-pluginsJashwanth S J
09/15/2025, 9:19 AMJashwanth S J
09/15/2025, 9:19 AMJashwanth S J
09/15/2025, 9:19 AMJob Could not find a file system implementation for scheme 's3'. The scheme is directly supported by Flink through the following plugin(s): flink-s3-fs-hadoop, flink-s3-fs-presto. Please ensure that each plugin resides within its own subfolder within the plugins directory. See <https://nightlies.apache.org/flink/flink-docs-stable/docs/deployment/filesystems/plugins/> for more information. If you want to use a Hadoop file system for that scheme, please add the scheme to the configuration fs.allowed-fallback-filesystems. For a full list of supported file systems, please see <https://nightlies.apache.org/flink/flink-docs-stable/ops/filesystems/>.Anuj Jain
11/18/2025, 7:57 AMJashwanth S J
11/18/2025, 9:03 AMJashwanth S J
11/18/2025, 9:03 AMAnuj Jain
11/18/2025, 9:04 AMAnuj Jain
11/18/2025, 9:04 AMJashwanth S J
11/18/2025, 9:04 AMJashwanth S J
11/18/2025, 9:05 AMJashwanth S J
11/18/2025, 9:05 AM