Magdalena Kobusch
06/26/2025, 8:19 AMtEnv.executeSql(
"CREATE CATALOG pulse_table WITH ("
+ "'type'='iceberg',"
+ "'warehouse'='arn:aws:s3tables:us-east-1:058264243434:bucket/kyk-dataeng-table-iceberg',"
+ "'catalog-impl'='org.apache.iceberg.aws.s3tables.S3TablesCatalog',"
+ ")"
);
But that is not working for me.
I have added:
dependencies {
implementation 'software.amazon.awssdk:s3tables:2.29.26'
implementation 'software.amazon.s3tables:s3-tables-catalog-for-iceberg:0.1.7'
}
But I'm still getting:
Exception in thread "main" java.lang.IllegalArgumentException: Cannot initialize Catalog implementation org.apache.iceberg.aws.s3tables.S3TablesCatalog: Cannot find constructor for interface org.apache.iceberg.catalog.Catalog
Missing org.apache.iceberg.aws.s3tables.S3TablesCatalog [java.lang.ClassNotFoundException: org.apache.iceberg.aws.s3tables.S3TablesCatalog]Andreas Bube
06/26/2025, 10:53 AMAndreas Bube
06/26/2025, 10:56 AMMagdalena Kobusch
06/26/2025, 10:58 AMAndreas Bube
06/26/2025, 10:58 AMlib folderAndreas Bube
06/26/2025, 11:01 AMlib folder like rmoff does in this part of the blog: https://rmoff.net/2025/06/24/writing-to-apache-iceberg-on-s3-using-flink-sql-with-glue-catalog/#_jar_locationAndreas Bube
06/26/2025, 11:04 AMlib folder)Magdalena Kobusch
06/26/2025, 1:43 PMflinkShadowJar "software.amazon.awssdk:s3tables:2.29.26"
flinkShadowJar "software.amazon.s3tables:s3-tables-catalog-for-iceberg:0.1.7"
And catalog definition as above.Magdalena Kobusch
06/26/2025, 1:43 PMAndreas Bube
06/27/2025, 6:37 AMsoftware.amazon.s3tables.iceberg.S3TablesCatalog (not org.apache.iceberg.aws.s3tables.S3TablesCatalog) for the catalog-impl. I'm basing this on looking at the source for S3TablesCatalog. Have you tried that?
If the above still fails, can you show the your full gradle file? Flink can be very finicky in terms of getting the classpath set up correctly.
Also, if you use the config flinkShadowJar, then there shouldn't be a need for copying the dependencies to the lib folder, as they will get included in the jar file produced by gradle.Magdalena Kobusch
06/30/2025, 10:48 AMAndreas Bube
06/30/2025, 10:49 AM