ok, just going to ask as i'm loosing my cool/marbl...
# random
g
ok, just going to ask as i'm loosing my cool/marbles/sanity here, trying to get this jar "pie" build. anyone have a docker compose for 1.20.1 or 1.20.2 that includes the following. iceberg 1.9.1 catalog on jdbc -> postgres, chosen as it can handle both apace iceberg and apache paimon Iceberg storage on Minion/S3 file format will be parquet. flink cdc 3.5.0
m
This is what @rmoff blogged a while ago as having as dependencies https://rmoff.net/2025/06/24/writing-to-apache-iceberg-on-s3-using-flink-sql-with-glue-catalog/#_jar_location - It doesn't have the JDBC catalog, but hopefully it helps a little bit
g
will go have a look again, i've read most of his stuff... thanks for the reminder... running out of hair here
hmmm all previous examples i've seen normally :
Copy code
RUN echo "--> Install JARs: Flink's S3 plugin" && \
   mkdir -p ./plugins/s3-fs-hadoop && \
   mv ./opt/flink-s3-fs-hadoop-1.20.1.jar ./plugins/s3-fs-hadoop/
I dont see him doing this. trying to execute create table against iceberg immediately tell me can't find s3 driver.
hmmm, ok, he's writing to aws s3 and running against glue as catalog, close but not there, just enough difference to break things πŸ˜‰