Hey Guys had anyone had issue with Flink 1.16 and Hudi 0.13.X i have a pipeline where i am reading CDC from postgres using postgrescdc connector and i am able to see the data as well but when attempting to write data into Hudi i see hudi folder but no parquet files. complete steps can be found GH Issue 977

# Define the data to be inserted into the Hudi table
table_env.execute_sql("""
    INSERT INTO shipments_hudi_sink
        SELECT * FROM shipments_source
""").wait()

Here are logs after this command Logs

2023-09-23 16:50:18,442 WARN  org.apache.hadoop.metrics2.impl.MetricsConfig                [] - Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties
2023-09-23 16:50:18,475 INFO  org.apache.hadoop.metrics2.impl.MetricsSystemImpl            [] - Scheduled Metric snapshot period at 10 second(s).
2023-09-23 16:50:18,476 INFO  org.apache.hadoop.metrics2.impl.MetricsSystemImpl            [] - s3a-file-system metrics system started
2023-09-23 16:50:30,357 WARN  org.apache.hadoop.metrics2.impl.MetricsConfig                [] - Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties
2023-09-23 16:50:30,369 WARN  org.apache.hadoop.metrics2.util.MBeans                       [] - Failed to register MBean "Hadoop:service=s3a-file-system,name=MetricsSystem,sub=Stats": Instance already exists.
2023-09-23 16:50:30,369 INFO  org.apache.hadoop.metrics2.impl.MetricsSystemImpl            [] - Scheduled Metric snapshot period at 10 second(s).
2023-09-23 16:50:30,369 INFO  org.apache.hadoop.metrics2.impl.MetricsSystemImpl            [] - s3a-file-system metrics system started
2023-09-23 16:50:30,373 WARN  org.apache.hadoop.metrics2.util.MBeans                       [] - Failed to register MBean "Hadoop:service=s3a-file-system,name=MetricsSystem,sub=Control": Instance already exists.
2023-09-23 16:50:30,375 WARN  org.apache.hadoop.metrics2.util.MBeans                       [] - Failed to register MBean "Hadoop:service=s3a-file-system,name=S3AMetrics1-datateam-sandbox-qa-demo": Instance already exists.
2023-09-23 16:50:35,867 WARN  org.apache.hadoop.metrics2.impl.MetricsConfig                [] - Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties
2023-09-23 16:50:35,961 WARN  org.apache.hadoop.metrics2.util.MBeans                       [] - Failed to register MBean "Hadoop:service=s3a-file-system,name=MetricsSystem,sub=Stats": Instance already exists.
2023-09-23 16:50:40,963 INFO  org.apache.hadoop.metrics2.impl.MetricsSystemImpl            [] - Scheduled Metric snapshot period at 10 second(s).
2023-09-23 16:50:40,964 INFO  org.apache.hadoop.metrics2.impl.MetricsSystemImpl            [] - s3a-file-system metrics system started
2023-09-23 16:50:40,966 WARN  org.apache.hadoop.metrics2.util.MBeans                       [] - Failed to register MBean "Hadoop:service=s3a-file-system,name=MetricsSystem,sub=Control": Instance already exists.
2023-09-23 16:50:40,972 WARN  org.apache.hadoop.metrics2.util.MBeans                       [] - Failed to register MBean "Hadoop:service=s3a-file-system,name=S3AMetrics1-datateam-sandbox-qa-demo": Instance already exists.
# WARNING: Unable to get Instrumentation. Dynamic Attach failed. You may add this JAR as -javaagent manually, or supply -Djdk.attach.allowAttachSelf
# WARNING: Unable to get Instrumentation. Dynamic Attach failed. You may add this JAR as -javaagent manually, or supply -Djdk.attach.allowAttachSelf
# WARNING: Unable to attach Serviceability Agent. Unable to attach even with module exceptions: [org.apache.hudi.org.openjdk.jol.vm.sa.SASupportException: Sense failed., org.apache.hudi.org.openjdk.jol.vm.sa.SASupportException: Sense failed., org.apache.hudi.org.openjdk.jol.vm.sa.SASupportException: Sense failed.]
# WARNING: Unable to attach Serviceability Agent. Unable to attach even with module exceptions: [org.apache.hudi.org.openjdk.jol.vm.sa.SASupportException: Sense failed., org.apache.hudi.org.openjdk.jol.vm.sa.SASupportException: Sense failed., org.apache.hudi.org.openjdk.jol.vm.sa.SASupportException: Sense failed.]

Anyone has any clue how can i solve this Error Here are list of JAR

# Define a list of JAR file names you want to add
jar_files = [
    "flink-sql-connector-postgres-cdc-2.4.1.jar",
    "postgresql-42.6.0.jar",
    "flink-connector-jdbc-1.16.1.jar",
    
    "flink-s3-fs-hadoop-1.16.1.jar",
    # "flink-s3-fs-hadoop-1.16.0.jar",
    # "flink-s3-fs-hadoop-1.13.0.jar"
    
    # "hudi-flink1.16-bundle-0.13.1.jar"
     "hudi-flink1.16-bundle-0.13.0.jar"
    # ,"hudi-flink-bundle_2.12-0.10.1.jar"
]

GH https://github.com/apache/hudi/issues/9777

This question is better asked towards the Hudi community, but you're definitely mixing different Flink versions artifacts together. That won't work anyway

Thanks Yes I tried different JAR didn’t work My issue was around hudi I will ask in hudi community