Hello community, if anyone can help me with some q...
# troubleshooting
d
Hello community, if anyone can help me with some questions about configuring flink with hive and hadoop, I would appreciate it. I currently have 3 clusters, 1 with flink 1.18, another with hive 3.1.3 and another with hadoop 3.3.6. I have these environments working with Azure Data Lake G2. I am creating Jobs that work with iceberg, I am also testing iceberg using hive as a catalog from the flink sql client in which I can create a catalog, a database and the icebreg table without problem, but when trying to insert records the following error appears: • java.lang.NoSuchMethodError: 'org.apache.iceberg.shaded.com.fasterxml.jackson.databind.ObjectMapper org.apache.iceberg.util.JsonUtil.mapper() I understand that it is due to compatibility with a particular Jackson library... (core, databindin, annotations, and some others) I have the libraries included within the image not in a POM file, this is because when I use a POM for the job the errors tell me that these libraries must be included in the classpath. So my question for this problem would be the following: • How can I really use the POM without having to include the libraries in the Classpath? • If this is not possible, how should I configure flink to use hive and hadoop without having to include an installation of them within the flink cluster? If my questions are not related to the solution and someone knows which path to take, I would appreciate it if you can guide me along the best way.