hei, it is me again. We are trying to configure fl...
# troubleshootingo
Oscar Perez
05/24/2023, 1:58 PMhei, it is me again. We are trying to configure flink with hadoop as instructed here (https://nightlies.apache.org/flink/flink-docs-release-1.10/ops/deployment/hadoop.html) but we would like to use hadoop v3 but we do not see any shaded version for hadoop 3.x release. we want to use Hive 3.1.3 and Hadoop 3.3.3 and would like to use the shaded lib approach if possible. How can we do it for hadoop v3? Thanks!
m
Martijn Visser
05/24/2023, 2:07 PMThat's for Flink 1.10, which isn't supported in the community anymore
Martijn Visser
05/24/2023, 2:08 PMThe new instructions are at https://nightlies.apache.org/flink/flink-docs-master/docs/dev/configuration/advanced/#hadoop-dependencies
o
Oscar Perez
05/25/2023, 7:38 AMoh, thanks! Does this mean I need to bake an image containing both flink and hadoop? Are there already baked images with both available somewhere? Thanks!
m
Martijn Visser
05/25/2023, 9:22 AMDoes this mean I need to bake an image containing both flink and hadoop?I don't know to be honest.
Are there already baked images with both available somewhere?Not from the Flink community at least, there's no tight coupling between Flink and Hadoop