Felix Angell
04/18/2023, 1:54 PMjava.lang.NoSuchMethodError: 'org.apache.flink.metrics.MetricGroup org.apache.flink.api.common.functions.RuntimeContext.getMetricGroup()'
at org.apache.flink.streaming.connectors.kinesis.internals.KinesisDataFetcher.<init>(KinesisDataFetcher.java:416)
at org.apache.flink.streaming.connectors.kinesis.internals.KinesisDataFetcher.<init>(KinesisDataFetcher.java:365)
Essentially we've upgraded to 1.15.2 flink (on KDA) and we're using flink-sql-connector-kinesis v 1.15.3 which exposes a FlinkKinesisConsumer. We are using PyFlink and so we mapped this FlinkKinesisConsumer class with the jvm_gateway. On using this we get the above exception as of doing this upgrade.
I can still resolve this getMetricGroup symbol manually if I were to add the dependency to this flink-sql-connector-kinesis pom in a typical java project, but in the PyFlink environment it doesn't seem to pick it up.
Any ideas what is up here? Let me know if you need more detailsFelix Angell
04/18/2023, 2:10 PMgetMetricGroup() has changed from MetricGroup to returning OperatorMetricGroup instead in 1.15. not sure if this would be relevant?Felix Angell
04/18/2023, 2:18 PMflink-connector-kinesisMartijn Visser
04/18/2023, 2:38 PMflink-sql-connector-kinesis is a fat JAR which usually is used in Table API/SQL application. flink-connector-kinesis is meant for DataStream API appsFelix Angell
04/18/2023, 3:17 PMFelix Angell
04/18/2023, 3:18 PMMartijn Visser
04/18/2023, 3:19 PM*we get nosuchmethod error due to compiling with mixed flink versions? (edited)Patch versions should be compatible, unless the application relies on
Experimental or Internal interfacesFelix Angell
04/18/2023, 3:20 PM