Hi all, I’m trying to add `flink-connector-kinesis...
# troubleshooting
m
Hi all, I’m trying to add
flink-connector-kinesis-1.15.2.jar
The job starts successfully but immediately runs into this root exception:
java.lang.NoClassDefFoundError: org/apache/commons/logging/LogFactory
It appears the sql version of this connector does not have this issue, so I will use the Table API and then convert to a DataStream.
Ah, it appears that the SQL connector has bundled shaded dependency classes, but the non-SQL connector has not 😔
d
This is intentional and consistent with Flink connectors. The user app build is meant to bundle transitive dependencies into the final jar. Using the SQL connector does not limit you to table API. It is just an Uber jar build, but is equivalent in features/API support.
🙌 1
m
Thanks Danny, as I am using PyFlink on a managed Flink platform, I do not have a java build step where a bundled jar is typically produced
d
Makes sense, thanks for the context.