Hi team, I am trying to achieve dynamic rules in m...
# troubleshooting
k
Hi team, I am trying to achieve dynamic rules in my Flink Job, I have gone through this references and I have implemented this way in Data stream it is working fine but now, I want to use Table API so I have thought of -->converting input of Rule evaluator to Table --> apply SQL rule -->To give back result I have tried below approaches 1. Give to Kafka Sink table directly (It’s not working) giving me below error Caused by: org.apache.flink.streaming.runtime.tasks.StreamTaskException: Cannot load user class: org.apache.flink.connector.kafka.sink.KafkaSink ClassLoader info: URL ClassLoader: Class not resolvable through given classloader. at org.apache.flink.streaming.api.graph.StreamConfig.getStreamOperatorFactory(StreamConfig.java:397) at org.apache.flink.streaming.runtime.tasks.OperatorChain.<init>(OperatorChain.java:166) at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.<init>(RegularOperatorChain.java:60) at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:688) at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:675) at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:952) at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:921) at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:745) at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562) at java.base/java.lang.Thread.run(Unknown Source) Caused by: java.lang.ClassNotFoundException: org.apache.flink.connector.kafka.sink.KafkaSink at java.base/java.net.URLClassLoader.findClass(Unknown Source) at java.base/java.lang.ClassLoader.loadClass(Unknown Source) at org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:67) at org.apache.flink.util.ChildFirstClassLoader.loadClassWithoutExceptionHandling(ChildFirstClassLoader.java:65) at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:51) at java.base/java.lang.ClassLoader.loadClass(Unknown Source) at 2. Convert table to Data stream in rule evaluator and extract data from datastream (But it’s taking to much time) Is there any way I can apply dynamic SQL rule to log stream? Thank you so much for your time and effort,
Any help will be very helpful?
r
+1 - also interested in a potential solution to dynamic rules in Table API
d
Me too, this would be of interest.
@Keyur Makwana did you figure anything out here?
k
No