Hi all, I get this exception from my Pyflink appli...
# troubleshooting
f
Hi all, I get this exception from my Pyflink application. I am not sure what MainClass it is referring to but I have the main method in my python file. I am deploying on AWS kinesis data analytics and I uploaded my application code and jar connector archived together as instructed by the documentation.
Internal server error.<Exception on server side:
java.util.concurrent.CompletionException: org.apache.flink.client.program.ProgramInvocationException: Neither a 'Main-Class', nor a 'program-class' entry was found in the jar file.
at org.apache.flink.runtime.webmonitor.handlers.JarRunOverrideHandler.handleRequest(JarRunOverrideHandler.java:262)
at org.apache.flink.runtime.webmonitor.handlers.JarRunOverrideHandler.handleRequest(JarRunOverrideHandler.java:88)
at org.apache.flink.runtime.rest.handler.AbstractRestHandler.respondToRequest(AbstractRestHandler.java:83)
a
Hi, Have you added your python file and jar locations to Properties while configuring your application? It should be like this: Group Id:
kinesis.analytics.flink.run.options
python: <python file>
jarfile: <jar with dependencies>
f
yes I did. I have a question though, I have files that my main python file depends on. These are are ordinary python files with functions. Do I have to specify them under pyFiles, or that is for third party imports only? I am abit confused on that part.
a
That depends on whether these dependencies are used in UDFs (i.e. would be used when running on TaskManagers). If yes - you need to add them in order to use them Additional information can be found here https://github.com/aws-samples/amazon-kinesis-data-analytics-examples/tree/master/python/PythonPackages