Hello Flink Community, Need help! I have a Flink b...
# troubleshooting
s
Hello Flink Community, Need help! I have a Flink batch job which uses table API. Joins are as follows t1 - pivot table / master table t2 --> t4 t2 --> t5 t2 --> t6 t1 --> t2 t1 --> t3 All joins are left outer joins and all of the joined data goes into
table t1
finally and t4, t5, t6 could be emoty datasets too. The Flink app seems to be working just fine when we are submitting it locally. But the same job when we are trying to deploy in the cluster we are running into the exception with below stacktrace. The job is up and running and this exception is during the execution of pipeline.
Copy code
at org.apache.flink.util.Preconditions.checkArgument(Preconditions.java:122)                                                                                        
       at org.apache.flink.table.runtime.hashtable.BaseHybridHashTable.init(BaseHybridHashTable.java:164)                                                                
       at org.apache.flink.table.runtime.hashtable.LongHybridHashTable.init(LongHybridHashTable.java:82)                                                                 
       at LongHashJoinOperator$2342$LongHashTable$2236.init(Unknown Source)                                                                                              
       at LongHashJoinOperator$2342.open(Unknown Source)                                                                                                                   
       at org.apache.flink.table.runtime.operators.multipleinput.MultipleInputStreamOperatorBase.open(MultipleInputStreamOperatorBase.java:128)                            
       at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:107)                                     
       at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:726)                                                                            
       at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.call(StreamTaskActionExecutor.java:55)                                                       
       at org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:702)                                                                         
       at org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:669)                                                                                 
       at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:935)                                                                             
       at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:904)                                                                                        
       at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:728)                                                                                                   
       at org.apache.flink.runtime.taskmanager.Task.run(Task.java:550)                                                                                                     
       at java.base/java.lang.Thread.run(Unknown Source)                                                                                                                   
       Suppressed: java.lang.NullPointerException                                                                                                                          
               at org.apache.flink.table.runtime.operators.join.HashJoinOperator.close(HashJoinOperator.java:239)                                                          
               at org.apache.flink.table.runtime.operators.multipleinput.TableOperatorWrapper.close(TableOperatorWrapper.java:197)                                         
               at org.apache.flink.table.runtime.operators.multipleinput.MultipleInputStreamOperatorBase.close(MultipleInputStreamOperatorBase.java:155)                   
               at org.apache.flink.streaming.runtime.tasks.StreamOperatorWrapper.close(StreamOperatorWrapper.java:163)                                                     
               at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.closeAllOperators(RegularOperatorChain.java:125)                                           
               at org.apache.flink.streaming.runtime.tasks.StreamTask.closeAllOperators(StreamTask.java:1025)                                                              
               at org.apache.flink.util.IOUtils.closeAll(IOUtils.java:255)                                                                                                 
               at org.apache.flink.core.fs.AutoCloseableRegistry.doClose(AutoCloseableRegistry.java:72)                                                                    
               at org.apache.flink.util.AbstractAutoCloseableRegistry.close(AbstractAutoCloseableRegistry.java:127)                                                        
               at org.apache.flink.streaming.runtime.tasks.StreamTask.cleanUp(StreamTask.java:943)                                                                         
               at org.apache.flink.runtime.taskmanager.Task.lambda$restoreAndInvoke$0(Task.java:917)                                                                       
               at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:935)                                                                     
               at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:917)                                                                                
               ... 3 more