Hi all :clap: I'm running Flink MiniCluster in my ...
# troubleshooting
a
Hi all πŸ‘ I'm running Flink MiniCluster in my java application on windows. When it starts, I get this error
Copy code
Hadoop FS is not available (not packaged with this application): NoClassDefFoundError : "org/apache/hadoop/conf/Configuration". - HadoopFSDelegationTokenProvider.init
I dont need hdfs support, just want to properly start that MiniCluster. What to do to bypass that? Thanks Alot!! πŸ™‚
d
First
Copy code
import org.apache.flink.configuration.Configuration;

Configuration config = new Configuration();
config.setBoolean("fs.hdfs.enabled", false); // disable Hadoop filesystem support
config.setString("high-availability", "none"); // disable high availability mode which might also look for HDFS
Then pass this configuration to the MiniCluster builder and restart
Copy code
import org.apache.flink.api.common.JobExecutionResult;
import org.apache.flink.api.java.ExecutionEnvironment;
import org.apache.flink.runtime.minicluster.MiniCluster;
import org.apache.flink.runtime.minicluster.MiniClusterConfiguration;

MiniClusterConfiguration miniClusterConfig = new MiniClusterConfiguration.Builder()
    .setConfiguration(config) // Use the custom configuration
    .setNumTaskManagers(1)
    .setNumSlotsPerTaskManager(1)
    .build();

try (MiniCluster miniCluster = new MiniCluster(miniClusterConfig)) {
    miniCluster.start();
    
    // execute your job or 
    // 
    
} catch (Exception e) {
    e.printStackTrace();
}
a
Thanks alot for your help!