https://flink.apache.org/ logo
Join Slack
Powered by
how do I fix this issue? ```org.rocksdb.RocksDBExc...
# troubleshooting
c
how do I fix this issue?
Copy code
org.rocksdb.RocksDBException: While open a file for appending: /opt/flink/log/tmp_tm_flink-native-concurrent-counter-fingerprint-taskmanager-2-176_tmp_job_fdfa20c065c3443a0f05d56a45c312c3_op_KeyedProcessOperator_58a461be943b6304e654ee058d1ec08e__7_10__uuid_2eebc0b8-34d8-4bb8-9651-ba79bc3ef8bf_bfeb6a0e-20fd-4e91-835f-7c6616081783_LOG: File name too long
	at org.rocksdb.RocksDB.open(Native Method)
	at org.rocksdb.RocksDB.open(RocksDB.java:315)
	at org.apache.flink.state.rocksdb.RocksDBOperationUtils.openDB(RocksDBOperationUtils.java:89)
	... 28 more
I don't seem to have control over the file name and the operator name is auto generated (flink sql)
this is with flink 2.2.0 but it was supposed to be fixed long ago? https://github.com/apache/flink/pull/22458
Copy code
org.rocksdb.RocksDBException: While open a file for appending: /opt/flink/log/tmp_tm_flink-tasev2-scraper-logout-taskmanager-5-3221_tmp_job_233ce66d41ff3ce105d15be70a7a289d_op_MiniBatchLeftOuterJoinStreamOperator_8eea6090bb313a438eb63192178bea13__3_15__uuid_a481a872-2463-4cb3-be93-612156b85e18_bf4c87c6-f715-4d96-a174-ee67bcfaacfc_LOG: File name too long
	at org.rocksdb.RocksDB.open(Native Method) ~[flink-dist-2.2.0.jar:2.2.0]
	at org.rocksdb.RocksDB.open(RocksDB.java:315) ~[flink-dist-2.2.0.jar:2.2.0]
	at org.apache.flink.state.rocksdb.RocksDBOperationUtils.openDB(RocksDBOperationUtils.java:89) ~[flink-dist-2.2.0.jar:2.2.0]
	... 28 more
my job name and the default directory is already reasonably short 😞
it's just that the auto generated operator id from my flink SQL query is too long and I dunno how to stop that
Open in Slack
PreviousNext
Powered by