:sos: help needed :pray: - CN crashing (3.5.8) - s...
# questions-and-troubleshooting
d
🆘 help needed 🙏 - CN crashing (3.5.8) - stacktrace in 🧵
Copy code
query_id:00000000-0000-0000-0000-000000000000, fragment_instance:00000000-0000-0000-0000-000000000000
*** Aborted at 1764857883 (unix time) try "date -d @1764857883" if you are using GNU date ***
PC: @          0x457a4b4 starrocks::NodeChannel::is_full()
*** SIGSEGV (@0x312e33332e3319) received by PID 2631640 (TID 0xfffecb5cfe40) LWP(2632596) from PID 858665753; stack trace: ***
    @     0xffffb5f4ebc0 __pthread_once_slow
    @          0xa710bf0 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*)
    @     0xffffb6ed6df0 PosixSignals::chained_handler(int, siginfo_t*, void*) [clone .part.0]
    @     0xffffb6ed77bc JVM_handle_linux_signal
    @     0xffffb774c830 ([vdso]+0x82f)
    @          0x457a4b4 starrocks::NodeChannel::is_full()
    @          0x4587278 std::_Function_handler<void (starrocks::NodeChannel*), starrocks::TabletSinkSender::is_full()::{lambda(starrocks::NodeChannel*)#1}>::_M_invoke(std::_Any_data const&, starrocks::NodeChannel*&&)
    @          0x4587cdc starrocks::TabletSinkSender::is_full()
    @          0x4563e48 starrocks::OlapTableSink::is_full()
    @          0x498a324 starrocks::pipeline::OlapTableSinkOperator::pending_finish() const
    @          0x4e94a84 starrocks::pipeline::PipelineDriverPoller::run_internal()
    @          0x3d39844 starrocks::Thread::supervise_thread(void*)
    @     0xffffb5f49b78 start_thread
    @     0xffffb5fb6cdc thread_start
[1764857883.956][thread: 281469798645312] je_mallctl execute purge success
[1764857883.956][thread: 281469798645312] je_mallctl execute dontdump success
Crashed more than once today
k
looks like the memory is corrupted.
SIGSEGV (@0x312e33332e3319)
this address is more like part of an ip address string:
1.33.3
, do you have coredump enabled for the crash?
d
@Kevin Cai thanks for your response! Unfortunately the core dumps are probably gone (I will double-check) as we decommissioned problem ec2 instances (arm architecture). There is also good news - there is more info in this GitHub issue opened by my colleague last night https://github.com/StarRocks/starrocks/issues/66347
👍 1