Also Why does memory usage at the OS level (monito...
# troubleshooting
a
Also Why does memory usage at the OS level (monitored through top or free) for a Flink TaskManager continue to increase and never decrease, even though the Flink web UI shows memory being freed within the JVM? Could this indicate a native memory leak ?
a
Hi, I assume you're talking about JVM heap metric? This is not Flink specific detail, this is general JVM memory layout: In this case OS side monitoring can only show you committed memory size, i.e. memory reserved from OS by JVM to use. This memory can change during lifetime of application, depending on memory needs, but it is not eagerly released to OS, so usually you don't see drops. Flink UI shows you JVM heap usage, this is "live" usage - memory currently used in heap. This block is using memory that been requested from OS (committed, as described above) and can go up and down with heap memory allocations and GC runs respectively. Before looking into native memory leak, you need to check these values first (Flink also exposes all these memory metrics).