@RunLLM best way to monitor the pulsar interl health like ledger metadata and ledger corruptions

To monitor Pulsar internal health, including ledger metadata and ledger corruptions, use a combination of Prometheus metrics, Grafana dashboards, and the PCK (Pulsar Consistency Checker) CLI tool. Prometheus and Grafana provide real-time monitoring of broker, BookKeeper, and ZooKeeper metrics, while PCK detects inconsistencies between Pulsar metadata (ZooKeeper) and data (BookKeeper/tiered storage), such as missing or orphaned ledgers. For setup, expose Pulsar, BookKeeper, and ZooKeeper metrics to Prometheus, then visualize them in Grafana. Use PCK regularly to check for metadata/data mismatches and ledger issues. For details, see PCK Overview, Monitoring Guide, and Grafana Dashboard. Would you like more detail on configuring these tools or interpreting specific metrics? Sources: - PCK Overview - Monitoring Guide - Grafana Dashboard 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.

@RunLLM Pulsar PCK tool can we use it for standalone pulsar ?

Yes, you can use the Pulsar PCK (Pulsar Consistency Checker) tool with a standalone Pulsar deployment. When running PCK, provide the ZooKeeper connection string and service URL for your standalone instance, along with the topic you want to check. This allows you to detect missing or orphaned ledgers in standalone mode as well as in clustered deployments, as shown in the PCK Tutorial. Would you like more detail on the exact command usage for standalone Pulsar? Sources: - PCK Tutorial 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.

@RunLLM where can i find the source code or cli download option for PCK

The PCK (Pulsar Consistency Checker) tool is included as part of the StreamNative Platform tools, not as a separate open-source project. You can access it via the

sn-pulsar-tools

package provided by StreamNative. There is no standalone public repository for PCK; it is distributed with StreamNative's enterprise/private cloud offerings. For more information, see the PCK Tutorial. Would you like more detail on how to obtain or use

sn-pulsar-tools

? Sources: - PCK Tutorial 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.

@RunLLM yes

It seems likely that to obtain and use

sn-pulsar-tools

(which includes PCK), you need access to the StreamNative Platform distribution. After downloading and extracting the platform package, you will find the CLI tools (including PCK) in the

/pulsar/sn-pulsar-tools/bin/

directory. You can then run commands like

sn-pulsar-tools pck bookie detect-missing-ledger

or

sn-pulsar-tools pck bookie find-orphan-ledger

as described in the PCK Tutorial. If you do not have access to the StreamNative Platform, you may need to contact StreamNative for a download or trial. There is no public, standalone download for PCK outside of the StreamNative distribution. Sources: - PCK Tutorial 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.