Hi all, I'm looking for a tool which can give an overview of the setup of a kafka cluster, so • which topics are there • what are the schemas used for a topic • which producers and consumers exist for each topic • are there consumers which are lagging behind? I got the kafka-metadata ingest working but unfortunately this source lacks information about the producers and consumers. So I'm wondering if the kafka-connect ingest (https://datahubproject.io/docs/metadata-ingestion/source_docs/kafka-connect) will give me what I need, however the documentation is a bit unclear to me. Can someone tell me: • what the kafka connect is ingesting exactly? • why the kafka connect example configuration has some DB connection configured? Thanks in advance!

username/password are optional as they are not marked required in the docs https://datahubproject.io/docs/metadata-ingestion/source_docs/kafka-connect/. Under "Capabilities" it mentions what it is extracting. Is that not clear?

@best-television-56567 kafka connect source is ingesting consumers and producers configured using kafka connect tool. Example configuration includes credentials for connecting to kafka connect REST API.

It wasn't clear to me that kafka had something like a kafka-connect tool which is what this ingestion tool is using. That's where the confusion came from. Thank you all for the info!

Perhaps irrelevant now, but we use https://github.com/tchiotludo/akhq for kafka ui visualization.