is there any way in Flink Pipeline Ui, we can get ...
# troubleshooting
n
is there any way in Flink Pipeline Ui, we can get the number of partitions in the source topic?
r
I don’t think it’s exposed at that high of a level via the KafkaSource, however if you have the appropriate configuration, you could use a KafkaClient and connect to your brokers to get that information prior to running your Flink Job and pass it to the appropriate location. Is there a specific need here? The related Kafka Sources/Sinks typically use partitioning/discovery as you’d expect to make sure it’s doing the right thing for reading and writing.
n
For the basic debugging, it should be exposed in my opinion.
r
If you have the job running, you should see in roughly in the logs for the source that’s reading from Kafka. Something to the affect of the following when your job starts up:
Copy code
your-topic-$partition1
your-topic-$partition2 
...
The reader should discover all of the partitions to ensure that it’s reading from all of them.
n
couldnt find in taskmanager and jobManager logs
It is available in metrics
committedOffset
👍 1
Thanks @Rion Williams