So we found ourselves in a position where we had t...
# troubleshootings
Stuart Millholland
08/22/2022, 4:52 PMSo we found ourselves in a position where we had to decrease kafka partitions for realtime and ended up deleting our consuming segments. We are looking for how we tell Pinot to start creating consuming segments again.
m
Mayank
08/22/2022, 4:53 PM
@saurabh dubey @Neha Pawar ^^
Mayank
08/22/2022, 4:53 PM
Could you try the reset api @Stuart Millholland
s
Stuart Millholland
08/22/2022, 4:54 PMok trying that
Stuart Millholland
08/22/2022, 4:56 PMWe run this
Stuart Millholland
08/22/2022, 4:56 PMcurl -X GET "http://localhost:9000/tables/immutable_events_REALTIME/consumingSegmentsInfo" -H "accept: application/json"
Stuart Millholland
08/22/2022, 4:56 PMAnd still get this
Stuart Millholland
08/22/2022, 4:56 PM Copy code
{
"_segmentToConsumingInfoMap": {}
}m
Mayank
08/22/2022, 5:00 PM
What command did you run to reset?
s
Stuart Millholland
08/22/2022, 5:00 PMcurl -X POST "http://localhost:9000/segments/immutable_events_REALTIME/reset" -H "accept: application/json"
Stuart Millholland
08/22/2022, 5:21 PMWe've tried to change things in the table config like replication, name of kafka topic. We tried to increase the number of kafka partitions. We can't seem to get the table to create consuming segments again after we manually nuked them all.
n
Neha Pawar
08/22/2022, 5:38 PM
reset won’t help if you’ve deleted the CONSUMING segments. try this one https://github.com/apache/pinot/pull/8663
s
Stuart Millholland
08/22/2022, 5:39 PMWe will try
n
Neha Pawar
08/22/2022, 5:40 PM
though i think this is not part of 0.10.0. are you using latest docker image or 0.10.0?
s
Stuart Millholland
08/22/2022, 5:41 PMoh yikes yeah we are 0.10
Stuart Millholland
08/22/2022, 5:41 PMso we are still in development and can just nuke the realtime table and restart, we are trying to pretend this is prod though so seeing if we can get out of this situation
n
Neha Pawar
08/22/2022, 5:42 PM
resumeConsumption would’ve worked, from future releases. it was designed for exactly such situations
s
Stuart Millholland
08/22/2022, 5:42 PMok, good to know that's coming!