This message was deleted.
# generals
Slackbot
12/13/2023, 5:03 PMThis message was deleted.
r
Ryan Plessner
12/13/2023, 5:09 PMif you are okay with potentially re-processing some already committed offsets you should be able to issue a request to the supervisor to start at specific offsets. it looks kinda painful todo because each partition of each topic needs to be specified https://druid.apache.org/docs/latest/development/extensions-core/kafka-supervisor-operations#sample-request
Ryan Plessner
12/13/2023, 5:09 PMnote the partitionMap field of the request has the partition included in the key of each field:
Copy code
"partitionOffsetMap": {
"ads_media_foo:0": 3,
"ads_media_bar:1": 12
}j
JRob
12/13/2023, 5:10 PMBasically, a node went down and the offsets were reset to 0. So for specific partitions we want to reset offset to 0, but for other partitions we want to leave them where they are.
JRob
12/13/2023, 5:10 PMThis looks like what I was looking for. Thanks!
👍 1
r
Ryan Plessner
12/13/2023, 5:11 PMI would definitely test this on a dev cluster if possible, but if I understand the docs correctly this should just effect topics you explicitly want to change
j
John Kowtko
12/14/2023, 8:37 PMThere is also a "Set Offsets" panel accessible from the Supervisor Actions menu. I have not used it so I do not know if you have to specify offsets for all partitions, or just the ones you want to change.