This message was deleted.
# generals
Slackbot
06/01/2023, 11:17 PMThis message was deleted.
g
Gaurav Ashok
06/02/2023, 8:29 AMCan you give an example?
I was expecting the "sequence ID" order to be the same as publish order only. Except that for the key-shared sub, a consumer will get a subset of messages based on the assigned keys. whereas reader most likely will read all messages (for all keys). But the order of the messages for a particular key should be same. right?
z
Zach Blocker
06/02/2023, 2:48 PMI did try to give the reader key hash ranges matching a certain set of message keys, to filter the messages I was getting.
But here is a sample readout from my log statements (edited for brevity)
The format used is
[log time] Reader: [message key]: [sequence ID],[publish timestamp] Copy code
[08:58:35 INF] Reader: 470c97f2-55ca-be89-db44-2fb63530152e: 5,1685710714454
[08:58:35 INF] Reader: 470c97f2-55ca-be89-db44-2fb63530152e: 36,1685710714454
...
...
[08:58:35 INF] Reader: 470c97f2-55ca-be89-db44-2fb63530152e: 354,1685710714473
...
...
[08:58:36 INF] Reader: 470c97f2-55ca-be89-db44-2fb63530152e: 0,1685710714546
[08:58:36 INF] Reader: 470c97f2-55ca-be89-db44-2fb63530152e: 5,1685710714546Zach Blocker
06/02/2023, 3:21 PMI added the full message ID to the output and now it seems like what I really have here is duplicated messages...maybe? Because what I seem to see is messages that have the same key and the same sequence ID but different message IDs and timestamps.
Copy code
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 84, ORD: - ID: 1056:67:-1:0 - @ 1685718549330 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 177, ORD: - ID: 1056:67:-1:1 - @ 1685718549330 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 213, ORD: - ID: 1056:67:-1:2 - @ 1685718549330 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 389, ORD: - ID: 1056:181:-1:0 - @ 1685718549347 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 430, ORD: - ID: 1056:181:-1:1 - @ 1685718549347 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 514, ORD: - ID: 1056:181:-1:2 - @ 1685718549347 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 541, ORD: - ID: 1056:181:-1:3 - @ 1685718549347 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 840, ORD: - ID: 1056:305:-1:0 - @ 1685718549374 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 870, ORD: - ID: 1056:305:-1:1 - @ 1685718549374 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 897, ORD: - ID: 1056:305:-1:2 - @ 1685718549374 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 950, ORD: - ID: 1056:305:-1:3 - @ 1685718549374 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 0, ORD: - ID: 1056:379:-1:0 - @ 1685718549420 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 84, ORD: - ID: 1056:379:-1:1 - @ 1685718549420 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 177, ORD: - ID: 1056:471:-1:0 - @ 1685718549436 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 213, ORD: - ID: 1056:471:-1:1 - @ 1685718549436 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 389, ORD: - ID: 1056:471:-1:2 - @ 1685718549436 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 430, ORD: - ID: 1056:566:-1:0 - @ 1685718549451 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 514, ORD: - ID: 1056:566:-1:1 - @ 1685718549451 - eligible (retry mode)
[11:09:10 INF] Reader: STRM: d9366fda-1a63-3116-07b0-7d543e8a6da6: SEQ: 541, ORD: - ID: 1056:566:-1:2 - @ 1685718549451 - eligible (retry mode)Zach Blocker
06/02/2023, 5:51 PMReporting back - my mistake (which I was hoping it was!) I double-published by mistake.
👍 2