This message was deleted.
# generals
Slackbot
11/15/2023, 9:31 AMThis message was deleted.
d
David K
11/15/2023, 4:50 PMBased on the following two metrics, all the messages on that partition appeared to have been consumed.
David K
11/15/2023, 4:50 PM Copy code
"markDeletePosition" : "13835443:0",
"readPosition" : "13835443:1",David K
11/15/2023, 4:52 PMIt is unclear to me how/why this event occurred, “received reset cursor on subscription….to position 13833005750”
s
sindhushree
11/16/2023, 8:34 AM@David K Topics stats shows message backlog for that subscriptions.
"subscriptions" : {
"0_itom_di_scheduler_provider_default_profile2_90" : {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"bytesOutCounter" : 0,
"msgOutCounter" : 0,
"msgRateRedeliver" : 0.0,
"messageAckRate" : 0.0,
"chunkedMessageRate" : 0,
"msgBacklog" : 1299,
"backlogSize" : 0,
"earliestMsgPublishTimeInBacklog" : 0,
"msgBacklogNoDelayed" : 1299,
"blockedSubscriptionOnUnackedMsgs" : false,
"msgDelayed" : 0,
"unackedMessages" : 0,
"type" : "None",
"msgRateExpired" : 0.0,
"totalMsgExpired" : 0,
"lastExpireTimestamp" : 0,
"lastConsumedFlowTimestamp" : 0,
"lastConsumedTimestamp" : 0,
"lastAckedTimestamp" : 0,
"lastMarkDeleteAdvancedTimestamp" : 0,
"consumers" : [ ],
"isDurable" : true,
"isReplicated" : false,
"allowOutOfOrderDelivery" : false,
"consumersAfterMarkDeletePosition" : { },
"nonContiguousDeletedMessagesRanges" : 0,
"nonContiguousDeletedMessagesRangesSerializedSize" : 0,
"subscriptionProperties" : {
"owner" : "itom_di_scheduler_udx"
},
"durable" : true,
sindhushree
11/16/2023, 8:34 AMand internal stats their are ledgers in open state
sindhushree
11/20/2023, 7:45 AM@David K @Penghui
On further debugging i have found the below error in bookie.
Read ledger metadata is giving below output
2023-11-17T082645,365
[main] INFO
org.apache.bookkeeper.tools.cli.commands.client.LedgerMetaDataCommand -
LedgerMetadata{formatVersion=3, ensembleSize=2, writeQuorumSize=2,
ackQuorumSize=2, state=CLOSED, length=845300, lastEntryId=52,
digestType=CRC32C, password=base64:,
ensembles={0=[itomdipulsar-bookkeeper-2.itomdipulsar-bookkeeper.chotest:3181,
itomdipulsar-bookkeeper-0.itomdipulsar-bookkeeper.chotest:3181],
53=[itomdipulsar-bookkeeper-2.itomdipulsar-bookkeeper.chotest:3181,
itomdipulsar-bookkeeper-1.itomdipulsar-bookkeeper.chotest:3181]},
customMetadata={component=base64:bWFuYWdlZC1sZWRnZXI=,
pulsar/managed-ledger=base64:cHVibGljL2RlZmF1bHQvcGVyc2lzdGVudC9wcm9maWxlMl85MC1wYXJ0aXRpb24tMA==,
application=base64:cHVsc2Fy}}
Read ledger data is giving the below error for the 52nd entry
2023-11-17T082724,885
[BookKeeperClientWorker-OrderedExecutor-3-0] ERROR
org.apache.bookkeeper.client.PendingReadOp - Read of ledger entry
failed: L13835443 E52-E52, Sent to
[itomdipulsar-bookkeeper-0.itomdipulsar-bookkeeper.chotest:3181,
itomdipulsar-bookkeeper-2.itomdipulsar-bookkeeper.chotest:3181], Heard
from [] : bitset = {}, Error = 'No such entry'. First unread entry is
(-1, rc = null)