This message was deleted.

Hello Lalit, when do you get this error. Can you attach some more logs around it please..

@bala rao I get this error when I am consuming data through consumer. I am consuming 20k msg/s using consumer listener with consumer configuration as

m_Config.setReceiverQueueSize(10000);
    m_Config.setConsumerType(pulsar::ConsumerType::ConsumerExclusive);
    m_Config.setMessageListener(m_Listner);
    m_Config.setAckGroupingTimeMs(500);
    m_Config.setAckGroupingMaxSize(6000);

consumer log is:

2023-02-08 02:52:47.589 INFO  [140589809350400] ClientConnection:189 | [<none> -> <pulsar://192.168.29.78:6650>] Create ClientConnection, timeout=10000
2023-02-08 02:52:47.589 INFO  [140589809350400] ConnectionPool:97 | Created connection for <pulsar://192.168.29.78:6650>
2023-02-08 02:52:47.594 INFO  [140589706241792] ClientConnection:386 | [172.17.0.2:53268 -> 192.168.29.78:6650] Connected to broker
2023-02-08 02:52:47.632 INFO  [140589706241792] HandlerBase:72 | [<non-persistent://public/default/mytopic1>, d66b4928-9d5a-4f89-b8af-ef3aaa5ba5fb, 0] Getting connection from pool
2023-02-08 02:52:47.634 INFO  [140589706241792] ConsumerImpl:170 | [<non-persistent://public/default/mytopic1>, d66b4928-9d5a-4f89-b8af-ef3aaa5ba5fb, 0] ACK will NOT be sent to broker for this non-persistent topic.
2023-02-08 02:52:47.634 INFO  [140589706241792] HandlerBase:72 | [<non-persistent://public/default/mytopic2>, d66b4928-9d5a-4f89-b8af-ef3aaa5ba5fb, 1] Getting connection from pool
2023-02-08 02:52:47.635 INFO  [140589706241792] ConsumerImpl:170 | [<non-persistent://public/default/mytopic2>, d66b4928-9d5a-4f89-b8af-ef3aaa5ba5fb, 1] ACK will NOT be sent to broker for this non-persistent topic.
2023-02-08 02:52:47.640 INFO  [140589706241792] ClientConnection:189 | [<none> -> <pulsar://192.168.29.78:6650>] Create ClientConnection, timeout=10000
2023-02-08 02:52:47.640 INFO  [140589706241792] ConnectionPool:97 | Created connection for <pulsar://localhost:6650>
2023-02-08 02:52:47.644 INFO  [140589681063680] ClientConnection:388 | [172.17.0.2:53272 -> 192.168.29.78:6650] Connected to broker through proxy. Logical broker: <pulsar://localhost:6650>
2023-02-08 02:52:47.660 INFO  [140589681063680] ConsumerImpl:238 | [<non-persistent://public/default/mytopic1>, d66b4928-9d5a-4f89-b8af-ef3aaa5ba5fb, 0] Created consumer on broker [172.17.0.2:53272 -> 192.168.29.78:6650] 
2023-02-08 02:52:47.661 INFO  [140589681063680] MultiTopicsConsumerImpl:275 | Successfully Subscribed to a single partition of topic in TopicsConsumer. Partitions need to create : 0
2023-02-08 02:52:47.662 INFO  [140589681063680] ConsumerImpl:238 | [<non-persistent://public/default/mytopic2>, d66b4928-9d5a-4f89-b8af-ef3aaa5ba5fb, 1] Created consumer on broker [172.17.0.2:53272 -> 192.168.29.78:6650] 
2023-02-08 02:52:47.663 INFO  [140589681063680] MultiTopicsConsumerImpl:275 | Successfully Subscribed to a single partition of topic in TopicsConsumer. Partitions need to create : 0
2023-02-08 02:52:47.663 INFO  [140589681063680] MultiTopicsConsumerImpl:137 | Successfully Subscribed to Topics
2023-02-08 02:52:52.704 INFO  [140589706241792] HandlerBase:72 | [<non-persistent://public/default/mytopic1>, 29652a80-d903-4d5b-9949-2a28e818b28f, 2] Getting connection from pool
2023-02-08 02:52:52.704 INFO  [140589706241792] ConsumerImpl:170 | [<non-persistent://public/default/mytopic1>, 29652a80-d903-4d5b-9949-2a28e818b28f, 2] ACK will NOT be sent to broker for this non-persistent topic.
2023-02-08 02:52:52.705 INFO  [140589706241792] HandlerBase:72 | [<non-persistent://public/default/mytopic2>, 29652a80-d903-4d5b-9949-2a28e818b28f, 3] Getting connection from pool
2023-02-08 02:52:52.706 INFO  [140589706241792] ConsumerImpl:170 | [<non-persistent://public/default/mytopic2>, 29652a80-d903-4d5b-9949-2a28e818b28f, 3] ACK will NOT be sent to broker for this non-persistent topic.
2023-02-08 02:52:52.712 INFO  [140589681063680] ConsumerImpl:238 | [<non-persistent://public/default/mytopic1>, 29652a80-d903-4d5b-9949-2a28e818b28f, 2] Created consumer on broker [172.17.0.2:53272 -> 192.168.29.78:6650] 
2023-02-08 02:52:52.713 INFO  [140589681063680] MultiTopicsConsumerImpl:275 | Successfully Subscribed to a single partition of topic in TopicsConsumer. Partitions need to create : 0
2023-02-08 02:52:52.716 INFO  [140589681063680] ConsumerImpl:238 | [<non-persistent://public/default/mytopic2>, 29652a80-d903-4d5b-9949-2a28e818b28f, 3] Created consumer on broker [172.17.0.2:53272 -> 192.168.29.78:6650] 
2023-02-08 02:52:52.717 INFO  [140589681063680] MultiTopicsConsumerImpl:275 | Successfully Subscribed to a single partition of topic in TopicsConsumer. Partitions need to create : 0
2023-02-08 02:52:52.718 INFO  [140589681063680] MultiTopicsConsumerImpl:137 | Successfully Subscribed to Topics
2023-02-08 02:52:54.011 INFO  [140589706241792] HandlerBase:72 | [<non-persistent://public/default/mytopic2>, 87cdecf2-3999-4c19-a9ae-4ead293e8bee, 4] Getting connection from pool
2023-02-08 02:52:54.012 INFO  [140589706241792] ConsumerImpl:170 | [<non-persistent://public/default/mytopic2>, 87cdecf2-3999-4c19-a9ae-4ead293e8bee, 4] ACK will NOT be sent to broker for this non-persistent topic.
2023-02-08 02:52:54.013 INFO  [140589706241792] HandlerBase:72 | [<non-persistent://public/default/mytopic1>, 87cdecf2-3999-4c19-a9ae-4ead293e8bee, 5] Getting connection from pool
2023-02-08 02:52:54.013 INFO  [140589706241792] ConsumerImpl:170 | [<non-persistent://public/default/mytopic1>, 87cdecf2-3999-4c19-a9ae-4ead293e8bee, 5] ACK will NOT be sent to broker for this non-persistent topic.
2023-02-08 02:52:54.023 INFO  [140589681063680] ConsumerImpl:238 | [<non-persistent://public/default/mytopic2>, 87cdecf2-3999-4c19-a9ae-4ead293e8bee, 4] Created consumer on broker [172.17.0.2:53272 -> 192.168.29.78:6650] 
2023-02-08 02:52:54.024 INFO  [140589681063680] MultiTopicsConsumerImpl:275 | Successfully Subscribed to a single partition of topic in TopicsConsumer. Partitions need to create : 0
2023-02-08 02:52:54.024 INFO  [140589681063680] ConsumerImpl:238 | [<non-persistent://public/default/mytopic1>, 87cdecf2-3999-4c19-a9ae-4ead293e8bee, 5] Created consumer on broker [172.17.0.2:53272 -> 192.168.29.78:6650] 
2023-02-08 02:52:54.025 INFO  [140589681063680] MultiTopicsConsumerImpl:275 | Successfully Subscribed to a single partition of topic in TopicsConsumer. Partitions need to create : 0
2023-02-08 02:52:54.025 INFO  [140589681063680] MultiTopicsConsumerImpl:137 | Successfully Subscribed to Topics
2023-02-08 02:52:55.252 INFO  [140589706241792] HandlerBase:72 | [<non-persistent://public/default/mytopic2>, 108e44a0-5603-40de-bd29-47a9a1ef797e, 6] Getting connection from pool
2023-02-08 02:52:55.252 INFO  [140589706241792] ConsumerImpl:170 | [<non-persistent://public/default/mytopic2>, 108e44a0-5603-40de-bd29-47a9a1ef797e, 6] ACK will NOT be sent to broker for this non-persistent topic.
2023-02-08 02:52:55.253 INFO  [140589706241792] HandlerBase:72 | [<non-persistent://public/default/mytopic1>, 108e44a0-5603-40de-bd29-47a9a1ef797e, 7] Getting connection from pool
2023-02-08 02:52:55.253 INFO  [140589706241792] ConsumerImpl:170 | [<non-persistent://public/default/mytopic1>, 108e44a0-5603-40de-bd29-47a9a1ef797e, 7] ACK will NOT be sent to broker for this non-persistent topic.
2023-02-08 02:52:55.263 INFO  [140589681063680] ConsumerImpl:238 | [<non-persistent://public/default/mytopic2>, 108e44a0-5603-40de-bd29-47a9a1ef797e, 6] Created consumer on broker [172.17.0.2:53272 -> 192.168.29.78:6650] 
2023-02-08 02:52:55.264 INFO  [140589681063680] MultiTopicsConsumerImpl:275 | Successfully Subscribed to a single partition of topic in TopicsConsumer. Partitions need to create : 0
2023-02-08 02:52:55.265 INFO  [140589681063680] ConsumerImpl:238 | [<non-persistent://public/default/mytopic1>, 108e44a0-5603-40de-bd29-47a9a1ef797e, 7] Created consumer on broker [172.17.0.2:53272 -> 192.168.29.78:6650] 
2023-02-08 02:52:55.266 INFO  [140589681063680] MultiTopicsConsumerImpl:275 | Successfully Subscribed to a single partition of topic in TopicsConsumer. Partitions need to create : 0
2023-02-08 02:52:55.266 INFO  [140589681063680] MultiTopicsConsumerImpl:137 | Successfully Subscribed to Topics
2023-02-08 02:52:56.811 INFO  [140589706241792] HandlerBase:72 | [<non-persistent://public/default/mytopic1>, 7667514e-ff47-4743-8252-88562632d81f, 8] Getting connection from pool
2023-02-08 02:52:56.812 INFO  [140589706241792] ConsumerImpl:170 | [<non-persistent://public/default/mytopic1>, 7667514e-ff47-4743-8252-88562632d81f, 8] ACK will NOT be sent to broker for this non-persistent topic.
2023-02-08 02:52:56.812 INFO  [140589706241792] HandlerBase:72 | [<non-persistent://public/default/mytopic2>, 7667514e-ff47-4743-8252-88562632d81f, 9] Getting connection from pool
2023-02-08 02:52:56.813 INFO  [140589706241792] ConsumerImpl:170 | [<non-persistent://public/default/mytopic2>, 7667514e-ff47-4743-8252-88562632d81f, 9] ACK will NOT be sent to broker for this non-persistent topic.
2023-02-08 02:52:56.821 INFO  [140589681063680] ConsumerImpl:238 | [<non-persistent://public/default/mytopic1>, 7667514e-ff47-4743-8252-88562632d81f, 8] Created consumer on broker [172.17.0.2:53272 -> 192.168.29.78:6650] 
2023-02-08 02:52:56.822 INFO  [140589681063680] MultiTopicsConsumerImpl:275 | Successfully Subscribed to a single partition of topic in TopicsConsumer. Partitions need to create : 0
2023-02-08 02:52:56.823 INFO  [140589681063680] ConsumerImpl:238 | [<non-persistent://public/default/mytopic2>, 7667514e-ff47-4743-8252-88562632d81f, 9] Created consumer on broker [172.17.0.2:53272 -> 192.168.29.78:6650] 
2023-02-08 02:52:56.823 INFO  [140589681063680] MultiTopicsConsumerImpl:275 | Successfully Subscribed to a single partition of topic in TopicsConsumer. Partitions need to create : 0
2023-02-08 02:52:56.824 INFO  [140589681063680] MultiTopicsConsumerImpl:137 | Successfully Subscribed to Topics
2023-02-08 03:02:47.632 INFO  [140589706241792] ConsumerStatsImpl:68 | Consumer [<non-persistent://public/default/mytopic1>, d66b4928-9d5a-4f89-b8af-ef3aaa5ba5fb, 0] , ConsumerStatsImpl (numBytesRecieved_ = 248522520, totalNumBytesRecieved_ = 248522520, receivedMsgMap_ = {[Key: Ok, Value: 4142042], }, ackedMsgMap_ = {[Key: {Result: Ok, ackType: 0}, Value: 4142042], }, totalReceivedMsgMap_ = {[Key: Ok, Value: 4142042], }, totalAckedMsgMap_ = {[Key: {Result: Ok, ackType: 0}, Value: 4142042], })
2023-02-08 03:02:47.634 INFO  [140589706241792] ConsumerStatsImpl:68 | Consumer [<non-persistent://public/default/mytopic2>, d66b4928-9d5a-4f89-b8af-ef3aaa5ba5fb, 1] , ConsumerStatsImpl (numBytesRecieved_ = 248871480, totalNumBytesRecieved_ = 248871480, receivedMsgMap_ = {[Key: Ok, Value: 4147858], }, ackedMsgMap_ = {[Key: {Result: Ok, ackType: 0}, Value: 4147858], }, totalReceivedMsgMap_ = {[Key: Ok, Value: 4147858], }, totalAckedMsgMap_ = {[Key: {Result: Ok, ackType: 0}, Value: 4147858], })