This message was deleted.

hello @David K thanks for all your help, I do really appreciate. please what could be the possible check and solution if this is the issue . I have literally restarted the pulsar instance, delete and reconfigured then restart from scratch, also have downloaded new pulsar binary severally but the issue still persist

What about the client side of the TCP connection, or are you running both inside the same infrastructure.

I am running the both in the same infrastructure I am literally still developing and performing everything on my pc at the moment

Just to rule it out, I would gather some data on the number of open TCP connections while running these tests. e.g.

while (true); do netstat -p TCP | wc -l; sleep 15; done

run that in the background and gather some connection counts.

ok I got this values before I terminated it

those are all small numbers, so it isn’t TCP connection exhaustion

oh wow, this means I am stuck

It means you have to gather some more data to identify the bottleneck

Hello @David K below is my sink output, can you deduct anything from here which could be causing the delay in message delivery to the configured url

{
  "tenant": "public",
  "namespace": "default",
  "name": "customer-test",
  "className": "org.apache.pulsar.io.http.HttpSink",
  "sourceSubscriptionPosition": "Latest",
  "inputs": [
    "<persistent://public/default/test>"
  ],
  "inputSpecs": {
    "<persistent://public/default/test>": {
      "schemaProperties": {},
      "consumerProperties": {},
      "poolMessages": false,
      "regexPattern": false
    }
  },
  "configs": {
    "headers": {
      "Content-Type": "application/json"
    },
    "url": "<http://localhost:9000/consume/sms/smsenvio>"
  },
  "parallelism": 1,
  "processingGuarantees": "ATLEAST_ONCE",
  "retainOrdering": false,
  "retainKeyOrdering": false,
  "resources": {
    "cpu": 1,
    "ram": 1073741824,
    "disk": 10737418240
  },
  "autoAck": true,
  "archive": "<builtin://http>",
  "cleanupSubscription": true
}

Can you share the topic stats for the topic you are publishing to ?