https://pulsar.apache.org/ logo
Join Slack
Powered by
# general
  • s

    Slackbot

    03/14/2023, 3:47 PM
    This message was deleted.
    b
    • 2
    • 5
  • u

    高晟京

    03/15/2023, 2:45 AM
    i want write any demo code about Message deduplication,but i not custom sequence id,how can look "Message deduplication" effect?
  • u

    高晟京

    03/15/2023, 2:57 AM
    I don't know now what kind of code should I write to achieve the effect I want
  • u

    高晟京

    03/15/2023, 3:01 AM
    I do not know how to write what kind of code to cause Message retransmission under the premise of custom sequence id, and finally achieve Message deduplication
  • s

    Slackbot

    03/15/2023, 6:04 AM
    This message was deleted.
    m
    a
    m
    • 4
    • 5
  • u

    高晟京

    03/15/2023, 6:21 AM
    same producer name?
  • s

    Slackbot

    03/15/2023, 6:21 AM
    This message was deleted.
    a
    • 2
    • 1
  • s

    Slackbot

    03/15/2023, 6:27 AM
    This message was deleted.
    a
    u
    +2
    • 5
    • 9
  • u

    高晟京

    03/15/2023, 11:33 AM
    Entry log rollover period: multiple ledgers in BookKeeper are interleaved into an entry log. how interleaved?? i don't know
  • s

    Slackbot

    03/15/2023, 11:35 AM
    This message was deleted.
    j
    d
    +3
    • 6
    • 11
  • s

    Slackbot

    03/16/2023, 1:30 AM
    This message was deleted.
    m
    d
    • 3
    • 2
  • s

    Slackbot

    03/16/2023, 12:43 PM
    This message was deleted.
    p
    m
    • 3
    • 2
  • s

    Slackbot

    03/16/2023, 1:54 PM
    This message was deleted.
    t
    a
    +2
    • 5
    • 14
  • u

    高晟京

    03/17/2023, 2:35 AM
    Please also note that a reader can have a "backlog", but the metric is only used for users to know how behind the reader is. The metric is not considered for any backlog quota calculations. what mean about "how behind the reader"???
  • s

    Slackbot

    03/17/2023, 2:38 AM
    This message was deleted.
    l
    • 2
    • 1
  • u

    高晟京

    03/17/2023, 2:50 AM
    @Enrico Olivelli
    👍 1
  • u

    高晟京

    03/17/2023, 3:12 AM
    https://pulsar.apache.org/docs/2.11.x/concepts-clients/
  • s

    Slackbot

    03/20/2023, 7:42 AM
    This message was deleted.
    p
    z
    • 3
    • 2
  • s

    Slackbot

    03/20/2023, 12:05 PM
    This message was deleted.
    p
    y
    • 3
    • 3
  • s

    Slackbot

    03/20/2023, 12:28 PM
    This message was deleted.
    a
    y
    • 3
    • 3
  • s

    Slackbot

    03/20/2023, 3:51 PM
    This message was deleted.
    n
    y
    b
    • 4
    • 7
  • j

    jihong

    03/21/2023, 2:00 AM
    Hello, the data reads id=‘(32064937,191,-1,-1)’ I don’t read down, but I see that there is a lot of data below. This can be obtained from the command line,:bin/pulsar-admin topics get-message-by-id
  • j

    jihong

    03/21/2023, 3:02 AM
    too many: java.util.concurrent.CompletionException: javax.ws.rs.WebApplicationException: HTTP 307 Temporary Redirect
  • j

    jihong

    03/21/2023, 3:02 AM
    broker log
  • j

    jihong

    03/21/2023, 3:08 AM
    Topic has an existing exclusive producer persistent://public/functions/assignments broker 2.10.3 , too many error
  • y

    Yang Ou

    03/21/2023, 4:52 AM
    Hi, when looking up a topic, we are seeing a lot of redirects, and a lot of times, these redirects form an infinity loop, and thus timeout.
  • y

    Yang Ou

    03/21/2023, 4:52 AM
    Is this a bug in pulsar broker? Reading the golang client code, we are seeing this handling
    Copy code
    const lookupResultMaxRedirect = 20
    
    func (ls *lookupService) Lookup(topic string) (*LookupResult, error) {
    	ls.metrics.LookupRequestsCount.Inc()
    	id := ls.rpcClient.NewRequestID()
    	res, err := ls.rpcClient.RequestToAnyBroker(id, pb.BaseCommand_LOOKUP, &pb.CommandLookupTopic{
    		RequestId:              &id,
    		Topic:                  &topic,
    		Authoritative:          proto.Bool(false),
    		AdvertisedListenerName: proto.String(ls.listenerName),
    	})
    	if err != nil {
    		return nil, err
    	}
    	ls.log.Debugf("Got topic{%s} lookup response: %+v", topic, res)
    
    	for i := 0; i < lookupResultMaxRedirect; i++ {
    		lr := res.Response.LookupTopicResponse
    		switch *lr.Response {
    
    		case pb.CommandLookupTopicResponse_Redirect:
    			logicalAddress, physicalAddr, err := ls.getBrokerAddress(lr)
    			if err != nil {
    				return nil, err
    			}
    
    			ls.log.Debugf("Follow topic{%s} redirect to broker. %v / %v - Use proxy: %v",
    				topic, lr.BrokerServiceUrl, lr.BrokerServiceUrlTls, lr.ProxyThroughServiceUrl)
    
    			id := ls.rpcClient.NewRequestID()
    			res, err = ls.rpcClient.Request(logicalAddress, physicalAddr, id, pb.BaseCommand_LOOKUP, &pb.CommandLookupTopic{
    				RequestId:              &id,
    				Topic:                  &topic,
    				Authoritative:          lr.Authoritative,
    				AdvertisedListenerName: proto.String(ls.listenerName),
    			})
    			if err != nil {
    				return nil, err
    			}
    
    			// Process the response at the top of the loop
    			continue
    
    		case pb.CommandLookupTopicResponse_Connect:
    			ls.log.Debugf("Successfully looked up topic{%s} on broker. %s / %s - Use proxy: %t",
    				topic, lr.GetBrokerServiceUrl(), lr.GetBrokerServiceUrlTls(), lr.GetProxyThroughServiceUrl())
    
    			logicalAddress, physicalAddress, err := ls.getBrokerAddress(lr)
    			if err != nil {
    				return nil, err
    			}
    
    			return &LookupResult{
    				LogicalAddr:  logicalAddress,
    				PhysicalAddr: physicalAddress,
    			}, nil
    
    		case pb.CommandLookupTopicResponse_Failed:
    			ls.log.WithFields(log.Fields{
    				"topic":   topic,
    				"error":   lr.GetError(),
    				"message": lr.GetMessage(),
    			}).Warn("Failed to lookup topic")
    			return nil, errors.New(lr.GetError().String())
    		}
    	}
    
    	return nil, errors.New("exceeded max number of redirection during topic lookup")
    }
    So it seems it’s a known issue
  • y

    Yang Ou

    03/21/2023, 4:53 AM
    I’m using the latest available pulsar version from docker hub
  • y

    Yang Ou

    03/21/2023, 4:53 AM
    Copy code
    apachepulsar/pulsar:latest
  • y

    Yang Ou

    03/21/2023, 5:10 AM
    What's the recommended handling of these infinity loops
1...678...155Latest