https://pinot.apache.org/ logo
Join Slack
Powered by
# general
  • m
    The question is, when is this behavior not desirable?
  • k
    +1 on enabling it by default
  • m
    +1 as well
  • s
  • s
    In Broker Response, There is a field : ** * Set the total time used in request handling, into the broker response. */ void setTimeUsedMs(long timeUsedMs); This is the latency of a query right?
  • s
    // Set total query processing time. long totalTimeMs = TimeUnit.MILLISECONDS.convert(System.nanoTime() - compilationStartTime, TimeUnit.NANOSECONDS); brokerResponse.setTimeUsedMs(totalTimeMs); This is how it is set in the code
  • m
    Yes, that's the latency on Pinot side. Client side latency would be slightly larger (ie including network delay).
  • c
    Quick question, is there a way to add a specific server / broker instance to a given tenant ? We tried to look at Controller API but didn't really see anything - but maybe we missed it ?
  • k
    use tagging
  • c
    Interesting. Is there any documentation on this ?
  • k
  • c
    ok thanks will go through that
  • k
    this is written in 2015. you can get the idea from that wiki. Not sure if we have documentation on exact commands
  • c
    no worries , I can help update the wiki if needed
  • c
    I was able to tag a server/broker directly in Zookeeper and that worked. Haven't found the exact command to do that yet but for now we're unblocked
  • c
    thanks Kishore !
  • c
    might be useful to add this as an explicit API if it doesn't exist already
  • c
    lemme know and I can open an issue as required
  • k
    i am sure there is some rest api
  • s
    I recently realized that we don’t have pinot api to update tag directly. We only expose 
    POST /tenants
    that picks untagged servers and add tags based on the tenant config.
  • s
    We need to add the api to associate an instance to a specific tenant.
  • s
    we have used helix api or a python script to modify tags
  • c
    We also find out that manually tagging an instance with a tenant that doesn't exist also creates that particular tenant. Epic !
  • c
    that totally solved our problem
  • s
    🙂
  • s
    i will add the item to github issue
  • c
    🙂
  • s
    Hi Team, A quick question - Will more of vCPU’s cause the latency to not decrease on increased QPS?
  • s
    Hi team, This image is from one of the pinot presentations. Here, the latency almost remains some and increases when QPS > 1000. I am getting similar result where latency decreases a bit/almost remains same. The result is correct then right? Or should I still expect an increase in latency due to increased load?
  • m
    You should keep on increasing the QPS until you start seeing the latency degrade. If you are not seeing latency degrade, then increase QPS further. Assuming your test setup is correct, at some point the latency is bound to increase.
1...757677...160Latest