https://pinot.apache.org/ logo
Join Slack
Powered by
# troubleshooting
  • k
    Sure.
  • j
    @srisudha If possible, can you share the table config for your table?
  • s
    Sure just a moment
  • j
    Actually I think I know the problem
  • k
  • j
    You have 20 partitions and 2 replicas, so there is no way to evenly spread the partitions
  • s
    2020-05-19
  • k
    (Neha has answered the sole question on the frequent questions page, WRT replica groups)
  • s
    @Jackie so we tried with same test with 5 servers, 6 cores each, and also parallel ingestion .. The servers query time went upto 40 ms.. Querying at 10 k rps and ingestion at 5k rps
  • s
    So this time each server got about 8 consuming threads
  • s
    And only querying at 10k rps all three servers responded in less than 3 ms
  • j
    @srisudha Did you enable the replica group routing?
  • j
    I don't think with either 3 or 5 servers you will have segments correctly aligned because you have 2 replicas
  • s
    Thanks @Kenny Bastani
    🙂 1
  • s
    No, we just added that code yes to test it out.
  • j
    I would recommend testing with even number of servers
  • s
    So are u saying the servers to be a multiple of replicas
  • s
    Okay will give it a try
  • s
    And is there any correlation on number of brokers and servers?
  • j
    Yes, and that will give you correct replica-groups
  • j
    They are independent
  • s
    I was thinking 40 consuming threads evenly spread across servers would do
  • j
    In order to use replica-group, you should put servers as multiple of replicas
  • s
    Sorry replica group routing we did not add. What we added was partition aware routing from kafkaa producer
  • s
    Got that..
  • j
    Are you using the latest Pinot version?
  • j
    From the log you should be able to find how many segments queried
  • s
    V created an image from master git and using it because v wanted a recent fix that you made
  • j
    Cool, that should be the latest
  • j
    If you configured the partition correctly, you should see only a subset of segments getting queried
1...103104105...166Latest