https://pinot.apache.org/ logo
Join Slack
Powered by
# troubleshooting
  • p

    Pradeep

    10/01/2020, 5:47 PM
    ah it’s very big table, it killed our servers last time 🙂
  • p

    Pradeep

    10/01/2020, 5:47 PM
    yeah I thought that could be the reason too, so i included a minutes as one of the dimension yesterday evening
  • p

    Pradeep

    10/01/2020, 5:48 PM
    let me print the stats for that
  • p

    Pradeep

    10/01/2020, 5:50 PM
    this is for a much shorter time period 4hours
    Copy code
    timeMs=1802,docs=62235061/16481320579,entries=98184718/124470122,segments(queried/processed/matched/consuming/unavailable):5230/57/57/8/0,consumingFreshnessTimeMs=1601574542463,servers=4/4,groupLimitReached=false,exceptions=0,serverStats=(Server=SubmitDelayMs,ResponseDelayMs,ResponseSize,DeserializationTimeMs);172.31.17.90_R=1,1797,68551,0;172.31.30.139_O=0,4,372,0;172.31.34.149_O=0,4,372,0;172.31.24.127_R=1,1563,69169,0,
  • p

    Pradeep

    10/01/2020, 5:54 PM
    is there a way to verify that star-tree is being used?
  • p

    Pradeep

    10/01/2020, 5:55 PM
    I think baseed on the results it’s not, but not sure why
  • j

    Jackie

    10/01/2020, 5:55 PM
    You included
    minutes
    in the star-tree config?
  • j

    Jackie

    10/01/2020, 5:55 PM
    What is the query?
  • p

    Pradeep

    10/01/2020, 5:56 PM
    Copy code
    select colA, distinctCountHll(colb)
    from table
    where epochMinutes > X
    group by colA
  • p

    Pradeep

    10/01/2020, 5:56 PM
    epochMinutes is our minutes column
  • j

    Jackie

    10/01/2020, 5:57 PM
    dimensionsSplitOrder: ["colA", "epochMinutes"]
    ?
  • p

    Pradeep

    10/01/2020, 5:57 PM
    yup
  • j

    Jackie

    10/01/2020, 5:59 PM
    Then it should be solved by star-tree. Did this table have star-tree before you making this change?
  • p

    Pradeep

    10/01/2020, 6:00 PM
    yes there was one already present
  • p

    Pradeep

    10/01/2020, 6:00 PM
    it contains dimensionsSplitOrder: [“colA”, “epochMinutes”] + some more columns but aggregate function is just a count
  • j

    Jackie

    10/01/2020, 6:00 PM
    Then reloading won't help in that case..
  • p

    Pradeep

    10/01/2020, 6:01 PM
    yeah that’s why I am just looking at the newer data
  • j

    Jackie

    10/01/2020, 6:02 PM
    Can you please check the metadata for the queried segments and see if the new star-tree is generated?
  • p

    Pradeep

    10/01/2020, 6:02 PM
    yup, I pinged you in personal message the metadata
  • p

    Pradeep

    10/01/2020, 6:03 PM
    could it be because colA and colB are present in both the star-tree indicies?
  • e

    Elon

    10/02/2020, 7:38 PM
    We have an issue where there are non-existent server instances in our pinot cluster. Could have been due to a bad deployment from another cluster. I see that tables are consuming from the non-existent instances. Is it safe to just delete the instances or does more have to be done?
  • k

    Kishore G

    10/02/2020, 7:39 PM
    disable the node first
  • k

    Kishore G

    10/02/2020, 7:39 PM
    and then delete
  • e

    Elon

    10/02/2020, 7:40 PM
    Thanks, how do you disable the node?
  • e

    Elon

    10/02/2020, 7:40 PM
    It doesn't exist
  • e

    Elon

    10/02/2020, 7:42 PM
    Getting an error when deleting:
    Copy code
    "error": "Failed to drop instance Server_pinot-server-5.pinot-server-headless.pinot.svc.cluster.local_8098 - Instance Server_pinot-server-5.pinot-server-headless.pinot.svc.cluster.local_8098 exists in ideal state for XXXXX_OFFLINE"
  • k

    Kishore G

    10/02/2020, 7:42 PM
    ok, thats a safety check.
  • n

    Neha Pawar

    10/02/2020, 7:42 PM
    untag + rebalance will be needed rt
    👍 1
  • k

    Kishore G

    10/02/2020, 7:42 PM
    that means it has some segments
  • k

    Kishore G

    10/02/2020, 7:42 PM
    yes
    👍 1
1...134135136...166Latest