https://pinot.apache.org/ logo
Join Slack
Powered by
# troubleshooting
  • e

    Elon

    06/23/2020, 5:49 PM
    i.e. curl from
    kubectl exec -it pinot-server bash
    works without readiness probe only
  • x

    Xiang Fu

    06/23/2020, 5:57 PM
    hmmm
  • x

    Xiang Fu

    06/23/2020, 5:57 PM
    let me also check
  • k

    Kishore G

    06/24/2020, 9:46 PM
    @Neha Pawar ^^ any docs on this?
  • k

    Kishore G

    06/24/2020, 9:47 PM
    https://docs.pinot.apache.org/developers/design-documents we should add the real-time segment relocator here
  • p

    Pradeep

    06/24/2020, 9:48 PM
    There’s some info here: https://docs.pinot.apache.org/basics/components/table#tenants
  • n

    Neha Pawar

    06/24/2020, 9:49 PM
    looking
  • k

    Kishore G

    06/24/2020, 9:49 PM
    cool, https://docs.pinot.apache.org/operators/operating-pinot/tuning/realtime#moving-completed-segments-to-different-hosts
  • p

    Pradeep

    06/24/2020, 9:50 PM
    I am using “LowLevel” consumer
  • n

    Neha Pawar

    06/24/2020, 9:50 PM
    can you share the whole table config?
  • p

    Pradeep

    06/24/2020, 9:51 PM
    Copy code
    {
      "REALTIME": {
        "tableName": "<REMOVED>",
        "tableType": "REALTIME",
        "segmentsConfig": {
          "schemaName": "search",
          "timeType": "MILLISECONDS",
          "timeColumnName": "timestampMillis",
          "replicasPerPartition": "1"
        },
        "tenants": {
          "broker": "DefaultTenant",
          "server": "DefaultTenant"
        },
        "tableIndexConfig": {
          "streamConfigs": {
            "streamType": "kafka",
            "stream.kafka.consumer.type": "LowLevel",
            "stream.kafka.topic.name": "<REMOVED>",
            "stream.kafka.decoder.class.name": "org.apache.pinot.plugin.stream.kafka.KafkaJSONMessageDecoder",
            "stream.kafka.consumer.factory.class.name": "org.apache.pinot.plugin.stream.kafka20.KafkaConsumerFactory",
            "stream.kafka.broker.list": "<REMOVED>",
            "realtime.segment.flush.threshold.time": "1h",
            "realtime.segment.flush.threshold.size": "100M",
            "stream.kafka.consumer.prop.auto.offset.reset": "smallest"
          },
          "createInvertedIndexDuringSegmentGeneration": false,
          "enableDefaultStarTree": false,
          "aggregateMetrics": false,
          "nullHandlingEnabled": false,
          "loadMode": "MMAP",
          "autoGeneratedInvertedIndex": false
        },
        "metadata": {
          "customConfigs": {}
        }
      }
    }
  • n

    Neha Pawar

    06/24/2020, 9:51 PM
    also check if there’s anything in the logs when you did a POST for the table config
  • p

    Pradeep

    06/24/2020, 9:51 PM
    let me check that
  • n

    Neha Pawar

    06/24/2020, 9:52 PM
    also, was this during 1st time creation, or update?
  • p

    Pradeep

    06/24/2020, 9:56 PM
    @Neha Pawar First time I had tagsOverrideConfig but consumer type was “lowlevel”, so I did AddTable again where I changed consumer type from lowlevel to LowLevel Not sure if that would effect?
  • n

    Neha Pawar

    06/24/2020, 9:59 PM
    that property is case insensitive, so both calls should be treated the same
  • n

    Neha Pawar

    06/24/2020, 10:04 PM
    i could reproduce, i’ll investigate
  • p

    Pradeep

    06/24/2020, 10:04 PM
    nice thanks
  • n

    Neha Pawar

    06/24/2020, 10:12 PM
    how are you starting the Controller? @Pradeep
  • p

    Pradeep

    06/24/2020, 10:13 PM
    bin/pinot-admin.sh StartController -configFileName <controllerConfig>
  • n

    Neha Pawar

    06/24/2020, 10:14 PM
    cool, there’s a controller property called tenantIsolation which by default is true. that prop overrides the tenant config.
  • n

    Neha Pawar

    06/24/2020, 10:14 PM
    we can set it to false in the controller conf. looking for the exact property key
  • p

    Pradeep

    06/24/2020, 10:24 PM
    would that effect anything else? yeah not able to find a way to override it through controller config
  • n

    Neha Pawar

    06/24/2020, 10:24 PM
    cluster.tenant.isolation.enable=false
  • n

    Neha Pawar

    06/24/2020, 10:25 PM
    try this
  • p

    Pradeep

    06/24/2020, 10:28 PM
    trying it..
  • p

    Pradeep

    06/24/2020, 10:32 PM
    it worked, I can see the tagsOverrideConfig from the rest-api, I will wait for a bit and check if the segments are moving
  • p

    Pradeep

    06/24/2020, 10:32 PM
    What does the
    cluster.tenant.isolation.enable
    variable do?
  • p

    Pradeep

    06/24/2020, 10:32 PM
    it assumes single tenant?
  • n

    Neha Pawar

    06/24/2020, 10:34 PM
    yes.. that property assumes single tenant called “DefaultTenant”
1...115116117...166Latest