https://pinot.apache.org/ logo
Join Slack
Powered by
# troubleshooting
  • s

    Subbu Subramaniam

    06/11/2020, 5:26 PM
    ok, then we need to look at logs that say where the memroy is allocated.
  • s

    Subbu Subramaniam

    06/11/2020, 5:26 PM
    there is a debug port on the server that shows this
  • m

    Mayank

    06/11/2020, 5:27 PM
    @srisudha ^^
  • s

    srisudha

    06/11/2020, 8:18 PM
    Okay in logs it says Read mode is heap. Is that what you are referring?
  • k

    Kishore G

    06/11/2020, 8:19 PM
    Yes
  • s

    srisudha

    06/11/2020, 8:19 PM
    So what is the config i need to add to make it to mmap
  • s

    srisudha

    06/11/2020, 8:21 PM
    If read mode is mmap then where is load mode that i set to mmap using into effect?
  • k

    Kishore G

    06/11/2020, 8:23 PM
    if you have set the load mode in table, then that should be used
  • m

    Mayank

    06/11/2020, 8:24 PM
    @Kishore G tableconfig shows mmap
  • m

    Mayank

    06/11/2020, 8:24 PM
    The log is from instanceconfig and is misleading
  • m

    Mayank

    06/11/2020, 8:25 PM
    There are other configs to turn on mmap allocation for consuming segments
  • m

    Mayank

    06/11/2020, 8:26 PM
    But the confusing part is that why is10GB not good enough to consume and generate 3 segments in parallel of 100MB each
  • s

    srisudha

    06/11/2020, 8:27 PM
    And may be some accumulation is happening since first segment creation is good but oom for second time
  • m

    Mayank

    06/11/2020, 8:40 PM
    @srisudha could you tell us what java version you are using? Also if you could run jmap -histo and lsof and share the output?
  • s

    srisudha

    06/11/2020, 9:41 PM
    1.8
  • s

    srisudha

    06/11/2020, 9:41 PM
    Java
  • s

    srisudha

    06/11/2020, 9:42 PM
    Ya i can do a jmap
  • k

    Kishore G

    06/11/2020, 11:19 PM
    sorry, few folks complained about the traffic on general 🙂
  • k

    Kishore G

    06/11/2020, 11:20 PM
    which api did you use
  • p

    Pradeep

    06/11/2020, 11:21 PM
    np, /tables/{tableName}/size
  • p

    Pradeep

    06/11/2020, 11:21 PM
    i am getting { “tableName”: “<table_name>“, “reportedSizeInBytes”: 0, “estimatedSizeInBytes”: 0, “offlineSegments”: null, “realtimeSegments”: { “reportedSizeInBytes”: 0, “estimatedSizeInBytes”: 0, “missingSegments”: 0, “segments”: {} } }
  • p

    Pradeep

    06/11/2020, 11:22 PM
    but i do segments on the table and get results back from the ui
  • k

    Kishore G

    06/11/2020, 11:22 PM
    this is on controller ?
  • k

    Kishore G

    06/11/2020, 11:22 PM
    or each server
  • p

    Pradeep

    06/11/2020, 11:23 PM
    table is configured to use realitime server
  • p

    Pradeep

    06/11/2020, 11:23 PM
    was that what you were asking for?
  • k

    Kishore G

    06/11/2020, 11:23 PM
    checking
  • k

    Kishore G

    06/11/2020, 11:24 PM
    Copy code
    {
      "tableName": "baseballStats_OFFLINE",
      "reportedSizeInBytes": 3737641,
      "estimatedSizeInBytes": 3737641,
      "offlineSegments": {
        "reportedSizeInBytes": 3737641,
        "estimatedSizeInBytes": 3737641,
        "missingSegments": 0,
        "segments": {
          "baseballStats_OFFLINE_0": {
            "reportedSizeInBytes": 3737641,
            "estimatedSizeInBytes": 3737641,
            "serverInfo": {
              "Server_10.1.10.82_7000": {
                "segmentName": "baseballStats_OFFLINE_0",
                "diskSizeInBytes": 3737641
              }
            }
          }
        }
      },
      "realtimeSegments": null
    }
  • k

    Kishore G

    06/11/2020, 11:25 PM
    I tried it for quick start and returns correctly
  • p

    Pradeep

    06/11/2020, 11:25 PM
    my table is realtime, could that be issue?
1...111112113...166Latest