https://pinot.apache.org/ logo
Join Slack
Powered by
# general
  • s

    sunny19930321

    03/03/2020, 2:10 PM
    I want to test two mount methods
  • m

    Mayank

    03/03/2020, 2:23 PM
    Sure, but you can only configure one at a time. So these will be two separate tests
  • s

    sunny19930321

    03/04/2020, 2:19 AM
    yes, I’m testing the two mount methods in the test environment to see which is more suitable for our online environment @User
  • m

    Mayank

    03/04/2020, 3:34 AM
    Ok, cool. Hope you got answers to your questions @User
  • h

    Harshini Elath

    03/05/2020, 4:59 PM
    We tried star-tree index before loading segments but it doesn't look like it created
  • h

    Harshini Elath

    03/05/2020, 5:00 PM
    table config
    iw_trans_inventory_table_conf.json
  • h

    Harshini Elath

    03/05/2020, 5:00 PM
    index map from server
    index_map
  • h

    Harshini Elath

    03/05/2020, 5:01 PM
    any errors in config file ?
  • m

    Mayank

    03/05/2020, 5:03 PM
    Probably need to enable generation?
  • m

    Mayank

    03/05/2020, 5:21 PM
    We should have a validation tool for the configs?
  • n

    Neha Pawar

    03/05/2020, 5:22 PM
    i think we by choice allow extra configs to stay there, so that if something is removed, we wont fail
  • m

    Mayank

    03/05/2020, 5:22 PM
    I understand that behavior in controller
  • m

    Mayank

    03/05/2020, 5:23 PM
    But would be good to have a standalone tool that flags these
  • n

    Neha Pawar

    03/05/2020, 5:23 PM
    true
  • v

    veera vissa

    03/05/2020, 6:08 PM
    TableConfig
    TableConfig
  • v

    veera vissa

    03/05/2020, 6:09 PM
    { "code": 400, "error": "Cannot deserialize instance of
    java.util.ArrayList
    out of START_OBJECT token\n at [Source: UNKNOWN; line: -1, column: -1] (through reference chain: org.apache.pinot.common.config.IndexingConfig[\"starTreeIndexConfigs\"])" }
  • d

    Dan Hill

    03/06/2020, 7:22 PM
    Hi. I'm trying to follow the getting started instructions but they seem out of date. E.g. TOP doesn't appear to be allowed anymore. Scripts are missing. Any thoughts? Thanks! - Dan
  • n

    Neha Pawar

    03/06/2020, 7:26 PM
    hey Dan, we've started using https://apache-pinot.gitbook.io/apache-pinot-cookbook/getting-started as the documentation. Could you please try the instruction on this one instead?
  • d

    Dan Hill

    03/06/2020, 7:29 PM
    Ah, can do. Can someone update the 'learn more' link at https://pinot.apache.org/ ?
    ➕ 1
  • n

    Neha Pawar

    03/06/2020, 7:31 PM
    yeah, will do
  • n

    Neha Pawar

    03/06/2020, 7:46 PM
    updated the links @User. This documentation is still a WIP. Feedback is welcome!
    😀 1
  • d

    Dan Hill

    03/06/2020, 9:22 PM
    I've hit two issues with pinot-admin.sh. It seems to fail sometimes and not return an error. How can I get errors to be returned from it? One of the issues was I had a extra comma in the json spec during AddTable. Part of the success output is printed out (no errors). Another issue is I'm trying to batch load a 20M row csv (a 2M row csv worked). There is not an error in the output. https://docs.google.com/document/d/1MqoPzDX9oc-QdQE-pDHw-htKya3tlEOPB9_ZyRCcS28/edit#
  • d

    Dan Hill

    03/07/2020, 8:15 PM
    Hi. I have a few questions. (1) Does anyone have code where Protocol Buffers are used as inputs for ingestion? (2) Has anyone designed an API in front of Pinot that joins pinot with another data source for the API? E.g. I want to have my stats generated in Pinot and then join them entities in a MySQL table and return the results in GraphQL. It seems like I can use Apache Calcite to do this. (3) Is there documentation on useful/common integrations? I see on the gitbook.io that there's support for Thirdeye, Superset, Presto, Powerbi. Anything else? Thanks! - Dan
  • m

    Mayank

    03/07/2020, 9:20 PM
    These do seem like great integration ideas. We don’t have these (afaik), but happy to help you get these working
  • k

    Kishore G

    03/07/2020, 9:31 PM
    For 1) this is streaming or batch mode?
  • k

    Kishore G

    03/07/2020, 9:31 PM
    2) you can do this with presto Pinot connector
  • d

    Dan Hill

    03/08/2020, 12:37 AM
    (1) For both. (2) Cool, I'll take a look at Presto.
  • m

    Mayank

    03/08/2020, 12:38 AM
    Also curious how do you like GraphQL for analytical queries?
  • m

    Mayank

    03/08/2020, 12:39 AM
    My impression from a while back was that it was too verbose to perform a simple aggregation
  • d

    Dan Hill

    03/08/2020, 2:05 AM
    For my use case, GraphQL is mostly for UIs and external API. For analyzing ad stats, a SQL-like interface is easier. For doing mgmt stuff (like creating, updating, listing, etc), GraphQL is pretty nice. GraphQL lets me fetch multiple levels of entities in the same API call. The fields also can be more complex than converting fields to SQL columns. I'll probably end up exposing both a GraphQL and a SQL-like interface at some point.
1...116117118...160Latest