https://pinot.apache.org/ logo
Join Slack
Powered by
# general
  • k

    Kishore G

    04/03/2020, 4:59 PM
    I dint know Amazon Athena would allow installing your own connector
  • d

    Dan Hill

    04/03/2020, 5:08 PM
    I don't know much about Athena. There's a way of installing connectors using AWS Lambda.
  • k

    Kishore G

    04/03/2020, 5:11 PM
    looks like they do - https://github.com/awslabs/aws-athena-query-federation/wiki/Available-Connectors
  • d

    Dan Hill

    04/03/2020, 5:13 PM
    Yea
  • d

    Dan Hill

    04/03/2020, 5:13 PM
    https://docs.aws.amazon.com/athena/latest/ug/connect-data-source-federation-sdk.html
  • d

    Dan Hill

    04/03/2020, 5:14 PM
    This isn't a blocker for my team. Mostly was curious. For my use case, the price would work out well.
  • h

    Harshini Elath

    04/03/2020, 7:27 PM
    how does pagination work in pinot queries ?
  • h

    Harshini Elath

    04/03/2020, 7:28 PM
    SELECT foo, bar FROM myTable WHERE baz > 20 ORDER BY bar DESC LIMIT 50, 100
  • h

    Harshini Elath

    04/03/2020, 7:28 PM
    is 50 offset and 100 limit ?
  • h

    Harshini Elath

    04/03/2020, 7:29 PM
    it is giving the correct number of records but it looks like offset always starting from first record in results
  • x

    Xiang Fu

    04/03/2020, 9:28 PM
    LIMIT 50, 100 should return results from doc id 50-149
  • x

    Xiang Fu

    04/03/2020, 9:29 PM
    just if you don’t order by foo/bar, then your results may not be consistent between two queries
  • m

    Mayank

    04/03/2020, 9:29 PM
    It does end up redoing the entire query again though, and in case if ties you may see the same overlapping records
  • h

    Harshini Elath

    04/03/2020, 9:29 PM
    select psa_cd, psa_name, item_id, item_name,sum(net_purchases), sum(cash_purchases), sum(write_off_sales), sum(transfers), sum(net_merchandise_sales) from iw_trans_inventory where str_num = 39087 and transaction_date >= '2019-10-25' and transaction_date <'2020-01-09' and item_id != -99999 and sale_type = 'Original Retail' group by psa_cd, psa_name, item_id, item_name order by psa_cd, psa_name, item_id, item_name LIMIT 500,500
  • h

    Harshini Elath

    04/03/2020, 9:30 PM
    this was the sample query
  • m

    Mayank

    04/03/2020, 9:30 PM
    Limit with offset is only for selection queries at the moment
  • m

    Mayank

    04/03/2020, 9:30 PM
    Your query is aggr group by
  • h

    Harshini Elath

    04/03/2020, 9:30 PM
    Oh okay 👍
  • d

    Dan Hill

    04/04/2020, 4:28 AM
    Is there a Helm chart for
    apachepinot/pinot-presto:latest
    ? I tried to modify an existing Helm chart for other presto images but I'm hitting issues
    Error: failed to start container "presto-coordinator": Error response from daemon: OCI runtime create failed: container_linux.go:345: starting container process caused "exec: \"python3\": executable file not found in $PATH": unknown
    . I'm guessing this Docker image is different from other Presto Docker images.
  • x

    Xiang Fu

    04/04/2020, 4:33 AM
    so you are using
    apachepinot/pinot-presto:latest
    ?
  • d

    Dan Hill

    04/04/2020, 4:34 AM
    Yea
  • x

    Xiang Fu

    04/04/2020, 4:35 AM
    can you try this image :
    apachepinot/pinot-presto:0.234.1
  • x

    Xiang Fu

    04/04/2020, 4:35 AM
    this image should have python installed already
  • x

    Xiang Fu

    04/04/2020, 4:35 AM
    did you change PATH in the image
  • x

    Xiang Fu

    04/04/2020, 4:35 AM
    or the env variable ?
  • d

    Dan Hill

    04/04/2020, 4:36 AM
    I can try that. I don't know. I used the helm chart at
    <https://github.com/wiwdata/presto-chart>
    and I changed the repository and ripped out two of the values that were not used.
  • d

    Dan Hill

    04/04/2020, 4:38 AM
    I get the same issue with
    0.234.1
    . I can try a different helm chart next.
  • x

    Xiang Fu

    04/04/2020, 4:38 AM
    yes
  • d

    Dan Hill

    04/04/2020, 4:38 AM
    <https://github.com/helm/charts/tree/master/stable/presto>
  • x

    Xiang Fu

    04/04/2020, 4:38 AM
    or you can try out kube yaml file
1...122123124...160Latest