https://pinot.apache.org/ logo
Join Slack
Powered by
# general
  • n

    Neha Pawar

    03/18/2022, 7:03 PM
    Pinot community member and committer @User has written this nice blog about the Kinesis connector he worked on ๐Ÿ™‚ https://www.startree.ai/blogs/introducing-kinesis-support-in-apache-pinot
    ๐Ÿ‘ 12
  • d

    Diogo Baeder

    03/19/2022, 11:08 PM
    @User ^ as promised ๐Ÿ™‚
  • k

    Karin Wolok

    03/20/2022, 1:17 PM
    Nice job, @User on the blog, and thank you for taking the time! If anyone is interested, here's the link! https://www.startree.ai/blogs/introducing-kinesis-support-in-apache-pinot
  • k

    Karin Wolok

    03/20/2022, 1:18 PM
    I also just want to recognize @User for this awesome blog post! We know these pieces of content will be tremendously helpful to the community! Thank you!
    โค๏ธ 5
  • d

    Diogo Baeder

    03/20/2022, 1:26 PM
    You guys are very welcome, your support has been way more than amazing!
    โค๏ธ 3
  • k

    Karin Wolok

    03/22/2022, 4:11 PM
    ๐Ÿ‘‹ Help us welcome all the new Apache Pinot members! ๐Ÿท Please tell us who you are and what brought you here! ๐Ÿ˜ƒ @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User
    ๐Ÿ‘‹ 4
  • a

    Alice

    03/28/2022, 4:05 AM
    and if i want to use EBS, i should set two properties referred to EBS?
  • a

    Alice

    03/28/2022, 4:06 AM
    and the following properties are used to set deepstore:
  • a

    Alice

    03/28/2022, 4:06 AM
    pinot.server.storage.factory.class.s3=org.apache.pinot.plugin.filesystem.S3PinotFS 8 pinot.server.storage.factory.s3.region=us-west-2 9 pinot.server.segment.fetcher.protocols=file,http,s3 10 pinot.server.segment.fetcher.s3.class=org.apache.pinot.common.utils.fetcher.PinotFSSegmentFetcher
  • a

    Alice

    03/28/2022, 7:38 AM
    If i set retentionTimeUnit to 30 DAYS in a table config, will controller periodic task delete data in S3 deep store which is older than 30 days too?
  • a

    Alice

    03/28/2022, 2:43 PM
    In my test, some properties can be set like this, pinot-admin.sh StartController -zkAddress localhost:2191 -controllerPort 9000.
  • s

    Sukesh Boggavarapu

    03/28/2022, 3:55 PM
    ๐Ÿ‘‹ Hi everyone! Nice to be here.
  • s

    Sukesh Boggavarapu

    03/28/2022, 3:56 PM
    So, I am trying to get a table configured for upsert. So, I cannot use star tree index as it says in docs? Does that mean I am only limited to use any other index other than star tree?
  • s

    Sukesh Boggavarapu

    03/28/2022, 3:57 PM
    Also, according to docs, it is not guaranteed that order is preserved in case there is any sort index on any column.
  • s

    Sukesh Boggavarapu

    03/28/2022, 3:57 PM
    Copy code
    When two records of the same primary key are ingested, the record with the greater event time (as defined by the time column) is used. When records with the same primary key and event time, then the order is not determined. In most cases, the later ingested record will be used, but may not be so in the cases when the table has a column to sort by.
  • s

    Sukesh Boggavarapu

    03/28/2022, 3:58 PM
    Thanks
  • s

    Sukesh Boggavarapu

    03/29/2022, 11:59 AM
    However, after ingestion, along with my 3 records, pinot actually shows a lot of documents with null values..
  • s

    Sukesh Boggavarapu

    03/29/2022, 12:01 PM
    The actual 3 docs are the last 3 records. But like we can see, there are other results with null merchant name/Integer.MIN_VALUE merchantIds... In fact, it shows total docs as 116 where I expected it to show only 3 records.
  • a

    Alice

    03/29/2022, 12:44 PM
    Thanks
  • a

    Alice

    04/01/2022, 5:24 AM
    I uploaded a realtime table config and pinot created some local data, but no records in the table.
  • a

    Alice

    04/01/2022, 5:24 AM
    image.png
  • t

    Tonya Moore

    04/04/2022, 8:48 PM
    Hey folks! @User is doing a virtual meetup tomorrow on analyzing IoT data with Apache Pinot and Kafka. Please register if you can join us! ๐Ÿ—ฃ๏ธ ๐Ÿ’ป https://community.startree.ai/analyzing-iot-data-with-apache-kafka-and-pinot
    ๐Ÿท 5
    ๐Ÿ’ฏ 1
  • v

    Varun Mukundhan

    04/05/2022, 1:54 PM
    Hey folks, just an observation, the pinot go client doesnโ€™t have any provision to specify http/query timeout. It uses the defaultHttp client that keeps the connection open indefinitely. Any way to circumvent this?
  • t

    Tonya Moore

    04/05/2022, 3:00 PM
    Hey folks! Just a reminder that in 30 minutes we're going to start the meetup with @User. Come join us if you can! https://community.startree.ai/analyzing-iot-data-with-apache-kafka-and-pinot
  • a

    Alice

    04/06/2022, 9:23 AM
    Hi team, when HTTP Basic Auth is enabled in Pinot 0.10, some swagger rest api calls return 403. Is there some property I can set to make sure these endpoints be accessed with admin account? Thanks.
  • c

    Chengxuan Wang

    04/09/2022, 11:02 AM
    https://github.com/apache/pinot/pull/8498 looks like I canโ€™t add tag and reviewers to the pull request.
  • m

    Michael K. Aboagye

    04/11/2022, 2:19 PM
    Hi folks, which page replacement algorithm does Pinot use?
1...156157158159160Latest