https://pinot.apache.org/ logo
Join Slack
Powered by
# roadmap
  • y

    Yugandhar

    08/24/2020, 5:17 PM
    okay, thanks! are you planning to move to Java 11 with ZGC ? At this latency level GC could impact the >p95
  • y

    Yugandhar

    08/24/2020, 5:18 PM
    Many people faced it with Cassandra, So we relied on Scylladb
  • k

    Kishore G

    08/24/2020, 5:18 PM
    we haven't looked into it yet. thats good to know
  • k

    Kishore G

    08/24/2020, 5:18 PM
    this is at nurture farm?
  • y

    Yugandhar

    08/24/2020, 5:18 PM
    At Ola
  • y

    Yugandhar

    08/24/2020, 5:19 PM
    Even in nurture.farm we avoid Cassandra DB!
  • k

    Kishore G

    08/24/2020, 5:20 PM
    do you have detailed analysis on zGC
  • k

    Kishore G

    08/24/2020, 5:21 PM
    we are debugging something with leanplum on p99
  • k

    Kishore G

    08/24/2020, 5:21 PM
    and suspecting GC
  • y

    Yugandhar

    08/24/2020, 5:22 PM
    But we liked it in Java only, Over a period of time we want many developers work on the code base!
  • y

    Yugandhar

    08/24/2020, 5:23 PM
    I will find analysis for ZGC and post it, For last one year I worked on very closed system!
  • y

    Yugandhar

    08/24/2020, 5:23 PM
    I missed these links!
  • k

    Kishore G

    08/24/2020, 5:24 PM
    no worries, reading about it.
  • y

    Yugandhar

    08/24/2020, 5:25 PM
    But the idea is it won't reduce any burden on GC, but reduce the average "Stop the world" time by great extent, If I remember well, for large heaps it'll help even more!
  • y

    Yugandhar

    08/24/2020, 5:26 PM
    Does anybody used Pinot for logs use case ? Even though in docs said that it can be used, we don't find any articles on them! We want to use for comments (from users) matching as well!
  • k

    Kishore G

    08/24/2020, 5:27 PM
    yes, we haven't done anything specifically for that but we are seeing folks starting to use it for logs use case
  • k

    Kishore G

    08/24/2020, 5:28 PM
    its not Pinot's strength but we have the primitives like Text Index that can be enabled on specific columns
  • k

    Kishore G

    08/24/2020, 5:29 PM
    https://medium.com/apache-pinot-developer-blog/text-analytics-on-apache-pinot-cbf5c45d282c
  • y

    Yugandhar

    08/24/2020, 5:31 PM
    Thanks for the reading!
  • k

    Kishore G

    08/24/2020, 5:31 PM
    I can put you in touch with them if you need more info
  • y

    Yugandhar

    08/24/2020, 5:38 PM
    That would definitely help!
  • y

    Yugandhar

    08/24/2020, 5:41 PM
    Thanks for your time today!
  • k

    Kishore G

    08/24/2020, 5:42 PM
    when do you want to talk to them?
    y
    • 2
    • 6
  • y

    Yugandhar

    08/24/2020, 5:45 PM
    Their scale and learnings from it, especially in terms of manageability, Given that they are using with Lucene (Another moving part)
  • y

    Yugandhar

    08/24/2020, 5:48 PM
    It looks like they are some inherent inefficiency, for AND queries they are fetching documents separately for each query and doing joins of documents, which is pretty bad for scalability! I want it in such a way that full query has to be executed on table segment itself then return the result!
  • k

    Kishore G

    08/24/2020, 6:00 PM
    Lucene is temporary thing, we plan to replace it soon
  • k

    Kishore G

    08/24/2020, 6:01 PM
    the only part we need is the fuzzy matching part
  • p

    Petr Ponomarenko

    08/29/2022, 5:55 PM
    Hi. Please let me know if there is a slack channel that better fit the following question. What are the plans of adding support for Approximate Quantiles/Histograms/Ranks/CDF/etc and corresponding HLL Sketch and doubleSketch datatypes? Similar to https://druid.apache.org/docs/latest/development/extensions-core/datasketches-quantiles.html and https://datasketches.apache.org/docs/HLL/HLL.html . Or what other things can be already used in Pinot to represent mergeable information about approximate distributions? For example, what can we use to store the distribution of some float point values and allow filtering and aggregation of such distributions? Thank you.
    👍 1
  • k

    Kishore G

    08/29/2022, 9:31 PM
    troubleshooting might be a better channel
    thankyou 1
  • k

    karthi ck

    03/22/2024, 2:09 PM
    I would like to learn about the roadmap/next priority features for Apache Pinot. Do we have any docs/channel to get this information ?