https://pinot.apache.org/ logo
Join Slack
Powered by
# general
  • k
    Ah I think I got it.
  • k
    But will be beneficial for others to explain the scenario
  • s
    @User just trying to understand whether Pinot would be able to handle such a scenario or would it cause problems
  • k
    I can’t think of any reason why that would be an issue.
  • k
    @User wdyt
  • m
    Yeah, agree. One callout is that we don't support nested schema for the topic.
  • s
    It would entail each table consumer would have to read each message and discard appropriately…would slow down ingestion
  • s
    Also not a great idea if some tables expect higher volumes
  • m
    Unless these topics are quite overlapping, it will be an overhead
  • m
    *schema
  • s
    On the 
    tenants
    section, is that to be thought of in the context of tenancy as in data belonging to multiple different tenants in the same table? How do I think of this tenant section?
  • s
    It appears I cannot have multiple 
    outgoingGranularitySpec
    say I push timeseries data and want rollups say hypotetically 15min, 30min, 1 hr?
  • m
    Yeah, we have discussed that in the past, but not supported yet
  • k
    Hmm
  • k
    @User It is supported rt?
  • m
    Multiple time granularities?
  • m
    May be I am misreading the question?
  • s
    Multiple rollup intervals
  • k
    @User added that feature to have multiple datetimefieldspec
  • m
    Hmm, but do we have query processing that can figure out which rollup to use?
  • k
    One can use startree rt
  • k
    You can have time-15m, time-30, time-60 columns
  • m
    Yes, that works. I thought what @User was asking was more on what @User was working on
  • m
    the auto-rollup
  • k
    No. Thats a bit advanced.
  • m
    but instead of auto, there's multiple outgoing granularities
  • m
    ok
  • s
    @User mind explaining what you mean by “instead of auto, there’s multiple granularities”? How are they different?
  • k
    @User Mayank is talking about logical time column vs physical
  • k
    One can think that logically there is one time column
1...949596...160Latest