Hello, I am new with pinot, I try to model my data...
# general
i
Hello, I am new with pinot, I try to model my data into few meta data tables, and one major table. One of my metadata table should be large, maybe millions of records.. I read that there is a problem with the join of large table(more than 200MB), I'm lookin for ideas how to handle it, or if there are another solutions
m
if the join table is 200MB I think that should be ok? I assume you are talking about a dimension table? https://startree.ai/blog/understanding-lookup-based-join-support-in-apache-pinot
i
@Mark Needham yes, I'm talking about the dimension table