Apache Pinot

Hey <@UDRJ7G85T> <@U01KYJEFWUF> Thanks for reviewing the doc. Can we sign off on it today ?

Design is LGTM! Do we plan on providing an out of the box pinot property provider in addition to the azure specific provider?

Not part of the plan atm.. But I thought we might need a Noop impl probably…
With your new suggestion, the out of the box property based option will just work.. so leaning towards it

what is a good term to describe where Pinot is deployed

Zone feels generic to me. Can be a rack, a datacenter room, a region, a cloud provider or a continent

Yeah, took a step back and actually I have design comment, I’ll share them in the doc.

<@U0122PWUVJT> Updated the document with your suggestion. Can u review it again. Thanks :slightly_smiling_face:
cc <@UDRJ7G85T>

Can u sign off at the bottom of the Document. I have added your name to the reviewers list. Thanks :slightly_smiling_face:

Hey <@UDRJ7G85T>  Can u have one more look at the doc: <https://docs.google.com/document/d/1echXSSZfgKWLtkmA1KKxmdCRUkTqffqoJhNA-ovTfzc/|https://docs.google.com/document/d/1echXSSZfgKWLtkmA1KKxmdCRUkTqffqoJhNA-ovTfzc/> and sign off today. Thanks :blush: 

<@UDSRQR2GP> <@UDRJ7G85T> Can u review the changes and sign off today if possible. Thanks :slightly_smiling_face:

<@U01SXC56AV6> What is pinot env provider supposed to do?

Screen Shot 2021-04-09 at 1.09.34 AM.png

Hello guys, just want to check something. Consider a scenario where I have 6 segments , 3 servers and replica-per-partition is 2 and 2 FD. Will the design ensure replicas always go to a different FD? something like the diagram?

any reason why you dont want to have equal number of nodes per FD? or multiple FD's?

That was just an example, and I am using k8s so node count won't be exactly the same always.

Yeah, we will have to enhance the algorithm and most likely, we will end up having multiple strategies 

Prefer availability over uniform load balancing vs best effort tact aware placement

Yes agree,  it will be better to spread segments uniformly. That might require additional checks?

Segment assignment is a PhD topic and can get super complicated 

Yes, however as a quick workaround may be assign the segment to a node with least no of segments .

<@UDT7GFEG6> <@UDRJ7G85T> <@UDSRQR2GP> Can u guys help review the PR : <https://github.com/apache/incubator-pinot/pull/6842>
I am making some minor changes to the PR in some time.  Will ping again once ready.

Hey <@UDT7GFEG6> <@UDRJ7G85T> <@UDSRQR2GP> <@U01KYJEFWUF> Can I get a review for <https://github.com/apache/incubator-pinot/pull/6842|https://github.com/apache/incubator-pinot/pull/6842> Thanks

:eyes: Found this channel in a random mailing list when trying to figure out how to enable rack awareness for pinot + kafka.. Is this feature available?

Hi Lars, you can ask this in troubleshooting 