Apache Pinot

Thanks for creating the channel, Lin. Can we rename this channel to (say) pinot-rack-awareness

Sure. Will do. I will invite Jay once he join Pinot oss slack.

<!here>
Please help review the document: *Failure/Fault Domain Metadata Retrieval and Persistence to Helix Participant Configs:*
<https://docs.google.com/document/d/1echXSSZfgKWLtkmA1KKxmdCRUkTqffqoJhNA-ovTfzc/>

Hi <@UDRJ7G85T> this is the more leaner doc based on our conversation last week.

<@UDRJ7G85T> <@U01KYJEFWUF> Can u access now ? I have updated the link and granted u permissions.

Design is LGTM! Do we plan on providing an out of the box pinot property provider in addition to the azure specific provider?

Not part of the plan atm.. But I thought we might need a Noop impl probably…
With your new suggestion, the out of the box property based option will just work.. so leaning towards it

Can u sign off at the bottom of the Document. I have added your name to the reviewers list. Thanks :slightly_smiling_face:

Hey <@UDRJ7G85T>  Can u have one more look at the doc: <https://docs.google.com/document/d/1echXSSZfgKWLtkmA1KKxmdCRUkTqffqoJhNA-ovTfzc/|https://docs.google.com/document/d/1echXSSZfgKWLtkmA1KKxmdCRUkTqffqoJhNA-ovTfzc/> and sign off today. Thanks :blush: 

<@U01SXC56AV6> What is pinot env provider supposed to do?

Hello guys, just want to check something. Consider a scenario where I have 6 segments , 3 servers and replica-per-partition is 2 and 2 FD. Will the design ensure replicas always go to a different FD? something like the diagram?

any reason why you dont want to have equal number of nodes per FD? or multiple FD's?

That was just an example, and I am using k8s so node count won't be exactly the same always.

Yeah, we will have to enhance the algorithm and most likely, we will end up having multiple strategies 

Prefer availability over uniform load balancing vs best effort tact aware placement

Yes agree,  it will be better to spread segments uniformly. That might require additional checks?

Segment assignment is a PhD topic and can get super complicated 

Yes, however as a quick workaround may be assign the segment to a node with least no of segments .

Hi Lars, you can ask this in troubleshooting 