I don't think it is multiplied. You need one merge buffer to run each group by query ... when the broker runs a query it sends a subquery to each historical and real-time ingestion task, and then merges the results it receives back. So each node in question would just need one merge buffer to serve that query.
I'm not sure why a bit higher ... possibly there are Group By queries that the Broker can execute without Historical involvement, i.e. real-time segments only?