Hello, For Real-Time Tables, is there a condition like one Kafka topic should have one table data alone ?. In our cases, we have multiple tables data produced in a single topic. i.e we have a group of topics in Kafka. Each topic will serve for the set of tables based on the use case. is it possible to consume multiple table events from a single topic in pinot?

Each table in Pinot is independent of each other.. you can set up multiple tables to consume from same kafka topic.. You can also use filter config to filter out rows that don't belong to that table

Watch where you are headed though. It is easy to throw in all data into one topic and create multiple pinot tables, but the tables will be consuming all the data and discarding those that we don't need. This can generate a lot of garbage and get in way of high throughput use cases.

@User we have a group of topics. 1. since we have both user-level and table-level shard maintaining separate topic for every table is not scalable for us. 2. Configuring the Same topic for multiple tables will increase unnecessary IO load on Kafka servers.