Hi Team , i need help for below scenario • Table 'A' holds information about categories<category_id,category_name>, which is populated by kafka topic 1 • i am getting events from topic 2 , the payload has only

category_id

and i want to filter based on

category_name

during ingestion time.So i want to look up/query Table 'A' to get

category_name

based on

category_id

. Is it possible as per current architecture ? if yes can you point me the code sample?

You can try lookup join, but that requires TableA to be an offline table

Okay @Mayank but

Table A

also realtime table which is fed by kafka topic 1

We don’t have that today

okay @Mayank. Flink or beam which i have to use outside of Pinot scope right?

@chandarasekaran m Correct, you’d do this processing in a Flink (or Beam) workflow before generating the data that Pinot would ingest.