@ Hi Team, I am ingesting realtime data from Kafka and updating realtime data in superset dashboard. In superset dashboard I have one slice where I am displaying events of last 5 min based on my timestamp columns. So for testing purpose I have pushed one event in Kafka which was already available ( duplicate) as soon as pushed the data in Kafka it's showing on pinot within milisec.but same it's not reflecting at dashboard side as last 5 mins count. So my question is. Will it take sometime to reflect at dashboard side ?or duplicates records will not show as last 5 mins. Count at Dashboard. @Mayank

can you check what query the dashboard is firing to Pinot, and compare it with query you used to verify that event is in Pinot?

IMG_20210616_233230.jpg

can you manually run superset query directly on pinot?

Okay

my guess is the superset query is filtering the second record. you'll need to then compare the rows with the predicate on why that is happening

my bad @Mayank . I am pushing events whose current_timestamp is older than 5 min and in superset giving interval as 5 min .so might be this is the issue.

👍