https://pinot.apache.org/ logo
r

RK

06/16/2021, 5:35 PM
@ Hi Team, I am ingesting realtime data from Kafka and updating realtime data in superset dashboard. In superset dashboard I have one slice where I am displaying events of last 5 min based on my timestamp columns. So for testing purpose I have pushed one event in Kafka which was already available ( duplicate) as soon as pushed the data in Kafka it's showing on pinot within milisec.but same it's not reflecting at dashboard side as last 5 mins count. So my question is. Will it take sometime to reflect at dashboard side ?or duplicates records will not show as last 5 mins. Count at Dashboard. @Mayank
m

Mayank

06/16/2021, 5:38 PM
can you check what query the dashboard is firing to Pinot, and compare it with query you used to verify that event is in Pinot?
r

RK

06/16/2021, 6:03 PM
message has been deleted
@Mayank
m

Mayank

06/16/2021, 6:04 PM
can you manually run superset query directly on pinot?
r

RK

06/16/2021, 6:05 PM
Okay
m

Mayank

06/16/2021, 6:05 PM
my guess is the superset query is filtering the second record. you'll need to then compare the rows with the predicate on why that is happening
👍 1
r

RK

06/16/2021, 7:06 PM
my bad @Mayank . I am pushing events whose current_timestamp is older than 5 min and in superset giving interval as 5 min .so might be this is the issue.
m

Mayank

06/16/2021, 8:04 PM
👍