Hi team, is there a WBL concept in Pinot after an event is ingested? We would want to detect this signal and apply rollup in another data system. One option is to have a cron job regularly pulling the table but wonder if there is something out of the box

There isn’t a WBL concept, but are you trying to detect if an event is ingested? There may be ways to identify that

yes! We would want to detect that and then make a query call to get the latest metrics

An event is almost instantly available for query after it is ingested. So most of the time, the delay would be outside of Pinot.

If just wanna a trigger, then try out just query with max timestamp and see if that changed. But if you are looking for the changelog events, then we need to find out another way.

If just wanna a trigger, then try out just query with max timestamp and see if that changed.

that is a good idea. Do you think this query would be performant even without filters?

usually it will, worst case you do startree index 🙂