Is there a way to tell how late a late-arriving ev...
# troubleshootingd
Daniel Packard
06/07/2023, 5:35 PMIs there a way to tell how late a late-arriving event is? (I'm looking at a side output stream of late arriving data in a window operation, and trying to determine some stats about avg/p99/etc lateness)
j
Jeremy DeGroot
06/07/2023, 6:53 PMCurrent time minus event time? I put that into a histogram in Datadog for my events
https://docs.datadoghq.com/integrations/flink/
https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/deployment/metric_reporters/#datadog
👀 1
d
David Anderson
06/07/2023, 9:24 PMAs Jeremy mentioned, event time lag (current time minus event time) is a good thing to watch. But if you want to know by how much an event missed out on not being late, that would be current watermark minus event time — that’s how much you should add to the bounded-out-of-orderness if you want that event to not be late.
d
Daniel Packard
06/07/2023, 9:27 PMhow much you should add to the bounded-out-of-orderness if you want that event to not be lateexactly what I'm investigating - thanks @David Anderson! @Jeremy DeGroot - we don't use DataDog but that's a good lead, thanks!
Daniel Packard
06/07/2023, 9:37 PMwill the currentWatermark() be available after a message has landed in the late-data side output?
e.g. by applying a processfunction
Copy code
public void processElement(Foo foo, ProcessFunction<Foo, FooWithLateness>.Context ctx, Collector<FooWithLateness> out) throws Exception {
return new FooWithLateness(foo, foo.timestamp - ctx.timerService().currentWatermark());
}Daniel Packard
06/07/2023, 9:38 PMmore specifically, is it possible the
currentWatermark()