Hi All, I am building a Flink pipeline to write data into a Splunk index. I group records using window operations and then write into Splunk. Is it possible to use a window trigger based on size rather than count? I am encountering some memory and connection issues with Splunk.
k
Kirill Ternovsky
07/04/2024, 2:06 AM
In a pinch you could probably just copy CountTrigger, adapt it to accumulate your object sizes instead of just counts, and use that as a custom trigger.