Apache flink tumbling window or any window always ...
# troubleshootinga
aswin jose
05/12/2023, 11:59 AMApache flink tumbling window or any window always applying grouping and subgrouping as part of aggregation, but i have a situation to collect data in a tumbling window without grouping or aggregation in flink sql client. Is this possible in apache flink?
m
Martijn Visser
05/12/2023, 1:28 PMalways applying grouping and subgrouping as part of aggregation,That's not the case. You can have individual results with Window TVF functions. Something like
Copy code
SELECT * FROM TABLE(
TUMBLE(TABLE Bid, DESCRIPTOR(bidtime), INTERVAL '10' MINUTES));a
aswin jose
05/12/2023, 1:43 PMThank you @Martijn Visser..This helps...Will this support for apache-flink version 1.13 ?
n
Neha
05/12/2023, 8:32 PMYes
a
aswin jose
05/13/2023, 11:38 AMCould i use udf function for
Copy code
SELECT * FROM TABLE(
TUMBLE(TABLE Bid, DESCRIPTOR(bidtime), INTERVAL '10' MINUTES));a
Ari Huttunen
05/13/2023, 11:44 AMAre you using Java or Python? AFAIK, you can in either case, but details differ.
Ari Huttunen
05/13/2023, 11:45 AMI find the Python UDF API clunky.
Ari Huttunen
05/13/2023, 11:55 AMThe python udfs for groupby aggregation require that they store the calculated state in a data type that Flink knows. They also need functionality to remove values from the calculated aggregate.
Neither of these are possible for an algorithm like the t-digest.
a
aswin jose
05/13/2023, 11:59 AMThanks for the input..Is their any method to create a custom function to update record values in a tumbling window?
a
Ari Huttunen
05/13/2023, 1:20 PMIt's documented in the docs.
a
aswin jose
05/13/2023, 9:15 PM@Martijn Visser Thanks again...Your input solved my problems
2 Views