Hi everyone! While using Flink SQL there are many aggregations such as group bys, joins that turn the streams into an Upsert Stream, and there are many connectors that do not allow upsert stream, one example is Kinesis. Is there a way to disable the stream to become an upsert stream, and simply become an append only stream? We have made a workaround by doing 1 second windowing to turn it into append only, but adds unnecessary latency

Some operations necessarily create upsert streams; there's no configuration available that will avoid that. You can either avoid those operations, or find a way to convert them. Short windows are one approach -- I've experimented with 1 millisecond windows for this -- another solution is to use a PTF.

Thanks for the quick response David! I think a better long term solution is having a kinesis upsert connector similar to kafka