ed
08/12/2024, 1:06 PMredshift-destination (however much justified), came a bit out-of the blue which is the removal of standard INSERT strategy as mean of syncing. This felt a bit rushed since there is a lack of both deprecation announcement & documentation (standard INSERTs are still mentioned as an option to this day!), more importantly there is a security concern IMO, where COPY strategy S3 is now mandatory since it's the only option, the only AWS auth mean are through AWS Access keys (unlike s3-destination that allows passing an IAM Role's ARN, which is not super consistent) but they're not meant to be used that way in production. Issue #41031
• DeclarativeCursors as explained here. There would be many use cases where one would need to define incremental syncing without having a field in the data source to do so like mentioned in this discussion. It leaves one with not much option to define a custom connector through config.AddField transformation airbyte rocket octavia lovesEvan Tahler (Airbyte)
08/12/2024, 4:22 PM