Hello all, please I need some help, and clarity on...
# connector-contributions
k
Hello all, please I need some help, and clarity on this. When using Airbyte data platform to transfer data from MSSQL to Redshift... Is it better to transfer data directly from the SQL base tables into Redshift, or Is it rather better to create SQL Views off of those base tables in MSSQL before transferring data based on the SQL views into Redshift ? I tried transferring data from a particular SQL table into Redshift, but the table was short(data loss) of a good chunk of data upon reaching Redshift. However, when I created a SQL view from the same base table... and referenced the SQL view in Airbyte to load into Redshift, it actually worked... Can anyone shed some more light on this ? SQL Views Versus SQL Base Tables, any of them better for transfers via Airbyte ?
n
I don’t think that view vs table should make a difference for data consistency? We’ve also just shipped (or still in process?) source-MySQL on the new CDK, supposed to be much faster and more consistent. Either way, IF having an automated view solves data loss for your case, I guess nothing bad in having it. I’d recommend you figure out why some data would not sync from the original table tho.
k
Thanks.
Did you mean CDK for MSSQL or MySQL ?
n
Pardon me, MSSQL of course
k
Hey Natik, hope you doing well? How do I obtain this new CDK for MSSQL, or is it just an update to the MSSQL connector as shown below ? And when should this update be done ideally ?