https://linen.dev logo
#ask-community-for-troubleshooting
Title
# ask-community-for-troubleshooting
p

Prashanth Patali

06/12/2021, 3:07 PM
I am trying the basic replication sample, but instead of Postgres, I have configured MS SQL Server as both Source and Destination. Source DB
airbytesrc
has a single table EMPLOYEES with column (ID, FN, LN, STATUS, MODIFIEDON) in dbo schema, all String type including MODIFIEDON. ID is the PRIMARY key. The destination database is
airbytedest
. I have specified 'airtbyte' as the 'Default' schema. Sync setting is "Full Refresh" append. Currently manual sync is being used and it succeeds to replicate the rows. However in destination, the data is in a table with name
_airbyte_raw_EMPLOYEES
with only three columns
_airbyte_ab_id, _airbyte_data, _airbyte_emitted_at
and the row data from source is in the column
_airbyte_data
in Json format. My question is - after sync, should't the data be in the destination DB with table airbyte.EMPLOYEES with all source column, instead of in the "raw" table in Json format? This is my first attempt to use Airbyte, so I might have misunderstood this.
1
n

Noel Gomez

06/12/2021, 4:47 PM
In your destination setup in airbyte do you see an option to flatten? Check that and enable it if it is off.
p

Prashanth Patali

06/13/2021, 5:49 AM
There no such option for MS SQL Server destination.
d

Davin Chia (Airbyte)

06/13/2021, 6:07 AM
Hi, this is still in the works. Please follow this for updates: https://github.com/airbytehq/airbyte/issues/3430
Because this isn't offered yet, the data is synced raw for now, which explains the json table you see
Is it possible to use a different db type in the mean time?
p

Prashanth Patali

06/13/2021, 6:29 AM
Thanks, Davin. I will follow the above issue. As I am just experimenting. I can switch to other db type.
👍 1