Hello all! I was SO CLOSE to not needing to ask f...
# replication-troubleshootingt
Tammy Shipps
10/13/2022, 10:04 PMHello all! I was SO CLOSE to not needing to ask for help…so very close. I actually did get the synced data over but I have a major issue with it not ending up in the same schema - I’m going into Postgres, so it’s using the schema setup shown here -> https://docs.airbyte.com/integrations/destinations/postgres#schema-map, which of course, doesn’t work on the other end if you need the original schema. I’m really hoping there’s an easy fix :)
✍️ 1
u
user
10/13/2022, 10:09 PM@[DEPRECATED] Marcos Marx turned this message into Zendesk ticket 2822 to ensure timely resolution!
t
Tammy Shipps
10/13/2022, 10:09 PMExtra information:
Tammy Shipps
10/13/2022, 10:10 PMThe end result is a database that runs a CMS - the sync is meant to pull data from mysql older versions of the site into a postgres new version
m
Marcos Marx (Airbyte)
10/13/2022, 10:10 PMToday is not possible to have equal schema even if you’re using postgres to postgres. Airbyte will first convrt your record to the AirbyteMessage protocol and send to the destination, in this process your data can change. This is needed to achieve N-to-N connections, where you can connect any source to any destination.
t
Tammy Shipps
10/13/2022, 10:11 PMIs there a way to map it?
Tammy Shipps
10/13/2022, 10:15 PMOr is there a script available that would “unwrap it” essentially?
m
Marcos Marx (Airbyte)
10/13/2022, 10:21 PMNo, there isn’t 😞
Marcos Marx (Airbyte)
10/13/2022, 10:21 PMYou can… probably using dbt after running airbyte to re-map all your columns you need, or download the Airbyte normalization dbt module and edit it
Marcos Marx (Airbyte)
10/13/2022, 10:22 PMBut you have a lot of tables it can quite complicate to scale
t
Tammy Shipps
10/13/2022, 10:27 PMWelp. That’s a dead end, then. Unfortunate.