Hey all, I couldn’t figure out if Airbyte supporte...
# ask-community-for-troubleshooting
a
Hey all, I couldn’t figure out if Airbyte supported this use case, so wanted to check here. I want to sync multiple sources of the same type to the same destination table, along with some custom columns for which source it came from. For example, I’d want to connect to 10 different salesforces, and have all of them go to the same postgres tables (instead of having 10 sets of tables) — but this of course means I’d need additional columns for each table specifying which salesforce instance it came from. Is this possible?
1
s
not directly today. Partially because this is a really tricky flow to scale out (if one connection sends malformed data, how can Airbyte reset it to a clean state?). I would recommend landing these in 10 diff tables then buildling a view on top of it if possible, though can certainly see how that’s not ideal if you’re dealing with a dynamic/increasing number of instances. WDYT?
a
Yea, we would be dealing with a dynamic number of instances, so probably can’t use airbyte today — thanks!
u
@Ashwin Sreenivas other idea is pulling data using Airbyte and use dbt to union the datasets.