I'm considering Airbyte for a DWH ETL setup (Mongo...
# ask-community-for-troubleshooting
f
I'm considering Airbyte for a DWH ETL setup (Mongo -> BigQuery). Due to legal requirements I have to obfuscate some user IDs before the data hits the DWH. What are my options with Airbyte to do this transformation in-flight?
1
u
@Florian Polster this is not possible to execute at the moment. There is an issue requesting this feature: https://github.com/airbytehq/airbyte/issues/1758
f
Well the user ID obfuscation I have to do is a custom implementation. So I would need the possibility to run some custom code on the data in-flight 😅
Thanks for taking the time to respond, much appreciated!