How to load data from Mongo DB to postgres in normalized form?

Hi, you should be able to select

Basic Normalization

when setting up the conneciton

Yes I did, But got error as below Caused by: io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:66) ~[io.airbyte-airbyte-workers-0.27.0-alpha.jar:?]

Can I get the whole log file please?

Sure

I didn’t manage to look at this. @[DEPRECATED] Marcos Marx super appreciate if you have time

Normalization module was not able to create the correct number of tables. Looks you're using the old mongo db source, is it possible to use the new one

airbyte/source-mongodb-v2

? Check the image I sent to you. If this is not displaying in your setting page you can add manually. The new connector has improvements over the old one.

2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 - Traceback (most recent call last):
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/bin/transform-catalog", line 8, in <module>
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -     sys.exit(main())
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/transform.py", line 102, in main
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -     TransformCatalog().run(args)
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/transform.py", line 55, in run
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -     self.process_catalog()
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/transform.py", line 82, in process_catalog
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -     processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema)
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/catalog_processor.py", line 82, in process
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -     for conflict in tables_registry.resolve_names():
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/table_name_registry.py", line 177, in resolve_names
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -     conflicts = self.resolve_table_names()
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/table_name_registry.py", line 212, in resolve_table_names
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 -     assert (table_count * 2) == registry_size, f"Mismatched number of tables {table_count} vs {registry_size} being resolved"
2021-09-17 05:09:43 ERROR () LineGobbler(voidCall):85 - AssertionError: Mismatched number of tables 10 vs 18 being resolved