hi airbyte heros, hope you're doing well. on a mo...
# feedback-and-requests
m
hi airbyte heros, hope you're doing well. on a mongodb -> redshift sync, got frustrated when an end user updated schemas, and the normalizations would fail. Finally figured out that if you're checking all the collections on the mongodb source, and one or more of them are empty (& therefore not have columns), you'll end up failing normalization when it should probably just skip empty tables.
Copy code
2022-03-22 21:44:47 [42mnormalization[0m >   File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/table_name_registry.py", line 196, in resolve_table_names
2022-03-22 21:44:47 [42mnormalization[0m >     assert (table_count * 2) == registry_size, f"Mismatched number of tables {table_count * 2} vs {registry_size} being resolved"
Just thought you might like to know in case other folks run into that issue.
m
@Mike Karp do you mind creating a Github issue to the team investigate and solve this?
m
sure