https://linen.dev logo
#ask-community-for-troubleshooting
Title
# ask-community-for-troubleshooting
d

dasol kim

06/07/2022, 3:56 AM
Hi, I faced same issue when I sync connection (source: json file, destination: postgres) with noramlization.
Copy code
airbyte-worker      | 2022-06-07 03:50:22 normalization > Processing destination_catalog.json...
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_columns_format (#44) to ny_p1_json_22_proper_s_view_columns_format (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_columns_cachedContents (#52) to ny_p1_json_22_proper_olumns_cachedContents (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_columns_cachedContents_top (#56) to ny_p1_json_22_proper_ns_cachedContents_top (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_attachments (#50) to ny_p1_json_22_proper__metadata_attachments (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_custom_fields (#52) to ny_p1_json_22_proper_etadata_custom_fields (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_custom_fields_Update (#59) to ny_p1_json_22_proper__custom_fields_Update (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_custom_fields_Data_Collection (#68) to ny_p1_json_22_proper_ields_Data_Collection (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_custom_fields_Dataset_Information (#72) to ny_p1_json_22_proper_s_Dataset_Information (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_renderTypeConfig (#55) to ny_p1_json_22_proper_data_renderTypeConfig (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_renderTypeConfig_visible (#63) to ny_p1_json_22_proper_derTypeConfig_visible (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_availableDisplayTypes (#60) to ny_p1_json_22_proper_availableDisplayTypes (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_approvals_submitter (#49) to ny_p1_json_22_proper_w_approvals_submitter (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_approvals_submissionDetails (#57) to ny_p1_json_22_proper_als_submissionDetails (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_approvals_submissionOutcomeApplication (#68) to ny_p1_json_22_proper_ionOutcomeApplication (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_tableAuthor_flags (#47) to ny_p1_json_22_proper_iew_tableAuthor_flags (#43)
airbyte-worker      | 2022-06-07 03:50:22 normalization > Traceback (most recent call last):
airbyte-worker      | 2022-06-07 03:50:22 normalization >   File "/usr/local/bin/transform-catalog", line 8, in <module>
airbyte-worker      | 2022-06-07 03:50:22 normalization >     sys.exit(main())
airbyte-worker      | 2022-06-07 03:50:22 normalization >   File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/transform.py", line 82, in main
airbyte-worker      | 2022-06-07 03:50:22 normalization >     TransformCatalog().run(args)
airbyte-worker      | 2022-06-07 03:50:22 normalization >   File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/transform.py", line 35, in run
airbyte-worker      | 2022-06-07 03:50:22 normalization >     self.process_catalog()
airbyte-worker      | 2022-06-07 03:50:22 normalization >   File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/transform.py", line 62, in process_catalog
airbyte-worker      | 2022-06-07 03:50:22 normalization >     processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema)
airbyte-worker      | 2022-06-07 03:50:22 normalization >   File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/catalog_processor.py", line 63, in process
airbyte-worker      | 2022-06-07 03:50:22 normalization >     for conflict in tables_registry.resolve_names():
airbyte-worker      | 2022-06-07 03:50:22 normalization >   File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/table_name_registry.py", line 157, in resolve_names
airbyte-worker      | 2022-06-07 03:50:22 normalization >     conflicts = self.resolve_table_names()
airbyte-worker      | 2022-06-07 03:50:22 normalization >   File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/table_name_registry.py", line 196, in resolve_table_names
airbyte-worker      | 2022-06-07 03:50:22 normalization >     assert (table_count * 2) == registry_size, f"Mismatched number of tables {table_count * 2} vs {registry_size} being resolved"
airbyte-worker      | 2022-06-07 03:50:22 normalization > AssertionError: Mismatched number of tables 64 vs 62 being resolved
airbyte-worker      | 2022-06-07 03:50:22 normalization >
airbyte-worker      | 2022-06-07 03:50:22 normalization > Showing destination_catalog.json to diagnose/debug errors (1):
Why this issue continues to occur when discover_schema works well?
Copy code
AssertionError: Mismatched number of tables 64 vs 62 being resolved
m

Marcos Marx (Airbyte)

06/07/2022, 12:23 PM
@dasol kim can you post in our forum? https://discuss.airbyte.io/ use template gave to you and post complete log file. I’m asking because probably this issue will involve deeper debate about normalization and need to understand better your connectors and setup
d

dasol kim

06/07/2022, 1:09 PM
5 Views