dasol kim
06/07/2022, 3:56 AMairbyte-worker | 2022-06-07 03:50:22 normalization > Processing destination_catalog.json...
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_columns_format (#44) to ny_p1_json_22_proper_s_view_columns_format (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_columns_cachedContents (#52) to ny_p1_json_22_proper_olumns_cachedContents (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_columns_cachedContents_top (#56) to ny_p1_json_22_proper_ns_cachedContents_top (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_attachments (#50) to ny_p1_json_22_proper__metadata_attachments (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_custom_fields (#52) to ny_p1_json_22_proper_etadata_custom_fields (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_custom_fields_Update (#59) to ny_p1_json_22_proper__custom_fields_Update (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_custom_fields_Data_Collection (#68) to ny_p1_json_22_proper_ields_Data_Collection (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_custom_fields_Dataset_Information (#72) to ny_p1_json_22_proper_s_Dataset_Information (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_renderTypeConfig (#55) to ny_p1_json_22_proper_data_renderTypeConfig (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_renderTypeConfig_visible (#63) to ny_p1_json_22_proper_derTypeConfig_visible (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_metadata_availableDisplayTypes (#60) to ny_p1_json_22_proper_availableDisplayTypes (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_approvals_submitter (#49) to ny_p1_json_22_proper_w_approvals_submitter (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_approvals_submissionDetails (#57) to ny_p1_json_22_proper_als_submissionDetails (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_approvals_submissionOutcomeApplication (#68) to ny_p1_json_22_proper_ionOutcomeApplication (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Truncating ny_p1_json_22_properties_view_tableAuthor_flags (#47) to ny_p1_json_22_proper_iew_tableAuthor_flags (#43)
airbyte-worker | 2022-06-07 03:50:22 normalization > Traceback (most recent call last):
airbyte-worker | 2022-06-07 03:50:22 normalization > File "/usr/local/bin/transform-catalog", line 8, in <module>
airbyte-worker | 2022-06-07 03:50:22 normalization > sys.exit(main())
airbyte-worker | 2022-06-07 03:50:22 normalization > File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/transform.py", line 82, in main
airbyte-worker | 2022-06-07 03:50:22 normalization > TransformCatalog().run(args)
airbyte-worker | 2022-06-07 03:50:22 normalization > File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/transform.py", line 35, in run
airbyte-worker | 2022-06-07 03:50:22 normalization > self.process_catalog()
airbyte-worker | 2022-06-07 03:50:22 normalization > File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/transform.py", line 62, in process_catalog
airbyte-worker | 2022-06-07 03:50:22 normalization > processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema)
airbyte-worker | 2022-06-07 03:50:22 normalization > File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/catalog_processor.py", line 63, in process
airbyte-worker | 2022-06-07 03:50:22 normalization > for conflict in tables_registry.resolve_names():
airbyte-worker | 2022-06-07 03:50:22 normalization > File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/table_name_registry.py", line 157, in resolve_names
airbyte-worker | 2022-06-07 03:50:22 normalization > conflicts = self.resolve_table_names()
airbyte-worker | 2022-06-07 03:50:22 normalization > File "/usr/local/lib/python3.8/site-packages/normalization/transform_catalog/table_name_registry.py", line 196, in resolve_table_names
airbyte-worker | 2022-06-07 03:50:22 normalization > assert (table_count * 2) == registry_size, f"Mismatched number of tables {table_count * 2} vs {registry_size} being resolved"
airbyte-worker | 2022-06-07 03:50:22 normalization > AssertionError: Mismatched number of tables 64 vs 62 being resolved
airbyte-worker | 2022-06-07 03:50:22 normalization >
airbyte-worker | 2022-06-07 03:50:22 normalization > Showing destination_catalog.json to diagnose/debug errors (1):
Why this issue continues to occur when discover_schema works well?
AssertionError: Mismatched number of tables 64 vs 62 being resolved
Marcos Marx (Airbyte)
06/07/2022, 12:23 PMdasol kim
06/07/2022, 1:09 PM