Hello. All our airbyte connections are running too...
# replication-troubleshooting
s
Hello. All our airbyte connections are running too long. sometime more than two hours and normalisation step seems to be the issue. Query like below are running for each column up to 5-10 seconds. any suggestions on how to improve this.
Copy code
/* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.account_ab1"} */
select data_type from SVV_COLUMNS where table_name = '_airbyte_raw_account' and column_name = '_airbyte_data' and table_schema = 'staging';
e
Hi. when it comes to dbt it depends on the sql logic that is applied - if the query can run with only 1 node i.e. 1 thread at any given time there isnt much you can do about it by default. the best thing to do in this cases is to create your own normalization dbt model that will be able to use more than 1 thread and this will result in lower times
thanku 1