Khristina Rustanovich
10/31/2021, 1:04 PMThien Pham
11/01/2021, 8:29 AMBlake Enyart
11/01/2021, 1:54 PMBlake Enyart
11/01/2021, 9:18 PMJacob Roe
11/02/2021, 12:06 AMKhristina Rustanovich
11/03/2021, 6:05 AM2021-11-02 08:53:11 INFO () DefaultAirbyteStreamFactory(internalLog):98 - Backing off _send(...) for 5.0s (requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')))
The sync is running. In Bigquery there are only temp tables. The last log record for a Shopify pipeline is 2021-11-02 20:17:09 INFO () DefaultAirbyteStreamFactory(internalLog):98 - Backing off _send(...) for 5.0s (requests.exceptions.ConnectionError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')))
In Bigquery there are only temp tables.
The third pipeline is running and logs are updated every minute. The source datasets is a million or 2 million of rows expected for historical sync.
The question is: what to do with pipelines with the errors above? Should I change settings and run again?Ismail
11/03/2021, 3:12 PMStephan Claus
11/05/2021, 8:36 AMlogin_customer_ID
which is our a) master account ID in google ads and customer id
which is b) a specific sub-account id for which we download the reports from. As we have a lot of these b) sub-accounts we are wondering if we can bulk load all sub accounts with one connection or do we need to set up a single connection for every sub-account? Thank you for your support, appreciate any guidance!Frank Mayo
11/05/2021, 4:37 PMgunu
11/07/2021, 10:22 PMreset
and full sync, which is painful for large connectors.
How do people get around this? What is the correct configuration, do people persist binary logs indefinitely.Tony Mao
11/08/2021, 4:48 AMPreetam Balijepalli
11/08/2021, 5:26 AMDeividas J
11/08/2021, 4:13 PMDawid Karczewski
11/08/2021, 5:02 PMPrateek Gupta
11/09/2021, 5:43 AMdasol kim
11/09/2021, 6:45 AMmodules-path: "../dbt_modeuls"
in dbt_project.yaml file, referring to https://github.com/airbytehq/airbyte/issues/5590.
dbt deps --profiles-dir=$NORMALIZE_DIR --project-dir=$NORMALIZE_DIR
Running with dbt=1.0.0-b2
* Deprecation Warning: The `data-paths` config has been deprecated in favor of `seed-paths`. Please update your
`dbt_project.yml` configuration to reflect this change.
Encountered an error while reading the project:
ERROR: Runtime Error
at path []: Additional properties are not allowed ('modules-path' was unexpected)
Error encountered in /home/dskim/airbyte/dbt_customizing/normalization-files/normalize/dbt_project.yml
Encountered an error:
Runtime Error
Could not run dbt
I don't know why this error occurs. please help.Andreas
11/09/2021, 8:52 AMAlam
11/09/2021, 11:36 AMSlackbot
11/09/2021, 8:02 PMSrivallabh
11/10/2021, 11:56 AMKyle Phillips
11/10/2021, 6:52 PMSrivallabh
11/11/2021, 11:35 AMAndrew Greenburg
11/11/2021, 3:45 PMMadhup Sukoon
11/12/2021, 6:19 AMLaza Nantenaina
11/12/2021, 1:48 PMIgnacio Aranguren Rojas
11/12/2021, 5:48 PMAdam Buie
11/12/2021, 10:50 PMSandeep Devarapalli
11/13/2021, 6:08 PMError airbyte --discover:
W, [2021-11-13T18:05:40.416512 #1] WARN -- : MONGODB | Error running ismaster on <http://test-cluster-1.khach.mongodb.net:27017|test-cluster-1.khach.mongodb.net:27017>: SocketError: getaddrinfo: Name does not resolve
Stefan Otte
11/15/2021, 9:22 AMdocker-compose up
on a VM, I'm leaning towards just using docker-compose
.
The biggest advantage of the k8s deployment is the scalability, which in our setup is most likely not needed.
So I'm wondering how stable the k8s beta deployment is?
When is the beta deployment
moving to stable
?Caio CΓ©sar P. Ricciuti
11/15/2021, 2:54 PM