Dennis Hinnenkamp
04/05/2022, 2:12 PMSami RIAHI
04/05/2022, 3:48 PMYusuf Khan
04/05/2022, 6:14 PMERROR:
Can't find a suitable configuration file in this directory or any
parent. Are you in the right directory?
Supported filenames: docker-compose.yml, docker-compose.yaml, compose.yml, compose.yaml
my docker-compose version is:
docker-compose version 1.29.2, build 5becea4c
and I just cloned the airbyte repository now so should be the latest version on the main branch
Edit: And I have cd-ed into the airbyte local directory after cloningYusuf Khan
04/05/2022, 8:57 PMCould not connect with provided configuration. Error: Cannot create PoolableConnectionFactory (The TCP/IP connection to the host GAAZDSTDEV02D, port 1433 has failed. Error: "GAAZDSTDEV02D. Verify the connection properties. Make sure that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port. Make sure that TCP connections to the port are not blocked by a firewall.".)
Even though I can see the service is running and am able to connect through pymssql
https://stackoverflow.com/questions/71758242/connection-to-sql-server-from-airbyte-failing-cannot-create-poolableconnectionfParth Gangrade
04/06/2022, 12:06 PMYusuf Khan
04/06/2022, 4:09 PMSamuel Rodríguez
04/06/2022, 10:25 PMSamuel Rodríguez
04/06/2022, 10:26 PMAyoade Abel Adegbite
04/07/2022, 8:32 AMAndrei Batomunkuev
04/07/2022, 6:05 PMYusuf Khan
04/08/2022, 5:24 PMKevin Salmeron
04/08/2022, 8:53 PMRafael Auyer
04/08/2022, 10:28 PMBogdan Pirvu
04/09/2022, 4:02 PMjava.net.UnknownHostException
which I don’t understand (using MongoDB Compass I can connect to the same host), so I figured I’d give Airbyte Cloud a shot, since I assumed it’s better than the self-hosted version. However, with Airbyte Cloud I get exactly the same error.
Can somebody please help?
What’s also quite strange is that neither in the Airbyte Opern Source nor in the Airbyte Cloud interface there is a way to add my cluster’s CA certificate to the connection settings. Without that it’s not possible to verify the TLS connection to my MongoDB server, which has TLS enabled. However currently I’m not even getting that far due to the java.net.UnknownHostException
…
What I already worked in the past (few weeks ago) is to replicate data from MongoDB with TLS disabled on the server, however disabling TLS is of course a no-go…Gil Luz
04/10/2022, 12:29 PMRajiv Thatipalli
04/10/2022, 7:10 PMRajiv Thatipalli
04/10/2022, 7:10 PMArun Sivasankaran
04/10/2022, 8:07 PMArun Sivasankaran
04/10/2022, 8:09 PMpyarrow.lib.ArrowInvalid: CSV parse error: Expected 1 columns, got 9
when attempting to sync. I think its related to my config atleast. Here is an example file in s3...
{"userId":"615630dc81cd","sourceLanguage":"en","targetLanguage":"de","sourcePhrase":"a bit","sourceRoot":"bit","sourcePrefix":"a","targetPhrase":"ein Bisschen","incrementalViews":1,"eventName":"translationViewed"}
{"userId":"615630dc81cd","sourceLanguage":"en","targetLanguage":"de","sourcePhrase":"job","sourceRoot":"job","targetPhrase":"Arbeit","incrementalViews":1,"eventName":"translationViewed"}
{"userId":"615630dc81cd","sourceLanguage":"en","targetLanguage":"de","sourcePhrase":"information","sourceRoot":"information","targetPhrase":"Information","incrementalViews":1,"eventName":"translationViewed"}
{"userId":"615630dc81cd","sourceLanguage":"en","targetLanguage":"de","sourcePhrase":"example","sourceRoot":"example","targetPhrase":"Beispiel","incrementalViews":1,"eventName":"translationViewed"}
{"userId":"615630dc81cd","sourceLanguage":"en","targetLanguage":"de","sourcePhrase":"greatly","sourceRoot":"greatly","targetPhrase":"sehr","incrementalViews":1,"eventName":"translationViewed"}
{"userId":"615630dc81cd","sourceLanguage":"en","targetLanguage":"de","sourcePhrase":"example","sourceRoot":"example","targetPhrase":"Beispiel","incrementalViews":0,"eventName":"translationViewed"}
{"userId":"615630dc81cd","sourceLanguage":"en","targetLanguage":"de","sourcePhrase":"day","sourceRoot":"day","targetPhrase":"Tag","incrementalViews":1,"eventName":"translationViewed"}
{"userId":"615630dc81cd","sourceLanguage":"en","targetLanguage":"de","sourcePhrase":"functionality","sourceRoot":"functionality","targetPhrase":"Funktionalität","incrementalViews":1,"eventName":"translationViewed"}
Dimitriy Ni
04/11/2022, 1:05 PMLouis-Marius Gendreau
04/11/2022, 3:04 PMEgor Satiukov
04/11/2022, 3:43 PMDaniele Ferrero
04/11/2022, 3:44 PMAnton Nosovitsky
04/12/2022, 9:33 AMairbyte-server | 2022-04-12 09:31:28 INFO i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):99 - Database available!
airbyte-server | 2022-04-12 09:31:28 INFO i.a.d.Databases(createPostgresDatabaseWithRetry):57 - Database available!
airbyte-temporal | {"level":"info","ts":"2022-04-12T09:31:28.811Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/GET_SPEC/3","wf-task-queue-type":"Activity","lifecycle":"Starting","logging-call-at":"taskQueueManager.go:238"}
airbyte-temporal | {"level":"info","ts":"2022-04-12T09:31:28.811Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/GET_SPEC/3","wf-task-queue-type":"Activity","lifecycle":"Started","logging-call-at":"taskQueueManager.go:242"}
airbyte-temporal | {"level":"info","ts":"2022-04-12T09:31:28.826Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"1@07b096598acc:23029e80-aa07-4c6f-aa67-81fbefda049e","wf-task-queue-type":"Workflow","lifecycle":"Starting","logging-call-at":"taskQueueManager.go:238"}
airbyte-temporal | {"level":"info","ts":"2022-04-12T09:31:28.827Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"1@07b096598acc:23029e80-aa07-4c6f-aa67-81fbefda049e","wf-task-queue-type":"Workflow","lifecycle":"Started","logging-call-at":"taskQueueManager.go:242"}
airbyte-temporal | {"level":"info","ts":"2022-04-12T09:31:28.828Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/1@07b096598acc:23029e80-aa07-4c6f-aa67-81fbefda049e/2","wf-task-queue-type":"Workflow","lifecycle":"Starting","logging-call-at":"taskQueueManager.go:238"}
airbyte-temporal | {"level":"info","ts":"2022-04-12T09:31:28.829Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/1@07b096598acc:23029e80-aa07-4c6f-aa67-81fbefda049e/2","wf-task-queue-type":"Workflow","lifecycle":"Started","logging-call-at":"taskQueueManager.go:242"}
airbyte-temporal | {"level":"info","ts":"2022-04-12T09:31:28.837Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/1@07b096598acc:23029e80-aa07-4c6f-aa67-81fbefda049e/3","wf-task-queue-type":"Workflow","lifecycle":"Starting","logging-call-at":"taskQueueManager.go:238"}
airbyte-temporal | {"level":"info","ts":"2022-04-12T09:31:28.837Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/1@07b096598acc:23029e80-aa07-4c6f-aa67-81fbefda049e/3","wf-task-queue-type":"Workflow","lifecycle":"Started","logging-call-at":"taskQueueManager.go:242"}
airbyte-server | 2022-04-12 09:31:28 INFO i.a.c.EnvConfigs(getEnvOrDefault):834 - Using default value for environment variable CONFIGS_DATABASE_INITIALIZATION_TIMEOUT_MS: '60000'
airbyte-server | 2022-04-12 09:31:28 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Flyway Community Edition 7.14.0 by Redgate
airbyte-server | 2022-04-12 09:31:28 INFO o.f.c.i.l.s.Slf4jLog(info):49 - Database: jdbc:<postgresql://db:5432/airbyte> (PostgreSQL 13.6)
airbyte-server | 2022-04-12 09:31:29 ERROR i.a.s.ServerApp(main):249 - Server failed
airbyte-server | java.lang.NullPointerException: Cannot invoke "org.flywaydb.core.api.MigrationInfo.getVersion()" because the return value of "io.airbyte.db.instance.DatabaseMigrator.getLatestMigration()" is null
airbyte-server | at io.airbyte.db.instance.MinimumFlywayMigrationVersionCheck.assertMigrations(MinimumFlywayMigrationVersionCheck.java:75) ~[io.airbyte.airbyte-db-lib-0.35.65-alpha.jar:?]
airbyte-server | at io.airbyte.server.ServerApp.assertDatabasesReady(ServerApp.java:135) ~[io.airbyte-airbyte-server-0.35.65-alpha.jar:?]
airbyte-server | at io.airbyte.server.ServerApp.getServer(ServerApp.java:160) ~[io.airbyte-airbyte-server-0.35.65-alpha.jar:?]
airbyte-server | at io.airbyte.server.ServerApp.main(ServerApp.java:247) [io.airbyte-airbyte-server-0.35.65-alpha.jar:?]
airbyte-server exited with code 1
Alistair Wright
04/12/2022, 8:34 PMLarry Gormley
04/12/2022, 10:01 PMLarry Gormley
04/12/2022, 10:01 PMVarun Rayen
04/13/2022, 3:02 AMwriting 1 records in bulk operation
in elasticsearch the index is created, but no records have been insertedGil Luz
04/13/2022, 7:09 AMMalik Awais Khan
04/13/2022, 10:08 AM