Parker Dillon
04/28/2022, 3:07 PMCould not connect with provided configuration. Error: Cannot create PoolableConnectionFactory (Communications link failure The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.)
Any general support would be appreciated, but here are some specific questions:
• Do I need to add an authorized network IP address to my Google Cloud SQL instance? Or use the Cloud SQL Auth proxy? This issue makes me thing the current MySQL connector does not support connecting to a Google Cloud SQL instance
• Do I need to use an SSH tunnel? This post makes me thing an SSH tunnel to a MySQL DB on Google Cloud SQL is not possibleMarco Brea
04/28/2022, 3:38 PMRichard Ighodaro
04/28/2022, 4:08 PMJason Wiener
04/28/2022, 6:15 PM2022-04-28 16:53:25 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/145/0/logs.log
2022-04-28 16:53:25 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.35.42-alpha
2022-04-28 16:53:25 INFO i.a.w.DefaultNormalizationWorker(run):46 - Running normalization.
2022-04-28 16:53:25 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.1.69
2022-04-28 16:53:25 INFO i.a.w.p.KubeProcessFactory(create):111 - Attempting to start pod = normalization-sync-145-0-mkkvy
2022-04-28 16:53:25 INFO i.a.w.p.KubeProcessFactory(create):114 - normalization-sync-145-0-mkkvy stdoutLocalPort = 9016
2022-04-28 16:53:25 INFO i.a.w.p.KubeProcessFactory(create):117 - normalization-sync-145-0-mkkvy stderrLocalPort = 9017
2022-04-28 16:53:25 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):550 - Creating stdout socket server...
2022-04-28 16:53:25 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):568 - Creating stderr socket server...
2022-04-28 16:53:25 INFO i.a.w.p.KubePodProcess(<init>):507 - Creating pod...
2022-04-28 16:53:25 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):307 - Waiting for init container to be ready before copying files...
2022-04-28 16:53:25 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):320 - Init container present..
2022-04-28 16:53:26 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):323 - Init container ready..
2022-04-28 16:53:26 INFO i.a.w.p.KubePodProcess(<init>):513 - Copying files...
2022-04-28 16:53:26 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: destination_config.json
2022-04-28 16:53:26 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/f6f49d48-e353-44c6-a6b0-035ea96affe6/destination_config.json airbyte-2/normalization-sync-145-0-mkkvy:/config/destination_config.json -c init
2022-04-28 16:53:26 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: destination_catalog.json
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/3d2f578e-42f5-4ea7-aace-8afd7d09f24a/destination_catalog.json airbyte-2/normalization-sync-145-0-mkkvy:/config/destination_catalog.json -c init
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: FINISHED_UPLOADING
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/0bc14080-2fa2-456d-87ed-a6dc9cc42f69/FINISHED_UPLOADING airbyte-2/normalization-sync-145-0-mkkvy:/config/FINISHED_UPLOADING -c init
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(<init>):516 - Waiting until pod is ready...
2022-04-28 16:53:47 normalization > Running: transform-config --config destination_config.json --integration-type redshift --out /config
2022-04-28 16:53:47 normalization > Namespace(config='destination_config.json', integration_type=<DestinationType.redshift: 'redshift'>, out='/config')
2022-04-28 16:53:47 normalization > transform_redshift
2022-04-28 16:53:47 normalization > Running: transform-catalog --integration-type redshift --profile-config-dir /config --catalog destination_catalog.json --out /config/models/generated/ --json-column _airbyte_data
2022-04-28 16:53:47 normalization > Processing destination_catalog.json...
2022-04-28 16:53:47 normalization > Generating airbyte_ctes/quarantine/covid_epidemiology_ab1.sql from covid_epidemiology
2022-04-28 16:53:47 normalization > Generating airbyte_ctes/quarantine/covid_epidemiology_ab2.sql from covid_epidemiology
2022-04-28 16:53:47 normalization > Generating airbyte_ctes/quarantine/covid_epidemiology_ab3.sql from covid_epidemiology
2022-04-28 16:53:47 normalization > Generating airbyte_incremental/quarantine/covid_epidemiology.sql from covid_epidemiology
2022-04-28 16:53:47 normalization > detected no config file for ssh, assuming ssh is off.
2022-04-28 16:53:48 normalization > Running with dbt=0.21.1
2022-04-28 16:53:48 normalization > Unable to do partial parsing because ../build/partial_parse.msgpack not found
2022-04-28 16:53:49 normalization > WARNING: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
2022-04-28 16:53:49 normalization > There are 2 unused configuration paths:
2022-04-28 16:53:49 normalization > - models.airbyte_utils.generated.airbyte_views
2022-04-28 16:53:49 normalization > - models.airbyte_utils.generated.airbyte_tables
2022-04-28 16:53:49 normalization >
2022-04-28 16:53:49 normalization > Found 4 models, 0 tests, 0 snapshots, 0 analyses, 520 macros, 0 operations, 0 seed files, 1 source, 0 exposures
2022-04-28 16:53:49 normalization >
2022-04-28 16:53:49 normalization > 16:53:49 | Concurrency: 4 threads (target='prod')
2022-04-28 16:53:49 normalization > 16:53:49 |
2022-04-28 16:53:50 normalization > 16:53:50 | 1 of 1 START incremental model quarantine.covid_epidemiology................................................. [RUN]
2022-04-28 16:53:50 normalization > 16:53:50 + "airbyte_incoming".quarantine."covid_epidemiology"._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-04-28 16:53:45 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):559 - Setting stdout...
2022-04-28 16:53:46 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):571 - Setting stderr...
2022-04-28 16:53:47 INFO i.a.w.p.KubePodProcess(<init>):531 - Reading pod IP...
2022-04-28 16:53:47 INFO i.a.w.p.KubePodProcess(<init>):533 - Pod IP: 192.168.56.129
2022-04-28 16:53:47 INFO i.a.w.p.KubePodProcess(<init>):540 - Using null stdin output stream...
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(getReturnCode):733 - Exit code for pod normalization-sync-145-0-mkkvy is 0
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(exitValue):748 - Closed all resources for pod normalization-sync-145-0-mkkvy
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(exitValue):748 - Closed all resources for pod normalization-sync-145-0-mkkvy
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(exitValue):748 - Closed all resources for pod normalization-sync-145-0-mkkvy
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(exitValue):748 - Closed all resources for pod normalization-sync-145-0-mkkvy
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(exitValue):748 - Closed all resources for pod normalization-sync-145-0-mkkvy
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(exitValue):748 - Closed all resources for pod normalization-sync-145-0-mkkvy
2022-04-28 16:54:02 INFO i.a.w.DefaultNormalizationWorker(run):69 - Normalization executed in 37 seconds.
2022-04-28 16:54:02 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling...
2022-04-28 16:54:02 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating...
2022-04-28 16:54:01 normalization > 16:54:01 | 1 of 1 OK created incremental model quarantine.covid_epidemiology............................................ [SELECT in 11.18s]
2022-04-28 16:54:01 normalization > 16:54:01 |
2022-04-28 16:54:01 normalization > 16:54:01 | Finished running 1 incremental model in 11.73s.
2022-04-28 16:54:01 normalization >
2022-04-28 16:54:01 normalization > Completed successfully
2022-04-28 16:54:01 normalization >
2022-04-28 16:54:01 normalization > Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1
Sushil Parti
04/28/2022, 10:54 PM2022-04-28 22:57:37 INFO i.a.s.ServerApp(assertDatabasesReady):132 - Checking configs database flyway migration version..
2022-04-28 22:57:37 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database...
2022-04-28 22:57:37 WARN i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):74 - Waiting for database to become available...
2022-04-28 22:57:37 INFO i.a.d.i.BaseDatabaseInstance(lambda$isDatabaseConnected$5):127 - Testing airbyte configs database connection...
2022-04-28 22:57:39 INFO i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):99 - Database available!
2022-04-28 22:57:39 INFO i.a.d.Databases(createPostgresDatabaseWithRetry):57 - Database available!
2022-04-28 22:57:39 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):65 - The airbyte configs database is not initialized; initializing it with schema
2022-04-28 22:57:45 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database...
2022-04-28 22:57:45 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):65 - The airbyte configs database is not initialized; initializing it with schema
2022-04-28 22:57:51 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database...
2022-04-28 22:57:51 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):65 - The airbyte configs database is not initialized; initializing it with schema
2022-04-28 22:57:57 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database...
2022-04-28 22:57:57 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):65 - The airbyte configs database is not initialized; initializing it with schema
2022-04-28 22:58:03 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database...
2022-04-28 22:58:03 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):65 - The airbyte configs database is not initialized; initializing it with schema
2022-04-28 22:58:09 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database...
2022-04-28 22:58:09 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):65 - The airbyte configs database is not initialized; initializing it with schema
2022-04-28 22:58:15 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database...
2022-04-28 22:58:15 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):65 - The airbyte configs database is not initialized; initializing it with schema
2022-04-28 22:58:21 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database...
2022-04-28 22:58:21 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):65 - The airbyte configs database is not initialized; initializing it with schema
2022-04-28 22:58:27 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database...
2022-04-28 22:58:27 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):65 - The airbyte configs database is not initialized; initializing it with schema
2022-04-28 22:58:33 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database...
2022-04-28 22:58:33 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$isInitialized$4):65 - The airbyte configs database is not initialized; initializing it with schema
2022-04-28 22:58:39 INFO i.a.d.i.MinimumFlywayMigrationVersionCheck(assertDatabase):42 - Waiting for database...
2022-04-28 22:58:39 ERROR i.a.s.ServerApp(main):249 - Server failed
java.lang.RuntimeException: Timeout while connecting to the database..
at io.airbyte.db.instance.MinimumFlywayMigrationVersionCheck.assertDatabase(MinimumFlywayMigrationVersionCheck.java:45) ~[io.airbyte.airbyte-db-lib-0.35.65-alpha.jar:?]
at io.airbyte.server.ServerApp.assertDatabasesReady(ServerApp.java:133) ~[io.airbyte-airbyte-server-0.35.65-alpha.jar:?]
at io.airbyte.server.ServerApp.getServer(ServerApp.java:160) ~[io.airbyte-airbyte-server-0.35.65-alpha.jar:?]
at io.airbyte.server.ServerApp.main(ServerApp.java:247) [io.airbyte-airbyte-server-0.35.65-alpha.jar:?]
Could anyone please advise what could be the issue or point me in the right direction? The database I have created is an Azure managed postgresql instance and has an empty database available. After some time,Shubhransh Bhargava
04/29/2022, 4:43 AMSrini Ranganathan
04/29/2022, 4:59 AMJoey Taleño
04/29/2022, 2:40 PMRaja
04/29/2022, 6:12 PMRaja
04/29/2022, 6:13 PMRaja
04/29/2022, 6:13 PMJoseph Sturtevant
04/29/2022, 11:19 PMKavin Rajagopal
04/30/2022, 8:08 AMAndres Sarnari
04/30/2022, 9:17 PMVibhu Rajeev
05/01/2022, 3:51 PMFailed to fetch schema. Please try again
I tried looking in the troubleshooting forum but could not find much. Thanks in advance!Hrvoje Piasevoli
05/01/2022, 9:30 PMJonathan Samaroo
05/02/2022, 12:47 AMJoey Taleño
05/02/2022, 10:06 AMMaxime Sabran
05/02/2022, 2:49 PMEduardo Centeno
05/02/2022, 4:35 PMStuart Middleton
05/02/2022, 5:22 PMBruno Azevedo
05/02/2022, 8:31 PMBruno Azevedo
05/02/2022, 8:31 PMMikhail Luzhetskiy
05/02/2022, 10:11 PMShubham Pinjwani
05/02/2022, 11:24 PMJoey Taleño
05/03/2022, 12:59 AMLenin Mishra
05/03/2022, 3:46 AMLenin Mishra
05/03/2022, 4:17 AMJoey Taleño
05/03/2022, 7:27 AMDavi
05/03/2022, 11:36 AM