Jason Wiener
04/28/2022, 6:15 PM2022-04-28 16:53:25 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/145/0/logs.log
2022-04-28 16:53:25 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.35.42-alpha
2022-04-28 16:53:25 INFO i.a.w.DefaultNormalizationWorker(run):46 - Running normalization.
2022-04-28 16:53:25 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.1.69
2022-04-28 16:53:25 INFO i.a.w.p.KubeProcessFactory(create):111 - Attempting to start pod = normalization-sync-145-0-mkkvy
2022-04-28 16:53:25 INFO i.a.w.p.KubeProcessFactory(create):114 - normalization-sync-145-0-mkkvy stdoutLocalPort = 9016
2022-04-28 16:53:25 INFO i.a.w.p.KubeProcessFactory(create):117 - normalization-sync-145-0-mkkvy stderrLocalPort = 9017
2022-04-28 16:53:25 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):550 - Creating stdout socket server...
2022-04-28 16:53:25 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):568 - Creating stderr socket server...
2022-04-28 16:53:25 INFO i.a.w.p.KubePodProcess(<init>):507 - Creating pod...
2022-04-28 16:53:25 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):307 - Waiting for init container to be ready before copying files...
2022-04-28 16:53:25 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):320 - Init container present..
2022-04-28 16:53:26 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):323 - Init container ready..
2022-04-28 16:53:26 INFO i.a.w.p.KubePodProcess(<init>):513 - Copying files...
2022-04-28 16:53:26 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: destination_config.json
2022-04-28 16:53:26 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/f6f49d48-e353-44c6-a6b0-035ea96affe6/destination_config.json airbyte-2/normalization-sync-145-0-mkkvy:/config/destination_config.json -c init
2022-04-28 16:53:26 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: destination_catalog.json
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/3d2f578e-42f5-4ea7-aace-8afd7d09f24a/destination_catalog.json airbyte-2/normalization-sync-145-0-mkkvy:/config/destination_catalog.json -c init
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: FINISHED_UPLOADING
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/0bc14080-2fa2-456d-87ed-a6dc9cc42f69/FINISHED_UPLOADING airbyte-2/normalization-sync-145-0-mkkvy:/config/FINISHED_UPLOADING -c init
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process
2022-04-28 16:53:27 INFO i.a.w.p.KubePodProcess(<init>):516 - Waiting until pod is ready...
2022-04-28 16:53:47 normalization > Running: transform-config --config destination_config.json --integration-type redshift --out /config
2022-04-28 16:53:47 normalization > Namespace(config='destination_config.json', integration_type=<DestinationType.redshift: 'redshift'>, out='/config')
2022-04-28 16:53:47 normalization > transform_redshift
2022-04-28 16:53:47 normalization > Running: transform-catalog --integration-type redshift --profile-config-dir /config --catalog destination_catalog.json --out /config/models/generated/ --json-column _airbyte_data
2022-04-28 16:53:47 normalization > Processing destination_catalog.json...
2022-04-28 16:53:47 normalization > Generating airbyte_ctes/quarantine/covid_epidemiology_ab1.sql from covid_epidemiology
2022-04-28 16:53:47 normalization > Generating airbyte_ctes/quarantine/covid_epidemiology_ab2.sql from covid_epidemiology
2022-04-28 16:53:47 normalization > Generating airbyte_ctes/quarantine/covid_epidemiology_ab3.sql from covid_epidemiology
2022-04-28 16:53:47 normalization > Generating airbyte_incremental/quarantine/covid_epidemiology.sql from covid_epidemiology
2022-04-28 16:53:47 normalization > detected no config file for ssh, assuming ssh is off.
2022-04-28 16:53:48 normalization > Running with dbt=0.21.1
2022-04-28 16:53:48 normalization > Unable to do partial parsing because ../build/partial_parse.msgpack not found
2022-04-28 16:53:49 normalization > WARNING: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
2022-04-28 16:53:49 normalization > There are 2 unused configuration paths:
2022-04-28 16:53:49 normalization > - models.airbyte_utils.generated.airbyte_views
2022-04-28 16:53:49 normalization > - models.airbyte_utils.generated.airbyte_tables
2022-04-28 16:53:49 normalization >
2022-04-28 16:53:49 normalization > Found 4 models, 0 tests, 0 snapshots, 0 analyses, 520 macros, 0 operations, 0 seed files, 1 source, 0 exposures
2022-04-28 16:53:49 normalization >
2022-04-28 16:53:49 normalization > 16:53:49 | Concurrency: 4 threads (target='prod')
2022-04-28 16:53:49 normalization > 16:53:49 |
2022-04-28 16:53:50 normalization > 16:53:50 | 1 of 1 START incremental model quarantine.covid_epidemiology................................................. [RUN]
2022-04-28 16:53:50 normalization > 16:53:50 + "airbyte_incoming".quarantine."covid_epidemiology"._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-04-28 16:53:45 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):559 - Setting stdout...
2022-04-28 16:53:46 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):571 - Setting stderr...
2022-04-28 16:53:47 INFO i.a.w.p.KubePodProcess(<init>):531 - Reading pod IP...
2022-04-28 16:53:47 INFO i.a.w.p.KubePodProcess(<init>):533 - Pod IP: 192.168.56.129
2022-04-28 16:53:47 INFO i.a.w.p.KubePodProcess(<init>):540 - Using null stdin output stream...
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(getReturnCode):733 - Exit code for pod normalization-sync-145-0-mkkvy is 0
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(exitValue):748 - Closed all resources for pod normalization-sync-145-0-mkkvy
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(exitValue):748 - Closed all resources for pod normalization-sync-145-0-mkkvy
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(exitValue):748 - Closed all resources for pod normalization-sync-145-0-mkkvy
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(exitValue):748 - Closed all resources for pod normalization-sync-145-0-mkkvy
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(exitValue):748 - Closed all resources for pod normalization-sync-145-0-mkkvy
2022-04-28 16:54:02 INFO i.a.w.p.KubePodProcess(exitValue):748 - Closed all resources for pod normalization-sync-145-0-mkkvy
2022-04-28 16:54:02 INFO i.a.w.DefaultNormalizationWorker(run):69 - Normalization executed in 37 seconds.
2022-04-28 16:54:02 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling...
2022-04-28 16:54:02 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating...
2022-04-28 16:54:01 normalization > 16:54:01 | 1 of 1 OK created incremental model quarantine.covid_epidemiology............................................ [SELECT in 11.18s]
2022-04-28 16:54:01 normalization > 16:54:01 |
2022-04-28 16:54:01 normalization > 16:54:01 | Finished running 1 incremental model in 11.73s.
2022-04-28 16:54:01 normalization >
2022-04-28 16:54:01 normalization > Completed successfully
2022-04-28 16:54:01 normalization >
2022-04-28 16:54:01 normalization > Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1
Marcos Marx (Airbyte)
04/29/2022, 12:04 AMJason Wiener
04/29/2022, 2:41 PM