Miles Poindexter
05/27/2021, 10:47 PMJins Kadwood
05/28/2021, 3:33 AMSteve
05/28/2021, 9:42 AMdocker compose up
To try and debug it I've started from scratch by removing all existing Airbyte docker images + the Airbyte container, the local repo and re-cloning but it's always the same issue.
The console output reports errors around:
airbyte-db | 2021-05-28 09:33:24.676 UTC [29] ERROR: database "temporal" already exists
airbyte-db | 2021-05-28 09:33:24.676 UTC [29] STATEMENT: CREATE DATABASE temporal
airbyte-temporal | 2021/05/28 09:33:24 error creating database:pq: database "temporal" already exists
airbyte-temporal | + temporal-sql-tool --plugin postgres --ep db -u docker -p 5432 --db temporal setup-schema -v 0.0
airbyte-temporal | 2021/05/28 09:33:24 Starting schema setup, config=&{SchemaFilePath: InitialVersion:0.0 Overwrite:false DisableVersioning:false}
airbyte-temporal | 2021/05/28 09:33:24 Setting up version tables
airbyte-db | 2021-05-28 09:33:24.709 UTC [30] ERROR: relation "schema_version" already exists
and
airbyte-server | 2021-05-28 09:33:28 ERROR i.a.s.v.VersionMismatchServer(getServer):68 - {workspace_app_root=/tmp/workspace/server/logs} - Version mismatch between 0.24.2-alpha and 0.14.1-alpha.
I don't understand how something can "exist" after I've deleted all the Docker components and the code repo?
Full output is attached here.
My environment:
macOS 11.0.1
Docker version 20.10.6, build 370c289
Does anyone have any ideas please?
ThanksPatric
05/28/2021, 12:54 PMSteve
05/28/2021, 1:54 PMERROR: Invalid interpolation format for "environment" option in service "scheduler": "AIRBYTE_ROLE=${AIRBYTE_ROLE:-}"
Environment:
Ubuntu 18.0.4
Docker version 20.10.6, build 370c289
It's not critical as Airbyte is running fine locally for me to investigate with, but if it's an easy fix it would be great to have it running remotely too.
Thanks.Nathan Atkins
05/28/2021, 5:19 PMNathan Atkins
05/28/2021, 5:20 PMDaniel Getejanc
05/28/2021, 9:38 PMP.VAD
05/29/2021, 6:51 AMMunirah
05/29/2021, 10:51 PMJohn Smith
05/30/2021, 8:18 PMBaatch
05/31/2021, 5:57 AMVika Petrenko
05/31/2021, 9:38 PMMatt Hardner
06/02/2021, 5:42 PMgcloud beta compute ssh --zone "us-central1-a" --tunnel-through-iap "instance-1" --project "curantisapp-staging-shared" -- -L 8000:localhost:8000 -L 8001:localhost:8001 -N -f
but am getting the following ERROR: (gcloud.beta.compute.ssh) Could not fetch resource: - Request had insufficient authentication scopes.
Charter Smith
06/03/2021, 2:10 AMtest
06/03/2021, 5:05 AMMohammad Shahvez
06/03/2021, 7:10 AMMohammad Shahvez
06/03/2021, 10:01 AMAnastasia
06/03/2021, 10:25 AMSlackbot
06/03/2021, 1:54 PMVika Petrenko
06/03/2021, 8:29 PMget_updated_state
returned state doesn’t do anything until is using in update params in url? or it skips updating items that are under the latest state?Chirag Kakani
06/04/2021, 9:16 AMVika Petrenko
06/06/2021, 11:40 PMread_records
if source API does not support query params to get incremental new or modified data and use like an incremental stream?
def read_records(...) -> Iterable[Mapping[str, Any]]:
filtered = []
items = super().read_records(sync_mode=sync_mode, cursor_field=cursor_field, stream_slice=stream_slice, stream_state=stream_state)
for item in items:
if self._field_to_datetime(item[self.cursor_field]) > self._field_to_datetime(stream_state[self.cursor_field]):
filtered.append(item)
yield from filtered
Vika Petrenko
06/06/2021, 11:45 PMVika Petrenko
06/07/2021, 12:24 AMgunu
06/07/2021, 8:55 AMdatabase
name.
Current use-case: RDS (mysql) --> snowflakegunu
06/07/2021, 9:00 AMHawkar Mahmod
06/07/2021, 1:21 PMLy Pham
06/07/2021, 1:51 PMmodule airflow.providers
is not found. But the directories do exists. How can i fix this?Ly Pham
06/07/2021, 1:52 PM