P.VAD
06/07/2021, 3:57 PMMatt Hardner
06/07/2021, 9:33 PMTom Griffin
06/09/2021, 5:20 AMArun Kumar
06/09/2021, 11:22 AMflorent dubroqua
06/10/2021, 2:24 AMEthan Veres
06/10/2021, 2:35 AMNaN
2. the column names are written in title case (eg Job Type
) and it would be great if it could be cleaned as snake_case
3. column type mappings - seems like timestamps are kept as strings. Any control over that?Ly Pham
06/10/2021, 1:28 PMStewart Bryson
06/10/2021, 5:30 PMAmber Jain
06/10/2021, 9:30 PMIf you want to use different ports you will need to modifyWhat is the exact syntax to specify different port in API_URL inin yourAPI_URL
file and restart Airbyte..env
.env
file?Mané Rom
06/10/2021, 10:51 PMRahul Gupta
06/11/2021, 2:25 AMVika Petrenko
06/11/2021, 1:42 PMRupak Patel
06/12/2021, 1:57 AMPrashanth Patali
06/12/2021, 3:07 PMairbytesrc
has a single table EMPLOYEES with column (ID, FN, LN, STATUS, MODIFIEDON) in dbo schema, all String type including MODIFIEDON. ID is the PRIMARY key. The destination database is airbytedest
. I have specified 'airtbyte' as the 'Default' schema. Sync setting is "Full Refresh" append. Currently manual sync is being used and it succeeds to replicate the rows. However in destination, the data is in a table with name _airbyte_raw_EMPLOYEES
with only three columns _airbyte_ab_id, _airbyte_data, _airbyte_emitted_at
and the row data from source is in the column _airbyte_data
in Json format. My question is - after sync, should't the data be in the destination DB with table airbyte.EMPLOYEES with all source column, instead of in the "raw" table in Json format? This is my first attempt to use Airbyte, so I might have misunderstood this.gunu
06/14/2021, 5:27 AMSelect the data you want to sync
but i would like to add this other table so I click update schema to see the additional tables
To save the new schema, click on Save changes. Note that it will delete all the data in your destination and start syncing from scratch.I would like to add this other table without deleing all data in destination and sync from scratch. I appreciate that it thinks the overall schema is changing but its just adding another table Is the only way to do this, to create a duplicate source?
Fred Reimer
06/14/2021, 12:24 PMMané Rom
06/14/2021, 5:03 PMDamon Feldman
06/14/2021, 6:22 PMSurya
06/15/2021, 7:46 AMAldo Chiecchia
06/15/2021, 3:08 PMJoe Boutros
06/16/2021, 5:22 PMdocker compose
I can get the app up and running (though it usually hangs the first time and I have to cancel the docker compose and restart it).
The problem I’m running into is either a 500 error or a timeout when trying to configure a source. The endpoint in question is <http://localhost:8000/api/v1/source_definition_specifications/get>
.
I’ve tried docker compose down -v
to start from scratch, but the same issue reoccurs. (also side-note, the support link shown in the screenshot 404s)Mario
06/16/2021, 8:54 PMMario
06/17/2021, 12:12 AMMohammad Shahvez
06/17/2021, 5:13 AMJu Lee
06/17/2021, 10:51 PMNoel Gomez
06/18/2021, 9:35 PMGR
06/19/2021, 5:42 AMMrbirkov
06/21/2021, 4:44 AMgunu
06/21/2021, 8:24 AMNamespace Custom Format
vs dbt project +schema
) e.g.
Namespace Custom Format = "exchange_rates_api"
dbt_projects.yml
...
models:
airbyte_dbt_exchangeratesapi:
exchange_rates:
+materialized: table
+schema: exchange_rates_api
however, when running this sync. the output schema is airbyte_exchange_rates_api
my question is. where is the prefix airbyte
being created?konrad schlatte
06/21/2021, 2:28 PM