Henk van Dyk
08/02/2021, 11:10 AMSteve
08/02/2021, 2:12 PMStefano Pirrello
08/02/2021, 2:34 PMruntime column propagation
is in the works and the same for new tables?gunu
08/03/2021, 12:16 PMBao Ngo
08/03/2021, 3:13 PMNathan Atkins
08/03/2021, 9:42 PMrun --var '{"tenant": "xzy"}'
and the command line is getting generated as:
2021-08-03 21:39:07 INFO () LineGobbler(voidCall):85 - Running: dbt run -t prod --var {"tenant": "xyz"} --profiles-dir=/data/588/1/transform --project-dir=/data/588/1/transform/git_repo
Any help on the escaping in the syntax would be appreciated.konrad schlatte
08/04/2021, 1:43 PMAdhithya Ravichandran
08/04/2021, 6:48 PMmauro
08/05/2021, 10:01 AMApple Search Ads
Source? https://github.com/airbytehq/airbyte/issues/2982Wes T
08/05/2021, 3:13 PMPaschal Onuorah
08/05/2021, 6:19 PMNathan Atkins
08/05/2021, 10:35 PMNathan Atkins
08/05/2021, 10:52 PMOpeyemi Fabiyi
08/06/2021, 2:48 PMPaschal Onuorah
08/09/2021, 9:37 AMAllen FP
08/09/2021, 5:58 PMNathan Atkins
08/09/2021, 7:54 PM{
"_id": {
"$oid": "60a413694f65a9002bdc4ff3"
},
"__v": 0,
"activeStatus": {
"_id": {
"$oid": "60ad4c2262070d4a8410e537"
},
"statusId": 14,
"taskId": 8,
"createdOn": {
"$date": "2021-05-25T19:12:34.045Z"
},
}
Selecting the data from the raw table.
select
b._airbyte_data::json
from
postgres.load._airbyte_raw_b b
where
b._airbyte_data::json ->> '_id' = '60a413694f65a9002bdc4ff3'
{
"__v": 0,
"_id": "60a413694f65a9002bdc4ff3",
"activeStatus": "{\"statusId\"=>14, \"taskId\"=>8, \"createdOn\"=>2021-05-25 19:12:34.045 UTC}"
}
The problem I’m having is that the activeStatus column is a string not JSON and I don’t see how to easily parse it as the string is not formatted as JSON.
I was expecting to find something more like this.
{
"__v": 0,
"_id": "60a413694f65a9002bdc4ff3",
"activeStatus": "{\"statusId\":14, \"taskId\":8, \"createdOn\":\"2021-05-25 19:12:34.045 UTC\"}"
}
Were the activeStatus column was valid JSON and I could easily parse it with to_json() or that it would have been parsed with the ::json cast.Eli Rosenberg
08/09/2021, 8:12 PMkz
08/10/2021, 12:16 PMcloud-proxy
as it's own service perhaps?Kyle Cheung
08/11/2021, 4:33 AMAlderson
08/11/2021, 5:49 AMAlderson
08/11/2021, 6:04 AMmauro
08/11/2021, 9:04 AMJeff Crooks
08/11/2021, 1:02 PMOliver Meyer
08/11/2021, 2:40 PMJeff Crooks
08/11/2021, 2:43 PMNick Robitaille
08/12/2021, 12:23 AMAlderson
08/12/2021, 6:08 PMNathan Atkins
08/12/2021, 7:25 PM2021-08-12 18:04:49 INFO i.a.s.ServerApp(getServer):171 - {workspace_app_root=/workspace/server/logs} - Creating config repository...
2021-08-12 18:04:50 INFO i.a.c.p.ConfigPersistenceBuilder(getDbPersistenceWithFileSeed):93 - {workspace_app_root=/workspace/server/logs} - Creating db-based config persistence, and loading seed and existing data from files
2021-08-12 18:04:50 INFO i.a.c.p.FileSystemConfigPersistence(createWithValidation):62 - {workspace_app_root=/workspace/server/logs} - Constructing file system config persistence (root: /configs)
2021-08-12 18:04:50 INFO i.a.c.p.FileSystemConfigPersistence(createWithValidation):71 - {workspace_app_root=/workspace/server/logs} - Config volume is ready (waiting time: 0 s)
2021-08-12 18:04:50 INFO i.a.c.p.ConfigPersistenceBuilder(getDbPersistence):103 - {workspace_app_root=/workspace/server/logs} - Use database config persistence.
2021-08-12 18:04:50 INFO i.a.c.EnvConfigs(getEnvOrDefault):302 - {workspace_app_root=/workspace/server/logs} - CONFIG_DATABASE_USER not found or empty, defaulting to xxxxxxxx
2021-08-12 18:04:50 INFO i.a.c.EnvConfigs(getEnvOrDefault):302 - {workspace_app_root=/workspace/server/logs} - CONFIG_DATABASE_PASSWORD not found or empty, defaulting to xxxxxxxx
2021-08-12 18:04:50 INFO i.a.c.EnvConfigs(getEnvOrDefault):302 - {workspace_app_root=/workspace/server/logs} - CONFIG_DATABASE_URL not found or empty, defaulting to jdbc:<postgresql://xxxxx.xxxxxx.us-east-1.rds.amazonaws.com:5432/airbyte>
2021-08-12 18:04:50 WARN i.a.d.Databases(createPostgresDatabaseWithRetry):55 - {workspace_app_root=/workspace/server/logs} - Waiting for database to become available...
2021-08-12 18:04:50 INFO i.a.d.i.BaseDatabaseInstance(lambda$isDatabaseConnected$3):128 - {workspace_app_root=/workspace/server/logs} - Testing airbyte configs database connection...
2021-08-12 18:04:54 INFO i.a.d.Databases(createPostgresDatabaseWithRetry):60 - {workspace_app_root=/workspace/server/logs} - Database is not ready yet. Please wait a moment, it might still be initializing...
Emil
08/12/2021, 9:48 PM