Boggdan Barrientos
12/28/2021, 11:45 PMjsonb_set
,
I'm writing like, but nothing is updated.
UPDATE jobs SET config = jsonb_set(config, '{"sync":{"state"}}'::jsonb, '{"state": {"cdc": false, "streams": [{"cursor": "2021-10-29T00:00:00Z", "stream_name": "PROMOCIONESGENERADAS", "cursor_field": ["Fecha"], "stream_namespace": "CENTRALIZADOR"}]}}', false) WHERE id = 1611;
I think that I'm writting wrong the path, what the correct way to do it?
I think that is most a postgres question, but I hope find some guide here. Thanks.Raj
12/29/2021, 9:13 AMKashif Vikaas
12/30/2021, 12:44 AMJavier Llorente Mañas
12/30/2021, 4:09 PMGopinath Jaganmohan
01/03/2022, 1:13 AMJohan Wärlander
01/03/2022, 11:50 AMMukul Gopinath
01/04/2022, 9:11 AMOmri Cohen
01/05/2022, 6:09 PMtharaka prabath
01/06/2022, 4:34 AMSerhii Chvaliuk [GL]
01/06/2022, 1:38 PMuser@hrk1-ldl-A02942:~/airbyte$ SUB_BUILD=PLATFORM ./gradlew :airbyte-tests:automaticMigrationAcceptanceTest
> Task :airbyte-tests:automaticMigrationAcceptanceTest
MigrationAcceptanceTest > testAutomaticMigration() FAILED
java.lang.NullPointerException: Cannot invoke "java.lang.Boolean.booleanValue()" because the return value of "io.airbyte.api.client.model.HealthCheckRead.getAvailable()" is null
at io.airbyte.test.automaticMigrationAcceptance.MigrationAcceptanceTest.healthCheck(MigrationAcceptanceTest.java:327)
at io.airbyte.test.automaticMigrationAcceptance.MigrationAcceptanceTest.lambda$testAutomaticMigration$0(MigrationAcceptanceTest.java:87)
at io.airbyte.commons.concurrency.VoidCallable.call(VoidCallable.java:15)
at io.airbyte.test.automaticMigrationAcceptance.MigrationAcceptanceTest.runAirbyte(MigrationAcceptanceTest.java:138)
at io.airbyte.test.automaticMigrationAcceptance.MigrationAcceptanceTest.runAirbyte(MigrationAcceptanceTest.java:124)
at io.airbyte.test.automaticMigrationAcceptance.MigrationAcceptanceTest.testAutomaticMigration(MigrationAcceptanceTest.java:85)
1 test completed, 1 failed
Raj
01/06/2022, 7:17 PMSergi van den Berg
01/07/2022, 3:19 PMOmri Cohen
01/08/2022, 5:10 PMNaveen Sai Patnana
01/10/2022, 8:06 AMÁlvaro Queiroz
01/10/2022, 2:09 PMDarian
01/11/2022, 4:26 PMuser
01/12/2022, 12:15 PMAakash Kumar
01/12/2022, 12:25 PMdbt run --vars '{"prefix": ""}' --select Products Orders Customers
but upon executing the same in airbyte, it's removing single quotation mark, and hence it's failing.Mukul Gopinath
01/12/2022, 4:31 PMDavin Chia (Airbyte)
Thomas
01/13/2022, 7:43 AMRuslan
01/13/2022, 1:38 PMio.grpc.StatusRuntimeException: DEADLINE_EXCEEDED: deadline exceeded after 69.997454900s
after 100k rows read.
Any way to configure timeouts?Ariyo Kabir
01/13/2022, 4:31 PMJohan Wärlander
01/13/2022, 5:01 PMKhai Quang Nguyen
01/13/2022, 5:36 PM2022-01-13 04:07:36 source > 2022-01-13 04:07:36 ERROR i.d.r.TableSchemaBuilder(lambda$createValueGenerator$5):269 - Failed to properly convert data value for 'public.investment_listing.updated_at' of type timestamp for row [null, null, null, null, 213, null, null, null, null, null, null, null, null, null, null, 917bb142-db72-4ae4-8a5c-7398db43f527, null]:
2022-01-13 04:07:36 source > org.apache.kafka.connect.errors.DataException: Invalid value: null used for required field: "updated_at", schema type: STRING
this seems like an issue with postgres DELETE since WAL will just store the primary key for cases like this. A potential solution I have seen from a PR is to change the replication identity to FULL, but this has performance issues on very large table. Any workaround for this? I would imagine this should have been a very common use case.Serhii Chvaliuk [GL]
01/15/2022, 11:47 AMJarrod Parkes
01/17/2022, 10:11 PMJarrod Parkes
01/17/2022, 10:32 PMAirbyte is focused on the EL of ELT. If you need a really featureful tool for the transformations then, we suggest trying out dbt.https://docs.airbyte.com/understanding-airbyte/basic-normalization (looking into custom dbt transformations now)
Kabilan Ravi
01/18/2022, 1:32 PMRaj
01/18/2022, 5:24 PM