Leandro Bleda Cantos
02/27/2023, 9:55 AMSearching for WAL resume position
No records were returned by Debezium in the timeout seconds 1200, closing the engine and iterator
• Some synch jobs are able to find the the resume position but then it takes more than 5 hours to just load 11K records.
HAve you seen this before? I have tried different configs but I never get an acceptable performanceUmar Hussain
02/27/2023, 11:13 AMSlackbot
02/27/2023, 12:05 PMJason Vondersmith
02/27/2023, 1:19 PMKustomer
connector, currently in Alpha. I see there was a singer/user-agent issue with it originally. But then I found this PR that seems like it would correct the implementation. Is there a way to know when that PR might get merged?Mark Nuttall-Smith
02/27/2023, 1:37 PMNAMEDATALEN
)
eg. in the example below - the _airbyte_raw_...__user_course_performance_scd
is truncated to ..._us___ourse_performance_scd
Layth Al-Ani
02/27/2023, 1:55 PMLucas Abreu
02/27/2023, 2:30 PMio.grpc.StatusRuntimeException: DEADLINE_EXCEEDED: Deadline CallOptions will be exceeded in 9.996874017s
Digging a bit, it seems to resources related, so I then edited all config in the .env
file related to scaling to 1, so to at least give it a shot, but I can't get access to the UI.
According to docker ps
all containers are up and running, what seems misleading to me. Any tips would be much appreciatedMaciej Matuszewski
02/27/2023, 3:00 PMRicha Rochna
02/27/2023, 3:43 PMRunning generator...
While trying to generate a connector, an error occurred on line 39 of generate.sh and the process aborted early. This is probably a bug.
Carolina Buckler
02/27/2023, 4:18 PMBradley Ming
02/27/2023, 4:28 PMOwais Javed
02/27/2023, 5:24 PMShailendra Jaiswar
02/27/2023, 5:33 PMAdam Bloom
02/27/2023, 6:22 PMKonstantin Lackner
02/27/2023, 6:44 PMKevin Han
02/27/2023, 7:57 PMBruno Carara Nandi
02/27/2023, 9:11 PMChen Lin
02/27/2023, 11:18 PM0.3.20
and without specifying the compression(as shown in the screenshot below) and I noticed that the output files are already compressed, is this expected? our airbyte is on version 0.39.36-alpha
god830
02/27/2023, 11:36 PMTiger Sun
02/28/2023, 2:28 AM0.43.29
) environment but whenever I try to create a source or destination, it fails. from the k8s pod logs, i can see
call-heartbeat-server Terminated
main Using existing AIRBYTE_ENTRYPOINT: /airbyte/base.sh
main Waiting on CHILD_PID 7
main PARENT_PID: 1
main EXIT_STATUS: 0
relay-stderr 2023/02/28 01:24:32 socat[8] N reading from and writing to stdio
relay-stderr 2023/02/28 01:24:32 socat[8] E TCP: wrong number of parameters (9 instead of 2)
relay-stderr 2023/02/28 01:24:32 socat[8] N exit(1)
init All files copied successfully, exiting with code 0...
relay-stdout 2023/02/28 01:24:32 socat[8] N reading from and writing to stdio
relay-stdout 2023/02/28 01:24:32 socat[8] E TCP: wrong number of parameters (9 instead of 2)
relay-stdout 2023/02/28 01:24:32 socat[8] N exit(1)
Stream closed EOF for airbyte2/n-local-json-check-57b98b6d-867d-4f38-878c-33b5cb1beabb-0-ymcce (main)
Stream closed EOF for airbyte2/n-local-json-check-57b98b6d-867d-4f38-878c-33b5cb1beabb-0-ymcce (init)
Stream closed EOF for airbyte2/n-local-json-check-57b98b6d-867d-4f38-878c-33b5cb1beabb-0-ymcce (relay-stderr)
Stream closed EOF for airbyte2/n-local-json-check-57b98b6d-867d-4f38-878c-33b5cb1beabb-0-ymcce (call-heartbeat-server)
Stream closed EOF for airbyte2/n-local-json-check-57b98b6d-867d-4f38-878c-33b5cb1beabb-0-ymcce (relay-stdout)
but can’t figure out what exactly is going on (for example, this is an attempt with local json) and a related log (attached) with null pointer exceptions. has any seen this before?James Salmon
02/28/2023, 2:30 AMBenen Cahill
02/28/2023, 6:28 AMThis version included a bug. Use 0.40.30 instead.Why is this the case? For those of us who had already migrated to
0.40.32
are we required to downgrade? I cannot find any further relevant documentation.Johannes Müller
02/28/2023, 7:18 AMAgrim Gupta
02/28/2023, 7:35 AMM. Farahmand
02/28/2023, 8:09 AMrequest_body_json()
method.ZouYong
02/28/2023, 8:26 AMsupportsNormalization
to return true in the acceptance test file. But this line in the DestinationAcceptanceTest.java always fails to assert.ZouYong
02/28/2023, 8:27 AM김건희
02/28/2023, 9:44 AMupdate_postgres_schema() {
{ export SQL_PASSWORD=${POSTGRES_PWD}; } 2> /dev/null
CONTAINER_ALREADY_STARTED="CONTAINER_ALREADY_STARTED_PLACEHOLDER"
if [ ! -e $CONTAINER_ALREADY_STARTED ]; then
touch $CONTAINER_ALREADY_STARTED
temporal-sql-tool --plugin postgres --ep "${POSTGRES_SEEDS}" -u "${POSTGRES_USER}" -p "${DB_PORT}" create --db "${DBNAME}"
temporal-sql-tool --plugin postgres --ep "${POSTGRES_SEEDS}" -u "${POSTGRES_USER}" -p "${DB_PORT}" --db "${DBNAME}" setup-schema -v 0.0
temporal-sql-tool --plugin postgres --ep "${POSTGRES_SEEDS}" -u "${POSTGRES_USER}" -p "${DB_PORT}" create --db "${VISIBILITY_DBNAME}"
temporal-sql-tool --plugin postgres --ep "${POSTGRES_SEEDS}" -u "${POSTGRES_USER}" -p "${DB_PORT}" --db "${VISIBILITY_DBNAME}" setup-schema -v 0.0
fi
echo "Starting to update the temporal DB"
temporal-sql-tool --plugin postgres --ep "${POSTGRES_SEEDS}" -u "${POSTGRES_USER}" -p "${DB_PORT}" --db "${DBNAME}" update-schema -d "${SCHEMA_DIR}"
echo "Update the temporal DB is done"
echo "Starting to update the temporal visibility DB"
temporal-sql-tool --plugin postgres --ep "${POSTGRES_SEEDS}" -u "${POSTGRES_USER}" -p "${DB_PORT}" --db "${VISIBILITY_DBNAME}" update-schema -d "${VISIBILITY_SCHEMA_DIR}"
echo "Update the temporal visibility DB is done"
}
the problem is, i'm using database name ${DBNAME} but when pods restart, pods try to make ${SCHEMA_DIR} (named temporal)
why this happen and if i want to use ${DBNAME} database after restart pods, how can i do that?Chandrasekharan Mohan
02/28/2023, 12:34 PMHiren Patel_C
02/28/2023, 12:42 PM