Samad Husain
10/20/2022, 3:20 PMMurat Cetink
10/20/2022, 3:25 PMfailed to fetch schema
error after upgrading to v0.40.15. My source connector is Zuora 0.1.3Hemalatha Tahapa
10/20/2022, 3:30 PMFrancisco Viera
10/20/2022, 3:48 PMFrancisco Viera
10/20/2022, 3:48 PMBrandon
10/20/2022, 7:21 PMio.airbyte.config.FailureReason@ece7f36[failureOrigin=source,failureType=<null>,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@64f5e48d[additionalProperties={attemptNumber=0, jobId=28, connector_command=read}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1
java.sql.SQLException: The last transaction was aborted due to Seamless Scaling. Please retry.
i.a.w.g.DefaultReplicationWorker(run):184 - Sync worker failed.
Anyone familiar with this error, and have an idea of a resolution?Nicolas
10/20/2022, 7:54 PMRobert Put
10/20/2022, 8:37 PMLee Danilek
10/20/2022, 8:48 PM- [ ] Connector's `bootstrap.md`. See [description and examples](<https://docs.google.com/document/d/1ypdgmwmEHWv-TrO4_YOQ7pAJGVrMp5BOkEVh831N260/edit?usp=sharing>)
that linked google doc has been deleted, and I don't see anything about bootstrap.md in the docs https://docs.airbyte.com/connector-development/ . I can probably pattern match on examples in the codebase, but it would be nice to know what this is for.Francisco Viera
10/20/2022, 10:19 PMZaza Javakhishvili
10/21/2022, 12:19 AMRaghu Bharadwaj
10/21/2022, 5:24 AMFailed
Last attempt:
8.56 MB | 29,303 emitted records | no records | 7m 4s | Sync
Failure Origin: source, Message: Something went wrong in the connector. See the logs for more details.
2022-10-20 19:51:37 - Additional Failure Information: java.lang.RuntimeException: java.lang.RuntimeException: org.apache.kafka.connect.errors.ConnectException: An exception occurred in the change event producer. This connector will be stopped.
Joe.J.Xu
10/21/2022, 7:44 AMFabrice Simon
10/21/2022, 8:20 AMSebastian Brickel
10/21/2022, 8:21 AMpaginator:
type: NoPagination
in my connector definition, I will only retrieve data from the first page of the service.
What are the options for retrieving all pages of the service?
I checked https://docs.airbyte.com/connector-development/config-based/understanding-the-yaml-file/pagination/ but none of the options there are supported by the APIRahul Borse
10/21/2022, 8:43 AMAdrian Castro
10/21/2022, 8:52 AMRahul Borse
10/21/2022, 9:34 AMAngel
10/21/2022, 11:23 AMChristopher Teljstedt
10/21/2022, 11:59 AMHarel Oshri
10/21/2022, 12:07 PMAlexander Pospiech
10/21/2022, 12:48 PMdocker-compose down
and docker-compose up -d
, where the following errors seem to disappear, but still nothing works.
The docker images come up nicely.
$ docker-compose ps
Name Command State Ports
--------------------------------------------------------------------------------------------------------------------------------------------
airbyte-bootloader /bin/bash -c ${APPLICATION ... Up
airbyte-cron /bin/bash -c ${APPLICATION ... Up
airbyte-db docker-entrypoint.sh postgres Up 5432/tcp
airbyte-proxy ./run.sh ./run.sh Up 80/tcp, 0.0.0.0:8000->8000/tcp,:::8000->8000/tcp,
0.0.0.0:8001->8001/tcp,:::8001->8001/tcp
airbyte-server /bin/bash -c ${APPLICATION ... Up 8000/tcp, 0.0.0.0:49316->8001/tcp,:::49316->8001/tcp
airbyte-temporal ./update-and-start-temporal.sh Up 6933/tcp, 6934/tcp, 6935/tcp, 6939/tcp, 7233/tcp, 7234/tcp, 7235/tcp,
7239/tcp
airbyte-webapp /docker-entrypoint.sh ngin ... Up 0.0.0.0:49317->80/tcp,:::49317->80/tcp
airbyte-worker /bin/bash -c ${APPLICATION ... Up 0.0.0.0:49668->9000/tcp,:::49668->9000/tcp
init /bin/sh -c ./scripts/creat ... Exit 0
There are PSQLExceptions in airbyte-worker and airbyte-cron.
$ docker logs airbyte-worker
2022-10-21 11:09:56,409 main INFO Loading mask data from '/seed/specs_secrets_mask.yaml
___ _ __ __
/ | (_)____/ /_ __ __/ /____
/ /| | / / ___/ __ \/ / / / __/ _ \
/ ___ |/ / / / /_/ / /_/ / /_/ __/
/_/ |_/_/_/ /_.___/\__, /\__/\___/
/____/
: airbyte-workers :
Micronaut (v3.7.2)
2022-10-21 11:09:58 ESC[32mINFOESC[m i.m.c.e.DefaultEnvironment(<init>):159 - Established active environments: [ec2, cloud, control-plane]
2022-10-21 11:09:58 ESC[32mINFOESC[m c.z.h.HikariDataSource(<init>):71 - HikariPool-1 - Starting...
2022-10-21 11:10:09 ESC[1;31mERRORESC[m c.z.h.p.HikariPool(throwPoolInitializationException):526 - HikariPool-1 - Exception during pool initialization.
org.postgresql.util.PSQLException: The connection attempt failed.
at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:331) ~[postgresql-42.5.0.jar:42.5.0]
...
Caused by: java.net.SocketTimeoutException: Connect timed out
....
airbyte-server just shows this message at the end of the log:
$ docker logs airbyte-server
2022-10-21 11:09:57 ESC[33mWARNESC[m i.a.d.c.DatabaseAvailabilityCheck(check):38 - Waiting for database to become available...
2022-10-21 11:09:57 ESC[32mINFOESC[m i.a.d.c.DatabaseAvailabilityCheck(lambda$isDatabaseConnected$1):75 - Testing airbyte configs database connection...
airbyte-db does not show any errors
airbyte-proxy shows some timeouts:
1 upstream timed out (110: Connection timed out) while connecting to upstream
airbyte-temporal
$ docker logs airbyte-temporal
Start init
Done init
Waiting for PostgreSQL to startup.
The database in airbyte-db looks empty 🤔
$ psql -h localhost -p 5432 -d airbyte -U docker
Password for user docker:
psql (14.5 (Ubuntu 14.5-0ubuntu0.22.04.1), server 13.8)
Type "help" for help.
airbyte=# \d
Did not find any relations.
Hiep Minh Pham
10/21/2022, 1:08 PM{'name': 'page_query', 'dimensions': ['page', 'query']}
but I get an errors when I try to setup a connection. Please note that it works fine without the custom report. Do you have any ideas? Appreciate your help!Francisco Viera
10/21/2022, 2:07 PMBlake Hughes
10/21/2022, 2:41 PMmy_airbyte_resource = airbyte_resource.configured(
{
"host": "localhost",
"port": "8000",
}
)
sync_foobar = airbyte_sync_op.configured({"connection_id": "8bb7ae88-350d-40f4-947c-dfbe682311af"}, name="sync_foobar")
Kevin Phan
10/21/2022, 3:16 PM0.40.0-alpha
Guy Feldman
10/21/2022, 4:35 PMCannot invoke "io.airbyte.config.JobSyncConfig.getSourceDockerImage()" because "jobSyncConfig" is null
has anyone run into this?Slackbot
10/21/2022, 6:35 PMYoan Yahemdi
10/21/2022, 7:23 PMKevin Phan
10/21/2022, 7:45 PMInvalid json input. Unrecognized field "workspaceId" (class io.airbyte.api.model.generated.SourceCoreConfig), not marked as ignorable (2 known properties: "connectionConfiguration", "sourceDefinitionId"]) at [Source: (org.glassfish.jersey.message.internal.ReaderInterceptorExecutor$UnCloseableInputStream); line: 1, column: 257] (through reference chain: io.airbyte.api.model.generated.SourceCoreConfig["workspaceId"]) Unrecognized field "workspaceId" (class io.airbyte.api.model.generated.SourceCoreConfig), not marked as ignorable
i also updated my airbyte version to 0.40.15
. what is the latest stable version i can use? I saw threads that mention this is a backend issue