Akshay Saini
02/17/2022, 10:51 PMJustin Reynolds
02/18/2022, 10:04 AMSailendra DS
02/18/2022, 10:13 AMArasdan
02/18/2022, 11:24 AMDejan Antonic
02/18/2022, 1:19 PMYour connection from Okta version 0.1.4 to BigQuery version 0.6.7 succeeded
This was for sync started on Friday, February 18, 2022 at 10308 PM Coordinated Universal Time, running for 8 minutes 29 seconds.
You can access its logs here: http://localhost:8000/connections/792cdbca-8f3f-446f-ac8c-bd4d94e5285d
David Hadaller
02/18/2022, 1:51 PMLennert Rienau
02/18/2022, 2:58 PMParquet
it seems not to support instanceprofile. Do I get it right that S3ParquetWriter is using SimpleAWSCredentialsProvider in any case?Gabriel Souza
02/18/2022, 3:26 PMERROR i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null
There any thing I could do?
OS Version/Instance: ec2.t2.large
Memory/Disk: 8Gb/ 50Gb
Deployment: Docker EC2
Source name/Version: Postgres version 0.4.7
Destination name/Version: Bigquery 0.6.8
Airbytes Version: 0.35.4-alphaGabriel Souza
02/18/2022, 7:30 PMManoj Yadav
02/18/2022, 7:58 PMDustin Wood
02/18/2022, 9:24 PMMathieu Austruy
02/18/2022, 10:33 PMMadhu Prabhakara
02/19/2022, 2:41 AMOAuth 2.0
optioniggy002
02/19/2022, 4:57 AMJOB_MAIN_CONTAINER_*
settings are not applied to jobs. This is a recently updated deployment, first time using resource limits settings with new variables. I can confirm its in env config map. I can confirm all of airbyte-server/airbyte-scheduler/airbyte-worker containers have this injected and available. Seems I am missing something maybe? Anyway to debug more?user
02/19/2022, 7:25 AMRoss Nordeen
02/19/2022, 7:16 PM~/airbyte$ sudo docker-compose up
WARN[0000] The "RUN_DATABASE_MIGRATION_ON_STARTUP" variable is not set. Defaulting to a blank string.
WARN[0000] The "SECRET_PERSISTENCE" variable is not set. Defaulting to a blank string.
WARN[0000] The "WORKER_ENVIRONMENT" variable is not set. Defaulting to a blank string.
WARN[0000] The "SECRET_PERSISTENCE" variable is not set. Defaulting to a blank string.
WARN[0000] The "WORKER_ENVIRONMENT" variable is not set. Defaulting to a blank string.
WARN[0000] The "SECRET_PERSISTENCE" variable is not set. Defaulting to a blank string.
WARN[0000] The "WORKER_ENVIRONMENT" variable is not set. Defaulting to a blank string.
[+] Running 0/8
⠙ db Pulling
⠙ server Pulling
⠙ airbyte-temporal Pulling
⠙ webapp Pulling
⠙ scheduler Pulling
⠙ init Pulling
⠙ worker Pulling
⠙ bootloader Pulling
error getting credentials - err: exit status 1, out: `Error calling StartServiceByName for org.freedesktop.secrets: Timeout was reached`
Can you please help me?Jason Ofua
02/19/2022, 8:37 PMJason Ofua
02/20/2022, 11:34 AMShreya Upadhyay
02/20/2022, 2:03 PM{
"status": "failed",
"reason": "io.airbyte.validation.json.JsonValidationException: json schema validation failed when comparing the data to the json schema. \nErrors: $.id: is missing but it is required, $.catalog: is missing but it is required, $.catalogHash: is missing but it is required \nSchema: \n{\n \"$schema\" : \"<http://json-schema.org/draft-07/schema#>\",\n \"$id\" : \"<https://github.com/airbytehq/airbyte/blob/master/airbyte-config/models/src/main/resources/types/AttemptFailureSummary.yaml>\",\n \"title\" : \"ActorCatalog\",\n \"description\" : \"Catalog of an actor.\",\n \"type\" : \"object\",\n \"additionalProperties\" : false,\n \"required\" : [ \"id\", \"catalog\", \"catalogHash\" ],\n \"properties\" : {\n \"id\" : {\n \"type\" : \"string\",\n \"format\" : \"uuid\"\n },\n \"catalog\" : {\n \"type\" : \"object\",\n \"existingJavaType\" : \"com.fasterxml.jackson.databind.JsonNode\"\n },\n \"catalogHash\" : {\n \"type\" : \"string\"\n }\n }\n}"
}
Kelvin Beh
02/20/2022, 3:41 PMSYNC_JOB_MAX_TIMEOUT_DAYS
while Airbyte is running?Luke Bussey
02/21/2022, 4:19 AMCollin Lenon
02/21/2022, 6:12 AMCould not connect with provided configuration. Error: Timed out after 30000 ms while waiting for a server that matches com.mongodb.client.internal.MongoClientDelegate$1@282308c3. Client view of cluster state is {type=REPLICA_SET, servers=[{address=172.31.23.101:27017, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSocketWriteException: Exception sending message}, caused by {javax.net.ssl.SSLHandshakeException: Remote host terminated the handshake}, caused by {java.io.EOFException: SSL peer shut down incorrectly}}, {address=172.31.23.102:27017, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSocketWriteException: Exception sending message}, caused by {javax.net.ssl.SSLHandshakeException: Remote host terminated the handshake}, caused by {java.io.EOFException: SSL peer shut down incorrectly}}, {address=172.31.23.103:27017, type=UNKNOWN, state=CONNECTING, exception={com.mongodb.MongoSocketWriteException: Exception sending message}, caused by {javax.net.ssl.SSLHandshakeException: Remote host terminated the handshake}, caused by {java.io.EOFException: SSL peer shut down incorrectly}}]
Muhammad Imtiaz
02/21/2022, 10:14 AMAnatole Callies
02/21/2022, 1:25 PMSai Sriram
02/21/2022, 1:32 PM# - name: airbyte
# version: "?.?.?"
# repository: "https://???-???.???.???.???/"
# condition: airbyte.enabled
Ofek Katriel
02/21/2022, 2:14 PMamountPaid
to amountPaid_airbyte_transform
. the new field is all NULL but there are values in the field. Please I need help to resolve this.
Thank you.David Effiong
02/21/2022, 3:00 PMconnection settings
?
Thanks for the support!
SELECT
campaign.id,
campaign.name,
metrics.clicks,
metrics.impressions,
metrics.conversions,
metrics.cost_micros,
metrics.ctr,
metrics.bounce_rate,
metrics.active_view_cpm,
metrics.active_view_ctr,
metrics.active_view_impressions,
metrics.interactions,
metrics.video_views
FROM campaign
André Luis Krasinski
02/21/2022, 3:08 PMOfek Katriel
02/21/2022, 4:29 PMtouch: CONTAINER_ALREADY_STARTED_PLACEHOLDER: Permission denied
...
ERROR Unable to create SQL database. {"error": "pq: database \"temporal\" already exists", "logging-call-at": "handler.go:97"}
I'm running docker-compose as the same user that the repository files are owned by, in one of /home subdirs.
Thanks in advance :)Krzysztof Sazon
02/21/2022, 4:48 PMInternal Server Error: Error creating S3 log client to Minio
and in the worker logs:
Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: Malformed escape pair at index 21: <http://minio-service>:%!d(<nil>)
or if I insert 9000:
Caused by: java.lang.IllegalArgumentException: java.net.URISyntaxException: Malformed escape pair at index 21: <http://minio-service>:%!d(float64=9000)
as you can see it is not parsing well the minio port, even when I insert:
9000
or
'9000'
or
"9000"
or nothing which is this error.
here’s my values.yaml file:
``````