Joey Benamy
04/25/2024, 8:36 PM'AttributeError("\'NoneType\' object has no attribute \'get\'")'
on version 1.7.1Jessica Bauer
04/25/2024, 11:36 PMCheckAvailabilityError: Error opening file. Please check the credentials provided in the config and verify that they provide permission to read files. Contact Support if you need assistance.
Slackbot
04/26/2024, 4:54 AMRamkumar Vaidyanathan
04/26/2024, 4:56 AMPriyam Gupta
04/26/2024, 6:08 AMCaused by: java.lang.RuntimeException: java.net.UnknownHostException: airbyte-temporal
at io.grpc.internal.DnsNameResolver.resolveAddresses(DnsNameResolver.java:223) ~[grpc-core-1.61.0.jar:1.61.0]
at io.grpc.internal.DnsNameResolver.doResolve(DnsNameResolver.java:282) ~[grpc-core-1.61.0.jar:1.61.0]
at io.grpc.grpclb.GrpclbNameResolver.doResolve(GrpclbNameResolver.java:63) ~[grpc-grpclb-1.61.0.jar:1.61.0]
at io.grpc.internal.DnsNameResolver$Resolve.run(DnsNameResolver.java:318) ~[grpc-core-1.61.0.jar:1.61.0]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
at java.base/java.lang.Thread.run(Thread.java:1583) ~[?:?]
Caused by: java.net.UnknownHostException: airbyte-temporal
at java.base/java.net.InetAddress$CachedLookup.get(InetAddress.java:988) ~[?:?]
at java.base/java.net.InetAddress.getAllByName0(InetAddress.java:1818) ~[?:?]
at java.base/java.net.InetAddress.getAllByName(InetAddress.java:1688) ~[?:?]
at io.grpc.internal.DnsNameResolver$JdkAddressResolver.resolveAddress(DnsNameResolver.java:632) ~[grpc-core-1.61.0.jar:1.61.0]
at io.grpc.internal.DnsNameResolver.resolveAddresses(DnsNameResolver.java:219) ~[grpc-core-1.61.0.jar:1.61.0]
at io.grpc.internal.DnsNameResolver.doResolve(DnsNameResolver.java:282) ~[grpc-core-1.61.0.jar:1.61.0]
at io.grpc.grpclb.GrpclbNameResolver.doResolve(GrpclbNameResolver.java:63) ~[grpc-grpclb-1.61.0.jar:1.61.0]
at io.grpc.internal.DnsNameResolver$Resolve.run(DnsNameResolver.java:318) ~[grpc-core-1.61.0.jar:1.61.0]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
at java.base/java.lang.Thread.run(Thread.java:1583) ~[?:?]
Slackbot
04/26/2024, 6:43 AMVictor Cojocaru
04/26/2024, 7:25 AM0.53.250
to 0.56.16
we are noticing big increase in cloud costs on snowflake, with queries like
SELECT table_schema, table_name, column_name, data_type, is_nullable
FROM information_schema.columns
WHERE table_catalog = ?
AND table_schema IN (%s)
AND table_name IN (%s)
ORDER BY table_schema, table_name, ordinal_position;
being executed millions of times, someone knows the reason?Malvic Leroux
04/26/2024, 8:29 AMrequests.exceptions.InvalidSchema: Invalid Protocol Scheme: The endpoint that data is being requested from is using an invalid or insecure protocol 'http'. Valid protocol schemes: https
Georgi Milanov
04/26/2024, 8:52 AMDavid Conde
04/26/2024, 9:32 AMChristian Schmid
04/26/2024, 11:59 AMAviral Harsh
04/26/2024, 12:42 PMDamien Busch
04/26/2024, 12:57 PMLucas Segers
04/26/2024, 12:58 PMChristian Schmid
04/26/2024, 1:05 PMTatiane Corrêa da Costa e Silva
04/26/2024, 2:18 PMAlasdair Ellis
04/26/2024, 2:50 PMMike Saffitz
04/26/2024, 3:02 PM2024-04-25 01:55:24 replication-orchestrator > Records read: 2120000 (8 GB)
2024-04-25 01:56:17 replication-orchestrator > Records read: 2125000 (8 GB)
2024-04-25 01:57:10 replication-orchestrator > Records read: 2130000 (9 GB)
2024-04-25 01:58:01 replication-orchestrator > Records read: 2135000 (9 GB)
2024-04-25 01:58:54 replication-orchestrator > Records read: 2140000 (9 GB)
2024-04-25 02:03:07 platform > Cloud storage job log path: /workspace/2181/0/logs.log
2024-04-25 02:03:07 platform > Executing worker wrapper. Airbyte version: 0.57.3
2024-04-25 02:03:07 platform > Attempt 0 to save workflow id for cancellation
2024-04-25 04:17:53 platform > Cloud storage job log path: /workspace/2181/0/logs.log
2024-04-25 04:17:53 platform > Executing worker wrapper. Airbyte version: 0.57.3
2024-04-25 04:17:53 platform > Attempt 0 to save workflow id for cancellation
2024-04-25 06:15:38 platform > Cloud storage job log path: /workspace/2181/0/logs.log
2024-04-25 06:15:38 platform > Executing worker wrapper. Airbyte version: 0.57.3
2024-04-25 06:15:38 platform > Attempt 0 to save workflow id for cancellation
2024-04-26 01:59:39 replication-orchestrator > thread status... heartbeat thread: true , replication thread: false
2024-04-26 01:59:39 replication-orchestrator > Do not terminate as feature flag is disable
2024-04-26 05:22:42 platform > Cloud storage job log path: /workspace/2181/0/logs.log
2024-04-26 05:22:42 platform > Executing worker wrapper. Airbyte version: 0.57.3
2024-04-26 05:22:42 platform > Attempt 0 to save workflow id for cancellation
@kapa.ai any ideas?Dana Williams
04/26/2024, 4:03 PMmike Trienis
04/26/2024, 6:19 PMLuke Lerdal
04/26/2024, 6:53 PMDana Williams
04/26/2024, 8:11 PMDana Williams
04/26/2024, 8:11 PMVenkata Saikiran Kattekola
04/26/2024, 9:02 PMTed Glomski
04/26/2024, 10:20 PM0.64.205
. We are using an annotated Service Account to grant AWS role credentials per AWS documentation for IAM roles for service accounts, and we have validated that non-Airbyte resources can access a given S3 bucket. All of our resources are in the AWS region us-east-1
- S3 bucket, IAM role, etc. All pods have us-east-1
set as the environment variables AWS_REGION
and AWS_DEFAULT_REGION
and we also have global.storage.s3.bucketRegion
set to us-east-1
. Whenever we try to access that S3 bucket or any other S3 bucket from Airbyte server, Airbyte Worker, or any source-check or destination-check job that gets spun up we get the same error:
software.amazon.awssdk.services.s3.model.S3Exception: The authorization header is malformed; the region 'us-east-1' is wrong; expecting 'eu-west-1'
This error comes up regardless if we specify the AWS region in the source or destination config, if we specify an AWS Access Key ID and Secret Access Key, if we specify an endpoint, etc.
Any assistance would be very welcome.Slackbot
04/26/2024, 10:20 PMmike Trienis
04/26/2024, 11:18 PMLuke Lerdal
04/26/2024, 11:30 PMHAL9000
04/27/2024, 5:11 AMHAL9000
04/27/2024, 5:16 AM