Hey, I use BigQuery for destination and use

GCS Staging

as Loading Method, but I got this error :

The connection tests failed.
State code: NoSuchKey; Message: The specified key does not exist. (Service: Amazon S3; Status Code: 404; Error Code: NoSuchKey; Request ID: null; S3 Extended Request ID: null; Proxy: null)

has anyone experienced this?

Hi. Are you trying to load from s3 to gcs and from there to bq?

I'm trying to load from MySQL to BQ. and I use GCS Staging as loading method

did you verify the source and destination that they indeed work? if so this is an issue with the connection is self and needs to be raised

@[DEPRECATED] Marcos Marx turned this thread into Zendesk ticket 2546 to ensure timely resolution!

Seems like the GCS HMAC Key is not configured correctly from the logs

HMAC key is correct. I think this is a bug in AirByte. source and destination also works well.

Does the HMAC Key have permissions to write to the bucket? It needs to have Storage Object Admin permission. What version of Airbyte are you using?

@Marcelo Pio de Castro I’m experiencing this issue as well. I’m on airbyte version

0.40.7

, the bigquery destination is version

1.2.5

but i was also seeing the error on

1.2.3

I use the BigQuery connector with GCS staging without any problems. From the error logs it seems a configuration problem, likely the service account that is associated with the HMAC Key does not have the correct permissions (most common scenario in my experience)

@Noah Selman and @Eka Pramudita I’ll try to reproduce this tomorrow

Hi, I already fixed this issue. root cause HMAC Key have no permissions to write to the bucket. So I need to add permission to the service account

I resolved this - it was also a permission issue on my ned - thanks for the response!

Airbyte uses the AWS Java library which is compatible with GCS. It simplify the code but... make the error logging more complex to users :(