Hi Guys， I encountered below errors when I tried to set up a google Ads source. I think this may be a proxy issue, as I deployed airbyte behind a proxy. Similar errors appeared in bing Ads source set-up. I configured http_proxy & https_proxy for docker, but not work. any suggestion on this problem? thanks.

@[DEPRECATED] Marcos Marx turned this message into Zendesk ticket 3006 to ensure timely resolution!

Hey do you have access to public internet from the instance?

what do you mean of a public internet ? I can access microsoft ads from the host, but failed to establish a connection to it on airbyte web UI.

I mean from the Airbyte hosted instance can you access the bing ads api host? Maybe you can exec and try ping

ah..yes, I can access public network from the host. I set proxy in both system Env. and docker. https://docs.docker.com/network/proxy/#configure-the-docker-client

Hey you mean the same error that domain is not reachable?

I can reach public network from server and webapp container, but still cannot create a google ads source.

Are you getting the same error?

yes. btw, I am not sure whether this is normal.

You mean init and bootloader exiting ? Yeah they are just starting container once their job is done they exit

Server Logs: POST 200 /api/v1/scheduler/sources/check_connection - {"connectionConfiguration":"REDACTED","workspaceId":"7c674a9b-1aba-4314-bb23-02f42645f92a","sourceDefinitionId":"253487c0-2246-43ba-a21f-5116b20a2c50"} worker logs: 2022-10-27 055217 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Checking the config 2022-10-27 055224 ERROR i.a.w.i.DefaultAirbyteStreamFactory(internalLog):113 - Check failed 2022-10-27 055225 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-27 055225 INFO i.a.w.t.TemporalAttemptExecution(get):162 - Stopping cancellation check scheduling... 2022-10-27 055225 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-27 055225 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-27 081647 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/8be92c0a-f120-4a16-821a-d406ca5c818d/0/logs.log 2022-10-27 081647 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.17 2022-10-27 081647 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-27 081647 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-27 081647 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-27 081647 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-google-ads:0.2.1 exists... 2022-10-27 081647 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-google-ads:0.2.1 was found locally. 2022-10-27 081647 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-google-ads-check-8be92c0a-f120-4a16-821a-d406ca5c818d-0-xphix with resources io.airbyte.config.ResourceRequirements@68bcae37[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-27 081647 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/8be92c0a-f120-4a16-821a-d406ca5c818d/0 --log-driver none --name source-google-ads-check-8be92c0a-f120-4a16-821a-d406ca5c818d-0-xphix --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-google-ads:0.2.1 -e AIRBYTE_VERSION=0.40.17 -e WORKER_JOB_ID=8be92c0a-f120-4a16-821a-d406ca5c818d airbyte/source-google-ads:0.2.1 check --config source_config.json 2022-10-27 081649 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Checking the config 2022-10-27 081656 ERROR i.a.w.i.DefaultAirbyteStreamFactory(internalLog):113 - Check failed 2022-10-27 081656 INFO i.a.w.t.TemporalAttemptExecution(get):162 - Stopping cancellation check scheduling... 2022-10-27 081656 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-27 081656 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-27 081656 INFO i.a.c.i.LineGobbler(voidCall):114

@Marcos Marx (Airbyte) any help here?

More tests. Just in case that I got some parameter value wrong in google or bing, I did a new test to create a git source with fewer and simpler parameters. airbyte-worker throw below errors. However, it's able to access https://api.githup.com from worker container(same as server and webapp container).

Hey thanks a lot for digging more deep into it. This question is more like a confirmation You did exec into worker container and pinged github.com and it is working? Could you create a issue here discuss.airbyte.io. I will ask @Marcos Marx (Airbyte) to look into it. Thanks a lot again for your patience

Thanks a lot. I have assigned to Marcos and asked for help

Hi any progress on this topic?

It looks like the issue is similar or the same one like this: https://airbytehq.slack.com/archives/C01MFR03D5W/p1637660475360200