https://linen.dev logo
Join Slack
Powered by
Hi! I have added a custom connector (source) to my...
# ask-community-for-troubleshooting
m
Hi! I have added a custom connector (source) to my local installation and I think I have added it twice. At one time it wasn’t there anymore so I hade to add it again. Now when I start up the docker containers and point my browser to localhost:8000 I get in to an infinite loop in the browser. This is the server log:
Copy code
irbyte-server      | 2021-10-06 18:49:50 INFO i.a.s.e.KnownExceptionMapper(toResponse):21 - {workspace_app_root=/tmp/workspace/server/logs} - Known exception
airbyte-server      | 2021-10-06 18:49:50 ERROR i.a.s.RequestLogger(filter):87 - {workspace_app_root=/tmp/workspace/server/logs} - REQ 172.19.0.3 POST 404 /api/v1/web_backend/connections/list - {"workspaceId":"a8d6c28e-ab6d-443d-ba5d-4f7568474ecf"}
And this is what I managed to grab from the browser:
Is it the only way around this to delete the database volume?
Here is the browser log:
Copy code
storytime.ts:138 Storytime has already been initialized!
value @ storytime.ts:138
(anonymous) @ SupportChat.tsx:41
Du @ react-dom.production.min.js:262
t.unstable_runWithPriority @ scheduler.production.min.js:18
qo @ react-dom.production.min.js:122
Ru @ react-dom.production.min.js:261
(anonymous) @ react-dom.production.min.js:261
M @ scheduler.production.min.js:16
w.port1.onmessage @ scheduler.production.min.js:12
storytime.ts:139 This may result in some unexpected issues.
value @ storytime.ts:139
(anonymous) @ SupportChat.tsx:41
Du @ react-dom.production.min.js:262
t.unstable_runWithPriority @ scheduler.production.min.js:18
qo @ react-dom.production.min.js:122
Ru @ react-dom.production.min.js:261
(anonymous) @ react-dom.production.min.js:261
M @ scheduler.production.min.js:16
w.port1.onmessage @ scheduler.production.min.js:12
index.esm.js:100 POST <http://localhost:8000/api/v1/web_backend/connections/list> 404 (Not Found)
t.<computed>.t.<computed> @ index.esm.js:100
(anonymous) @ BaseResource.tsx:50
l @ runtime.js:63
(anonymous) @ runtime.js:293
(anonymous) @ runtime.js:118
r @ asyncToGenerator.js:3
s @ asyncToGenerator.js:25
Promise.then (async)
r @ asyncToGenerator.js:13
s @ asyncToGenerator.js:25
(anonymous) @ asyncToGenerator.js:32
(anonymous) @ asyncToGenerator.js:21
(anonymous) @ 1.68e2b563.chunk.js:1
(anonymous) @ BaseResource.tsx:59
l @ runtime.js:63
(anonymous) @ runtime.js:293
(anonymous) @ runtime.js:118
r @ asyncToGenerator.js:3
s @ asyncToGenerator.js:25
(anonymous) @ asyncToGenerator.js:32
(anonymous) @ asyncToGenerator.js:21
(anonymous) @ 1.68e2b563.chunk.js:1
(anonymous) @ Connection.ts:155
l @ runtime.js:63
(anonymous) @ runtime.js:293
(anonymous) @ runtime.js:118
r @ asyncToGenerator.js:3
s @ asyncToGenerator.js:25
(anonymous) @ asyncToGenerator.js:32
(anonymous) @ asyncToGenerator.js:21
(anonymous) @ Connection.ts:152
payload @ createFetch.ts:84
h @ NetworkManager.ts:107
(anonymous) @ NetworkManager.ts:201
requestIdleCallback (async)
value @ NetworkManager.ts:199
value @ NetworkManager.ts:137
(anonymous) @ NetworkManager.ts:48
(anonymous) @ useFetchDispatcher.ts:49
(anonymous) @ useRetrieve.ts:20
useMemo @ react-dom.production.min.js:172
t.useMemo @ react.production.min.js:23
s @ useRetrieve.ts:17
d @ useResource.ts:42
h @ useResource.ts:783
Pn @ AllConnectionsPage.tsx:18
oa @ react-dom.production.min.js:157
Vl @ react-dom.production.min.js:267
ju @ react-dom.production.min.js:250
xu @ react-dom.production.min.js:250
Su @ react-dom.production.min.js:250
yu @ react-dom.production.min.js:243
(anonymous) @ react-dom.production.min.js:123
t.unstable_runWithPriority @ scheduler.production.min.js:18
qo @ react-dom.production.min.js:122
Qo @ react-dom.production.min.js:123
$o @ react-dom.production.min.js:122
fu @ react-dom.production.min.js:237
Ca @ react-dom.production.min.js:170
(anonymous) @ useAsyncFn.js:18
Promise.then (async)
(anonymous) @ useAsyncFn.js:17
(anonymous) @ useAsync.js:9
Du @ react-dom.production.min.js:262
t.unstable_runWithPriority @ scheduler.production.min.js:18
qo @ react-dom.production.min.js:122
Ru @ react-dom.production.min.js:261
(anonymous) @ react-dom.production.min.js:261
M @ scheduler.production.min.js:16
w.port1.onmessage @ scheduler.production.min.js:12
react-dom.production.min.js:216 Error: Could not find configuration for SOURCE_CONNECTION: 793e5041-798f-4348-8ad0-9c2e1adc2d67.
    at AirbyteRequestService.ts:75
    at l (runtime.js:63)
    at Generator._invoke (runtime.js:293)
    at Generator.next (runtime.js:118)
    at r (asyncToGenerator.js:3)
    at s (asyncToGenerator.js:25)
ll @ react-dom.production.min.js:216
n.payload @ react-dom.production.min.js:217
fi @ react-dom.production.min.js:130
Ha @ react-dom.production.min.js:184
Vl @ react-dom.production.min.js:269
ju @ react-dom.production.min.js:250
xu @ react-dom.production.min.js:250
Su @ react-dom.production.min.js:250
yu @ react-dom.production.min.js:243
(anonymous) @ react-dom.production.min.js:123
t.unstable_runWithPriority @ scheduler.production.min.js:18
qo @ react-dom.production.min.js:122
Qo @ react-dom.production.min.js:123
$o @ react-dom.production.min.js:122
fu @ react-dom.production.min.js:237
Ca @ react-dom.production.min.js:170
(anonymous) @ usePromisifiedDispatch.ts:29
(anonymous) @ SubscriptionManager.ts:72
(anonymous) @ NetworkManager.ts:58
dispatch @ useEnhancedReducer.ts:35
(anonymous) @ NetworkManager.ts:125
Promise.catch (async)
h @ NetworkManager.ts:107
(anonymous) @ NetworkManager.ts:201
requestIdleCallback (async)
value @ NetworkManager.ts:199
value @ NetworkManager.ts:137
(anonymous) @ NetworkManager.ts:48
(anonymous) @ useFetchDispatcher.ts:49
(anonymous) @ useRetrieve.ts:20
useMemo @ react-dom.production.min.js:172
t.useMemo @ react.production.min.js:23
s @ useRetrieve.ts:17
d @ useResource.ts:42
h @ useResource.ts:783
Pn @ AllConnectionsPage.tsx:18
oa @ react-dom.production.min.js:157
Vl @ react-dom.production.min.js:267
ju @ react-dom.production.min.js:250
xu @ react-dom.production.min.js:250
Su @ react-dom.production.min.js:250
yu @ react-dom.production.min.js:243
(anonymous) @ react-dom.production.min.js:123
t.unstable_runWithPriority @ scheduler.production.min.js:18
qo @ react-dom.production.min.js:122
Qo @ react-dom.production.min.js:123
$o @ react-dom.production.min.js:122
fu @ react-dom.production.min.js:237
Ca @ react-dom.production.min.js:170
(anonymous) @ useAsyncFn.js:18
Promise.then (async)
(anonymous) @ useAsyncFn.js:17
(anonymous) @ useAsync.js:9
Du @ react-dom.production.min.js:262
t.unstable_runWithPriority @ scheduler.production.min.js:18
qo @ react-dom.production.min.js:122
Ru @ react-dom.production.min.js:261
(anonymous) @ react-dom.production.min.js:261
M @ scheduler.production.min.js:16
w.port1.onmessage @ scheduler.production.min.js:12
45react-dom.production.min.js:216 Error: Could not find configuration for SOURCE_CONNECTION: 793e5041-798f-4348-8ad0-9c2e1adc2d67.
    at AirbyteRequestService.ts:75
    at l (runtime.js:63)
    at Generator._invoke (runtime.js:293)
    at Generator.next (runtime.js:118)
    at r (asyncToGenerator.js:3)
    at s (asyncToGenerator.js:25)
e
Try building the custom connector again, so you have a local image with the dev tag. There's a known bug when airbyte can't find a particular docker image tag.
m
OK, thanks. I will try that
Didn’t help. But Im new to docker so I might have missed something. I stopped the running airbyte containers, built the custom connector again with the same command as the first time. Ran git pull in the airbyte root folder and started it again with 
docker-compose up
. Command for building my custom connector: 
docker build . -t airbyte/source-provet:dev
e
I would need a bit more of the server logs. copy some 100 lines before and after those ones you pasted
m
Thanks for taking the time! I had airbyte running and the just opened the web UI for a few seconds to see that it went in to the infinite loop and the closed the tab. Here is the server log:
Copy code
airbyte-worker      | 2021-10-09 07:26:36 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(internalLog):90 - {job_log_path=/tmp/workspace/26/0/logs.log} - Starting syncing SourceProvet
airbyte-worker      | 2021-10-09 07:26:36 INFO i.a.w.p.a.DefaultAirbyteStreamFactory(internalLog):90 - {job_log_path=/tmp/workspace/26/0/logs.log} - Syncing stream: consultation 
airbyte-worker      | 2021-10-09 07:27:56 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$2):203 - {job_log_path=/tmp/workspace/25/0/logs.log} - Records read: 1000
airbyte-worker      | 2021-10-09 07:28:07 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$2):203 - {job_log_path=/tmp/workspace/26/0/logs.log} - Records read: 1000
airbyte-worker      | 2021-10-09 07:29:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$2):203 - {job_log_path=/tmp/workspace/25/0/logs.log} - Records read: 2000
airbyte-worker      | 2021-10-09 07:29:51 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$2):203 - {job_log_path=/tmp/workspace/26/0/logs.log} - Records read: 2000
airbyte-worker      | 2021-10-09 07:31:25 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$2):203 - {job_log_path=/tmp/workspace/25/0/logs.log} - Records read: 3000
airbyte-worker      | 2021-10-09 07:31:28 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$2):203 - {job_log_path=/tmp/workspace/26/0/logs.log} - Records read: 3000
airbyte-worker      | 2021-10-09 07:33:00 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$2):203 - {job_log_path=/tmp/workspace/26/0/logs.log} - Records read: 4000
airbyte-worker      | 2021-10-09 07:33:10 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$2):203 - {job_log_path=/tmp/workspace/25/0/logs.log} - Records read: 4000

airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:42 +0000] "GET / HTTP/1.1" 200 4597 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:42 +0000] "GET /index.css HTTP/1.1" 200 5642 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:42 +0000] "GET /static/js/main.0709e1dc.chunk.js HTTP/1.1" 200 1033 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:42 +0000] "GET /static/js/5.741e1b99.chunk.js HTTP/1.1" 200 213054 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:44 +0000] "GET /static/js/0.08072d12.chunk.js HTTP/1.1" 304 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:44 +0000] "GET /static/js/7.f3aff538.chunk.js HTTP/1.1" 304 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:44 +0000] "GET /static/js/1.f0d87d51.chunk.js HTTP/1.1" 304 0 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:44 +0000] "GET /static/css/0.0f25f7ed.chunk.css HTTP/1.1" 200 17165 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:44 +0000] "GET /manifest.json HTTP/1.1" 200 567 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:44 +0000] "GET /logo224.png HTTP/1.1" 200 48413 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-server      | 2021-10-09 07:33:44 INFO i.a.s.RequestLogger(filter):89 - {workspace_app_root=/tmp/workspace/server/logs} - REQ 172.19.0.5 POST 200 /api/v1/workspaces/list - {}
airbyte-server      | 2021-10-09 07:33:44 INFO i.a.s.RequestLogger(filter):89 - {workspace_app_root=/tmp/workspace/server/logs} - REQ 172.19.0.5 POST 200 /api/v1/workspaces/list - {}
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:44 +0000] "POST /api/v1/workspaces/list HTTP/1.1" 200 398 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:44 +0000] "POST /api/v1/workspaces/list HTTP/1.1" 200 398 "<http://localhost:8000/>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-server      | 2021-10-09 07:33:45 INFO i.a.s.RequestLogger(filter):89 - {workspace_app_root=/tmp/workspace/server/logs} - REQ 172.19.0.5 POST 200 /api/v1/source_definitions/list - {"workspaceId":"a8d6c28e-ab6d-443d-ba5d-4f7568474ecf"}
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:45 +0000] "POST /api/v1/source_definitions/list HTTP/1.1" 200 150780 "<http://localhost:8000/connections>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-server      | 2021-10-09 07:33:45 INFO i.a.s.RequestLogger(filter):89 - {workspace_app_root=/tmp/workspace/server/logs} - REQ 172.19.0.5 POST 200 /api/v1/source_definitions/list_latest - {"workspaceId":"a8d6c28e-ab6d-443d-ba5d-4f7568474ecf"}
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:45 +0000] "POST /api/v1/source_definitions/list_latest HTTP/1.1" 200 144226 "<http://localhost:8000/connections>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-server      | 2021-10-09 07:33:46 INFO i.a.s.RequestLogger(filter):89 - {workspace_app_root=/tmp/workspace/server/logs} - REQ 172.19.0.5 POST 200 /api/v1/destination_definitions/list - {"workspaceId":"a8d6c28e-ab6d-443d-ba5d-4f7568474ecf"}
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:46 +0000] "POST /api/v1/destination_definitions/list HTTP/1.1" 200 10074 "<http://localhost:8000/connections>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-server      | 2021-10-09 07:33:46 INFO i.a.s.e.KnownExceptionMapper(toResponse):21 - {workspace_app_root=/tmp/workspace/server/logs} - Known exception
airbyte-server      | 2021-10-09 07:33:46 ERROR i.a.s.RequestLogger(filter):87 - {workspace_app_root=/tmp/workspace/server/logs} - REQ 172.19.0.5 POST 404 /api/v1/web_backend/connections/list - {"workspaceId":"a8d6c28e-ab6d-443d-ba5d-4f7568474ecf"}
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:46 +0000] "POST /api/v1/web_backend/connections/list HTTP/1.1" 404 11595 "<http://localhost:8000/connections>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-server      | 2021-10-09 07:33:46 INFO i.a.s.RequestLogger(filter):89 - {workspace_app_root=/tmp/workspace/server/logs} - REQ 172.19.0.5 POST 200 /api/v1/destination_definitions/list_latest - {"workspaceId":"a8d6c28e-ab6d-443d-ba5d-4f7568474ecf"}
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:46 +0000] "POST /api/v1/destination_definitions/list_latest HTTP/1.1" 200 10074 "<http://localhost:8000/connections>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:46 +0000] "GET /simpleLogo.svg HTTP/1.1" 200 2674 "<http://localhost:8000/connections>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:47 +0000] "GET /fonts/inter/Inter-Medium.woff2 HTTP/1.1" 200 95048 "<http://localhost:8000/index.css>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:47 +0000] "GET /fonts/inter/Inter-Regular.woff2 HTTP/1.1" 200 88912 "<http://localhost:8000/index.css>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-server      | 2021-10-09 07:33:47 INFO i.a.s.e.KnownExceptionMapper(toResponse):21 - {workspace_app_root=/tmp/workspace/server/logs} - Known exception
airbyte-server      | 2021-10-09 07:33:47 ERROR i.a.s.RequestLogger(filter):87 - {workspace_app_root=/tmp/workspace/server/logs} - REQ 172.19.0.5 POST 404 /api/v1/web_backend/connections/list - {"workspaceId":"a8d6c28e-ab6d-443d-ba5d-4f7568474ecf"}
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:47 +0000] "POST /api/v1/web_backend/connections/list HTTP/1.1" 404 11595 "<http://localhost:8000/connections>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
airbyte-server      | 2021-10-09 07:33:49 INFO i.a.s.e.KnownExceptionMapper(toResponse):21 - {workspace_app_root=/tmp/workspace/server/logs} - Known exception
airbyte-server      | 2021-10-09 07:33:49 ERROR i.a.s.RequestLogger(filter):87 - {workspace_app_root=/tmp/workspace/server/logs} - REQ 172.19.0.5 POST 404 /api/v1/web_backend/connections/list - {"workspaceId":"a8d6c28e-ab6d-443d-ba5d-4f7568474ecf"}
airbyte-webapp      | 172.19.0.1 - - [09/Oct/2021:07:33:49 +0000] "POST /api/v1/web_backend/connections/list HTTP/1.1" 404 11595 "<http://localhost:8000/connections>" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Safari/537.36" "-"
I also see this line in the server log long after I have closed the browser tab.
Copy code
airbyte-worker      | 2021-10-09 07:44:38 INFO i.a.c.i.LineGobbler(voidCall):65 - {job_log_path=/tmp/workspace/25/0/logs.log} - [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
I ended up deleting all volumes for airbyte. There wasnt much to save anyway. Now Im up and running again 🙂
3 Views
Open in Slack
PreviousNext
Powered by