Andrey Morskoy
09/24/2021, 12:20 PMRecords read: 29000
• then just disabled WiFi
• job remains in Running state
- leaving it for couple of minutes to simulate network issue
• then I've re-enabled WiFi
• Nothing changed, job is still in the same Running
state, distination file is not updated since then.
Are there any retry policies for such network/data availability issues? For me it looks like there is couple of issues:
• I am not notified on sync error
• there is no job continuation - seems that I need manually reset connection?user
09/24/2021, 2:42 PMuser
09/24/2021, 2:42 PMuser
09/27/2021, 6:42 AMuser
09/27/2021, 6:45 AMroot@amorskyi-le-E5L9:~# docker ps | grep source
feb5280e090f airbyte/source-file:0.2.6 "/airbyte/base.sh re…" 2 days ago Up 2 days relaxed_poitras
Artem Astapenko
09/27/2021, 6:46 AMroot@47c2376a4120:/app# ps aux | grep source-file
root 773 0.0 0.0 2088580 46580 ? Sl Sep24 0:07 docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/7/0 --network host --log-driver none airbyte/source-file:0.2.6 read --config source_config.json --catalog source_catalog.json
root 1597 0.0 0.0 4832 884 pts/0 S+ 06:44 0:00 grep source-file
user
09/27/2021, 6:47 AM# strace -ff -p 14528 # it is corresponding PID from host
user
09/27/2021, 6:48 AMpid 27390] epoll_pwait(4, [], 128, 0, NULL, 824636977728) = 0
[pid 14553] epoll_pwait(4, <unfinished ...>
[pid 27390] epoll_pwait(4, <unfinished ...>
[pid 14553] <... epoll_pwait resumed> [], 128, 0, NULL, 0) = 0
[pid 14553] futex(0xc00007f150, FUTEX_WAIT_PRIVATE, 0, NULL <unfinished ...>
[pid 14548] <... nanosleep resumed> NULL) = 0
[pid 14548] futex(0x5636776c27d8, FUTEX_WAIT_PRIVATE, 0, {tv_sec
user
09/27/2021, 6:48 AMuser
09/27/2021, 9:47 AMSawyer Waugh
09/27/2021, 7:36 PMuser
09/28/2021, 7:24 AM