This message was deleted.
# clouds
steep-balloon-41261
09/01/2023, 8:20 AMThis message was deleted.
a
adorable-house-73941
09/01/2023, 8:20 AMthis was session
RM_5sLmjunBg8Tqa
able-gigabyte-21598
09/01/2023, 9:49 AMThe internal errors are from an issue with our gstreamer bindings, which is fixed in https://github.com/livekit/go-gst/pull/5.
The other two are from too many files waiting to be uploaded. What segment duration are you using?
a
adorable-house-73941
09/01/2023, 9:52 AMAmazing that the internal errors are already being resolved!
adorable-house-73941
09/01/2023, 9:53 AM6-second segment duration was configured
adorable-house-73941
09/19/2023, 8:14 AMHi @able-gigabyte-21598, thank you for solving the internal server error. I can confirm not seeing any of those in the past weeks. 😊
However, the
segment upload job queue is full Copy code
$ livekit-cli list-egress --verbose
+-----------------+----------------------+--------------------------------+--------------------------------+
| EGRESSID | STATUS | STARTED AT | ERROR |
+-----------------+----------------------+--------------------------------+--------------------------------+
| EG_Kr42AJ3hx5pf | EGRESS_LIMIT_REACHED | 2023-09-16 01:39:24.438811 | |
| | | +0200 CEST | |
| EG_Mo3RbqWbUry8 | EGRESS_LIMIT_REACHED | 2023-09-16 03:03:23.551145 | |
| | | +0200 CEST | |
| EG_YXogndUL8CGW | EGRESS_FAILED | 2023-09-16 13:40:23.390359 | zora-05_20230916163313623.ts |
| | | +0200 CEST | upload failed: segment upload |
| | | | job queue is full |
| EG_LRUdzUHJjTu3 | EGRESS_FAILED | 2023-09-16 15:04:23.063306 | zora-04_20230916142506751.ts |
| | | +0200 CEST | upload failed: segment upload |
| | | | job queue is full |
| EG_8qfyJognjSDV | EGRESS_FAILED | 2023-09-16 19:37:23.316762 | invalid start timestamp |
| | | +0200 CEST | |
| EG_TkqeF9tTf58Y | EGRESS_COMPLETE | 2023-09-16 19:54:23.145419 | |
| | | +0200 CEST | |
| EG_PdZQPunBn5TP | EGRESS_FAILED | 2023-09-16 20:58:23.481756 | zora-05_20230916234926308.ts |
| | | +0200 CEST | upload failed: segment upload |
| | | | job queue is full |
| EG_h8ucd4SvAqnH | EGRESS_COMPLETE | 2023-09-17 03:53:22.810389 | |
| | | +0200 CEST | |
| EG_6QY5Jrhxujet | EGRESS_COMPLETE | 2023-09-17 04:14:22.983738 | |
| | | +0200 CEST | |
| EG_ewqhYHYGavwn | EGRESS_FAILED | 2023-09-17 05:41:23.392833 | zora-05_20230917041949029.ts |
| | | +0200 CEST | upload failed: segment upload |
| | | | job queue is full |
| EG_FcRvQA2kR8u7 | EGRESS_FAILED | 2023-09-17 06:40:22.744484 | zora-05_20230917052100194.ts |
| | | +0200 CEST | upload failed: segment upload |
| | | | job queue is full |
| EG_2sHLYmMbEwBw | EGRESS_COMPLETE | 2023-09-17 07:46:23.495487 | |
| | | +0200 CEST | |
| EG_WgGfQ3EoQUSV | EGRESS_COMPLETE | 2023-09-17 12:08:23.825015 | |
| | | +0200 CEST | |
| EG_W4GrBiGWZehi | EGRESS_COMPLETE | 2023-09-17 15:16:23.961102 | |
| | | +0200 CEST | |
| EG_RrwoPBb4Mj8w | EGRESS_LIMIT_REACHED | 2023-09-17 15:25:23.389114 | |
| | | +0200 CEST | |
| EG_Nu4QU6yukfe6 | EGRESS_COMPLETE | 2023-09-17 18:36:22.958913 | |
| | | +0200 CEST | |
| EG_7dSj4H58ZGue | EGRESS_COMPLETE | 2023-09-18 01:53:23.682522 | |
| | | +0200 CEST | |
| EG_ifMkmnJa3WXF | EGRESS_LIMIT_REACHED | 2023-09-18 05:53:22.956088 | |
| | | +0200 CEST | |
| EG_4KCSXHcbf66o | EGRESS_FAILED | 2023-09-18 05:53:23.870463 | zora-05_20230918050943581.ts |
| | | +0200 CEST | upload failed: segment upload |
| | | | job queue is full |
| EG_EhbKTTU4wQ8T | EGRESS_FAILED | 2023-09-18 07:51:22.845975 | zora-05_20230918070330074.ts |
| | | +0200 CEST | upload failed: segment upload |
| | | | job queue is full |
| EG_2vgLqD6AAkAh | EGRESS_FAILED | 2023-09-18 09:42:24.048712 | zora-05_20230918082850141.ts |
| | | +0200 CEST | upload failed: segment upload |
| | | | job queue is full |
| EG_mokbSfuJ3ykS | EGRESS_FAILED | 2023-09-18 10:55:22.918139 | zora-05_20230918094340472.ts |
| | | +0200 CEST | upload failed: segment upload |
| | | | job queue is full |
| EG_MGDvbqW2Hsrg | EGRESS_COMPLETE | 2023-09-18 12:20:22.839838 | |
| | | +0200 CEST | |
| EG_Eqso5L4TjQxA | EGRESS_COMPLETE | 2023-09-18 16:41:24.004696 | |
| | | +0200 CEST | |
| EG_izHFhLn2bgZd | EGRESS_FAILED | 2023-09-18 17:54:23.846484 | invalid start timestamp |
| | | +0200 CEST | |
| EG_UWbvffHA4tcM | EGRESS_COMPLETE | 2023-09-18 21:13:23.160963 | |
| | | +0200 CEST | |
| EG_RegwoAxLvQmz | EGRESS_FAILED | 2023-09-18 23:12:23.067527 | zora-03_20230918212736985.ts |
| | | +0200 CEST | upload failed: segment upload |
| | | | job queue is full |
| EG_isyuXTDALKv8 | EGRESS_FAILED | 2023-09-18 23:58:23.468218 | zora-03_20230918231332033.ts |
| | | +0200 CEST | upload failed: segment upload |
| | | | job queue is full |
| EG_PLtpgMaTU3pD | EGRESS_COMPLETE | 2023-09-19 00:22:22.750685 | |
| | | +0200 CEST | |
| EG_auhEApiaXsk2 | EGRESS_FAILED | 2023-09-19 01:53:24.402272 | zora-03_20230919005139484.ts |
| | | +0200 CEST | upload failed: segment upload |
| | | | job queue is full |
| EG_4wY55TJLWjAC | EGRESS_ACTIVE | 2023-09-19 03:22:23.199975 | |
| | | +0200 CEST | |
| EG_nkBdmWMFL9Zz | EGRESS_COMPLETE | 2023-09-19 03:27:23.824672 | |
| | | +0200 CEST | |
| EG_7u5xmptx5LcV | EGRESS_FAILED | 2023-09-19 07:26:23.124757 | invalid start timestamp |
| | | +0200 CEST | |
| EG_iAacJ2UAvcDx | EGRESS_ACTIVE | 2023-09-19 08:31:23.033301 | |
| | | +0200 CEST | |
+-----------------+----------------------+--------------------------------+--------------------------------+a
able-gigabyte-21598
09/19/2023, 7:27 PMwhat storage provider are you using?
able-gigabyte-21598
09/19/2023, 7:27 PMthe
invalid start timestampa
adorable-house-73941
09/19/2023, 7:34 PMAh, thanks for fixing the
invalid start timestampadorable-house-73941
09/19/2023, 7:34 PMWe are using the S3 backend
a
able-gigabyte-21598
09/19/2023, 11:43 PMlooks like invalid timestamp is still an issue. I’ll look into that and why the s3 uploads are getting so backed up