This message was deleted.
# helpdesk
s
This message was deleted.
m
cc @chilly-animal-65189 @able-gigabyte-21598
c
Looks like a crash that would need to be tracked down in gstreamer. Are you using one of our egress containers? What version?
c
I use the Egress container and update to the latest version few days ago.
c
Ok. Would it be possible to get the egress start request you are using, and some more verbose debug? You could get this by setting the log level to debug in the egress conf and add the
-e GST_DEBUG=3 command line option to the docker command line
.
🙌 1
c
There are debug logs .
Copy code
2022-12-30T03:47:54.875Z	INFO	egress	service/service.go:153	request accepted	{"nodeID": "NE_ug96fQH8tez9", "egressID": "EG_DUGVkTesaSLG", "requestID": "RPC_HRuDFUDF7wqA", "senderID": "ND_ElfvPvE3"}
2022-12-30T03:47:54.907Z	INFO	egress	redis/redis.go:82	connecting to redis	{"nodeID": "NE_ug96fQH8tez9", "handlerID": "EGH_cbZtJrgjtDQs", "egressID": "EG_DUGVkTesaSLG", "simple": true, "addr": "127.0.0.1:6379"}
0:00:00.003690750    25 0x7fe0d4018290 ERROR     GST_PLUGIN_LOADING gstpluginloader.c:442:gst_plugin_loader_try_helper: Spawning gst-plugin-scanner helper failed: Failed to close file descriptor for child process (Operation not permitted)

(egress:25): GStreamer-WARNING **: 03:47:54.912: External plugin loader failed. This most likely means that the plugin loader helper binary was not found or could not be run. You might need to set the GST_PLUGIN_SCANNER environment variable if your setup is unusual. This should normally not be required though.
0:00:00.074762444    25 0x7fe0d4018290 WARN                 nvcodec gstcudaloader.c:139:gst_cuda_load_library: Could not open library libcuda.so.1, libcuda.so.1: cannot open shared object file: No such file or directory
0:00:00.074794689    25 0x7fe0d4018290 WARN                 nvcodec plugin.c:73:plugin_init: Failed to load cuda library
0:00:00.433007846    25 0x7fe0d4018290 WARN                 default gstsfelement.c:97:gst_sf_create_audio_template_caps: format 0x120000: 'AVR (Audio Visual Research)' is not mapped
0:00:00.433046018    25 0x7fe0d4018290 WARN                 default gstsfelement.c:97:gst_sf_create_audio_template_caps: format 0x180000: 'CAF (Apple Core Audio File)' is not mapped
0:00:00.433059706    25 0x7fe0d4018290 WARN                 default gstsfelement.c:97:gst_sf_create_audio_template_caps: format 0x100000: 'HTK (HMM Tool Kit)' is not mapped
0:00:00.433081592    25 0x7fe0d4018290 WARN                 default gstsfelement.c:97:gst_sf_create_audio_template_caps: format 0xc0000: 'MAT4 (GNU Octave 2.0 / Matlab 4.2)' is not mapped
0:00:00.433088414    25 0x7fe0d4018290 WARN                 default gstsfelement.c:97:gst_sf_create_audio_template_caps: format 0xd0000: 'MAT5 (GNU Octave 2.1 / Matlab 5.0)' is not mapped
0:00:00.433094249    25 0x7fe0d4018290 WARN                 default gstsfelement.c:97:gst_sf_create_audio_template_caps: format 0x210000: 'MPC (Akai MPC 2k)' is not mapped
0:00:00.433100843    25 0x7fe0d4018290 WARN                 default gstsfelement.c:97:gst_sf_create_audio_template_caps: format 0xe0000: 'PVF (Portable Voice Format)' is not mapped
0:00:00.433107752    25 0x7fe0d4018290 WARN                 default gstsfelement.c:97:gst_sf_create_audio_template_caps: format 0x160000: 'SD2 (Sound Designer II)' is not mapped
0:00:00.433116297    25 0x7fe0d4018290 WARN                 default gstsfelement.c:97:gst_sf_create_audio_template_caps: format 0x190000: 'WVE (Psion Series 3)' is not mapped
2022-12-30T03:47:56.960Z	INFO	egress	service/handler.go:133	egress updated	{"nodeID": "NE_ug96fQH8tez9", "handlerID": "EGH_cbZtJrgjtDQs", "egressID": "EG_DUGVkTesaSLG", "egressID": "EG_DUGVkTesaSLG", "request_type": "room_composite", "output_type": "segments", "status": "EGRESS_ENDING"}
0:00:02.054936874    25 0x7fe0dc02e6a0 WARN              aggregator gstaggregator.c:2101:gst_aggregator_query_latency_unlocked:<muxer> Latency query failed
0:00:02.055637455    25 0x7fe0dc02ed20 FIXME                default gstutils.c:4025:gst_pad_create_stream_id_internal:<pulsesrc0:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:02.056145697    25 0x7fe0dc02e580 FIXME                default gstutils.c:4025:gst_pad_create_stream_id_internal:<ximagesrc0:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:02.058775899    25 0x7fe0dc02ecc0 WARN         audio-resampler audio-resampler.c:274:convert_taps_gint16_c: can't find exact taps
**
ERROR:../gst/multifile/gstsplitmuxsink.c:2691:check_completed_gop: assertion failed: (gop != NULL)
Bail out! ERROR:../gst/multifile/gstsplitmuxsink.c:2691:check_completed_gop: assertion failed: (gop != NULL)
2022-12-30T03:47:57.245Z	ERROR	egress	service/manager.go:114	process failed	{"nodeID": "NE_ug96fQH8tez9", "error": "signal: aborted (core dumped)"}
<http://github.com/livekit/egress/pkg/service.(*ProcessManager).awaitCleanup|github.com/livekit/egress/pkg/service.(*ProcessManager).awaitCleanup>
	/workspace/pkg/service/manager.go:114
2022-12-30T03:47:57.245Z	INFO	egress	service/service.go:88	shutting down	{"nodeID": "NE_ug96fQH8tez9"}
d
Can you share the request that was made too? The failure looks really strange as it's attempting to load a hardware encoder. We do not support hardware encoders in Egress today. Which environment are you running this?
Copy code
WARN                 nvcodec gstcudaloader.c:139:gst_cuda_load_library: Could not open library libcuda.so.1, libcuda.so.1: cannot open shared object file: No such file or directory
c
Also setting the log level to debug in the egress conf would help.
c
Copy code
Architecture:                    x86_64
CPU op-mode(s):                  32-bit, 64-bit
Byte Order:                      Little Endian
Address sizes:                   46 bits physical, 48 bits virtual
CPU(s):                          4
On-line CPU(s) list:             0-3
Thread(s) per core:              2
Core(s) per socket:              2
Socket(s):                       1
NUMA node(s):                    1
Vendor ID:                       GenuineIntel
CPU family:                      6
Model:                           79
Model name:                      Intel(R) Xeon(R) CPU @ 2.20GHz
Stepping:                        0
CPU MHz:                         2199.998
BogoMIPS:                        4399.99
Hypervisor vendor:               KVM
Virtualization type:             full
L1d cache:                       64 KiB
L1i cache:                       64 KiB
L2 cache:                        512 KiB
L3 cache:                        55 MiB
NUMA node0 CPU(s):               0-3
Docker version 20.10.21, build baeda1f
d
can you post the request that was made?
a
Failure to load libcuda.so is normal, that's initializing the plugin registry