LiveKit Community

UDPMux isn't as efficient on multi-core systems, due to system-level mutexes that prevent multiple cores from accessing the socket. So it really depends on your use case.

I am trying to setup a proxy behind livekit and it would be easier to do with only one port and I was curious about the performance. Finally I managed to execute some valuable tests and I decided not to use the udpmux solution

glad to hear it. for production setups we don't recommend UDPMux

please ensure y our redis host is set properly, instead of the placeholder value `&lt;redis-host&gt;`

Screenshot from 2022-07-27 16-45-59.png

<@U03PRK0N1QU> VP8 and H.264 are the supported codecs.

There are plans for AV1 support (hopefully in the next few weeks).

<@U02CM28PB4Y> so `VP9` is not supported yet?  It's just ts types that confused me <https://github.com/livekit/client-sdk-js/blob/main/src/room/track/options.ts#L208>

Sorry, that needs to be removed. VP9 support is not planned for now. Given that AV1 is a more efficient and a more advanced codec, we have been focussing on supporting that.

<https://github.com/livekit/client-sdk-unity-web>

`/home/x1carbon/Unity/Hub/Editor/2021.3.6f1/Editor/Data/il2cpp/build/deploy/il2cpp --convert-to-cpp --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.SharedInternalsModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.TilemapModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/System.Xml.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/System.Data.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.PhysicsModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.TextCoreFontEngineModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.IMGUIModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.SpriteShapeModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/System.Xml.Linq.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.TextCoreTextEngineModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.CoreModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.UIElementsNativeModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.AnimationModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/System.Configuration.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.GridModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/mscorlib.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/System.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.UIElementsModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/LiveKitBridge.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/System.Core.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/System.Numerics.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/Newtonsoft.Json.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/RoomExample.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.UIModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.AudioModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/System.Runtime.Serialization.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/Assembly-CSharp.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.InputLegacyModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.UI.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/Mono.Security.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.TextRenderingModule.dll --assembly=Library/Bee/artifacts/WebGL/ManagedStripped/UnityEngine.Physics2DModule.dll --data-folder=/home/x1carbon/My project/Library/Bee/artifacts/WebGL/il2cppOutput/data --generatedcppdir=/home/x1carbon/My project/Library/Bee/artifacts/WebGL/il2cppOutput/cpp --emit-method-map --dotnetprofile=unityaot-linux --profiler-report --profiler-output-file=/home/x1carbon/My project/Library/Bee/artifacts/il2cpp_conv_edwl.traceevents --print-command-line`
Error: IL2CPP error for type '<http://System.Net|System.Net>.WebHeaderCollection/RfcChar' in assembly '/home/x1carbon/My project/Library/Bee/artifacts/WebGL/ManagedStripped/System.dll'
System.ArgumentOutOfRangeException: Index was out of range. Must be non-negative and less than the size of the collection. (Parameter 'index')
   at Unity.IL2CPP.CodeWriters.ChunkedMemoryStream.Seek(Int64 offset, SeekOrigin origin) in /Users/bokken/build/output/unity/il2cpp/Unity.IL2CPP/CodeWriters/ChunkedMemoryStream.cs:line 107
   at Unity.IL2CPP.CodeWriters.InMemoryGeneratedMethodCodeWriter.Write(IGeneratedMethodCodeStream other) in /Users/bokken/build/output/unity/il2cpp/Unity.IL2CPP/CodeWriters/InMemoryGeneratedMethodCodeWriter.cs:line 44
   at Unity.IL2CPP.SourceWriters.SourceWriterBase`2.FlushStream(GlobalWriteContext context, IGeneratedMethodCodeStream stream, NPath filePath) in /Users/bokken/build/output/unity/il2cpp/Unity.IL2CPP/SourceWriters/SourceWriterBase.cs:line 56
   at Unity.IL2CPP.Contexts.Scheduling.Streams.FileLevelParallelStreamManager`3.WorkerWriteItemsToFile(WorkItemData`2 data) in /Users/bokken/build/output/unity/il2cpp/Unity.IL2CPP/Contexts.Scheduling.Streams/FileLevelParallelStreamManager.cs:line 39
   at Unity.IL2CPP.Contexts.Scheduling.PhaseWorkScheduler`1.WorkerLoop(Object data) in /Users/bokken/build/output/unity/il2cpp/Unity.IL2CPP/Contexts.Scheduling/PhaseWorkScheduler.cs:line 339
UnityEditor.BuildPlayerWindow:BuildPlayerAndRun () (at /home/bokken/buildslave/unity/build/Editor/Mono/BuildPlayerWindow.cs:180)

it’s actually the `adaptiveStream`  the one that’s causing me issues, with just `dynacast` video playback works fine

it's not possible to turn off adaptivestream for just one track. it's a global setting per session

so yeah, that's the expected behavior if you are displaying to Canvas instead of attaching to other elements

gotcha, thought as much, is it something that’s expected to be added? something to keep the subscription on a particular track?

no, the two modes that we do support is fully automatic and fully manual. You can <https://docs.livekit.io/guides/room/receive/#enabling/disabling-tracks|still control> your desired layers and pause the stream.

How can i get the list of participants using the latest version of livekit android sdk. <@U01NZKTNE1H>

<https://docs.livekit.io/client-sdk-android/livekit-android-sdk/io.livekit.android.room/-room/index.html#1863190924%2FProperties%2F-885714121>

스크린샷 2022-07-28 오후 1.52.29.png

`docker build . -t &lt;your-image-tag&gt;`

Hi, there
I am wondering is there the *C#* sdk for *Linux* platform?

Is there any plan to support Others? such as linux etc.

Or any other languages to working on Linux platform? :grinning:

Sorry but i am not much knowledgeable about it. Maybe you can ask <@U01NZKTNE1H>

we are planning for native Unity as well :slightly_smiling_face:

What platform and sdk are you having issues on?

Sorry for not writing in detail earlier, I am using Unity 2022

image.png

Hey, are you sure the game isn't paused ( The browser tab isn't selected ) ?

In Unity WebGL sdk, How can i use the
```PublishData```
Method to send JSON Objects. I want to use livekit for sending JSON objects in a multiplayer Scene

<@U02MAJLGN65> Would it be worth making `LocalParticipant.ConnectionQuality` implement `Identifiable` and `Equatable`? It'd mean you wouldn't have to switch it to get a String representation.

`ConnectionStatus` has an implementation that would do the job at first glance.

<@U03RALFBR37> Could u let us know which platform sdk you are using ?

Thanks for the respone. Im using JS SDK, and on top a VUE JS wrapper for the UI.  im referencing  the tracks and stream directly from  the objects or events and not really calling that .attach() on the trackpublication. Will this cause any issue for the adaptive streaming, simulcast feature ?

If you are not calling the attach(), is it working for u as expected ?

I've just started the development. So just thought will ask you guys before proceeding

Im looping over the participants. So that is creating video and audio tags for me

I'm not creating element through my JS code

That'll work i guess. It's the same logic

OK thanks. i was going through the track object in my app and in that the attachedElements array was empty. So just thought  if was doing something wrong

That's great approach. You can ask <@U01NZKTNE1H> for a better suggestion. He is very informative

we setup the listeners needed to handle adaptive streaming in `attach()`, so adaptive streaming will likely not work if you don't use it.

Oh okay. Thanks for reply. it was mentioned in docs. I missed it somehow

<@U01NZKTNE1H> I had one more query. ParticipantConnected is fired after trackEvents. Is that order right  ?

Hmm that might be a bug. cc <@U02EU2ZPTQU>

hi <@U03RALFBR37> yeah, that seem unintuitive, will propose a fix for that!

<@U02EU2ZPTQU> <@U01NZKTNE1H> Yea this is working as expected. But the `participant` arg for `participantConnected` event does not have `name` in it.

are you encoding the `name` in the auth token? (that’s how it gets set)

Yes, for other events i'm getting it. Problem is only with `participantConnected`

I also get the name in `participantMetadataChanged`   event

Thanks for the report, this is a bug, PR with a fix is out <https://github.com/livekit/client-sdk-js/pull/376>

Hello <@U03EVR88RA5>, the sid are `server generated identifier` . Also, I'm not sure if you ever seen the following page in the docs, but I find it extremely useful for reference to those kind of questions :slightly_smiling_face: <https://docs.livekit.io/guides/server-api/#participantinfo>

I would also highly suggest to thread :thread: up all your questions together, it's much easier to follow through :slightly_smiling_face:

My bad, I will from now on :slightly_smiling_face:

I don't think there's a limitation with publishing resolution. additional logs from the server or client would be helpful to see what might be happening here.

As a test, I pushed a change to the included sample app that publishes 1080p. It's been working well for me. <https://github.com/livekit/client-sdk-js/tree/1080p-test>

Both Chrome and Safari are capturing at 1080p, FF still produces 720p not due to a difference of how it handles aspect ratio

Thanks for the updated sample. I can confirm streaming in 1080p from Safari with it works fine with my server. Am I right saying my issue most likely comes from the encoded 1080p stream on iOS?

Continuing my investigations, I have tried to send the video another way using `BufferCapturer` and `CMSampleBuffer`s. Unfortunately the behaviour is the same, no video gets to other participants.

Not sure what do to next. Bandwidth on the client side should be more than enough (500mbps up) and the I would hope the iPhone able to keep up with the encoding as it is a 13 Pro.

are you building with the Swift SDK then? it's possible there's a limitation in our swift SDK. CC <@U02MAJLGN65>
how are you publishing and encoding the video?

Yes, I'm building with the Swift SDK, sorry if that wasn't clear.

For the first try I've used `room.localParticipant?.setCamera(enabled: true)`. For the second try, I've been using `LocalVideoTrack.createBufferTrack()` , feeding it `CMSampleBuffer` from an `AVCaptureVideoDataOutput`. So in both case encoding is delegated to LiveKit. `adaptiveStream` was disabled.

For the publish quality, I've been using the `VideoPublishOptions` with either simulcast off (in which case quality depends on the source) and with simulcast on and its layers. In both cases, publishing fails silently if resolution is greater than 720p.

Have you tried the `BufferCaptureOptions` of `LocalVideoTrack.createBufferTrack()`  ?

Hi <@U02MAJLGN65>, yes I did. Same results unfortunately.

Here I have debug logs for both the server and the client for the 2 scenarios:

• 1 iPhone streaming @ 720p30, 1 client connected through Safari (named "iPhone client" in the logs)
• 1 iPhone streaming @ 1080p30, 1 client connected through Safari (named "iPhone client" in the logs)
Client-side, no logs caught my attention. However, on the serverside we can see that in the 1080p30 scenario, nothing happens after "sending ice candidates", when the 720p30 scenario binds the published track.

Out of curiosity, I've also tried changing the codecs when streaming from Safari to see if 1080p30 would fail, but it worked fine.

pion_debug_logs.zip

I figured that I could also enable Pion debug logs. Perhaps this is more useful.

The 1080p stream never passes this stage:
```sending SACK: SACK cumTsnAck=389057418 arwnd=1048576 dupTsn=[]	{"room": "iphone-dev-0", "roomID": "RM_JQhjPuHRkYCy", "participant": "iPhone", "pID": "PA_32agpHa3JKM7", "remote": false, "transport": "PUBLISHER"}```
Whereas the 720p stream continues past it:
```answering pub offer	{"room": "iphone-dev-0", "roomID": "RM_9YqWSHnB6gwb", "participant": "iPhone", "pID": "PA_GpH822vQUHCj", "remote": false, "state": "ACTIVE"} ```

Hi, I can reproduce the odd behavior. But if I use VP8 looks like everything works well.

A temporary workaround would be to force the server to use VP8.

Could you try if that works out ?

Oh great, thanks for the suggestion, it works!

Do you want me to open an issue on github for the h264 case?

I don’t think that’s required, I’ve already discussed this issue with our team.

Thanks for the help, hoping for a fix soon!

No problem, we are working on it :slightly_smiling_face:

Hey <@U02MAJLGN65>, sorry to bother you again. I might have found another related bug. When VP8 is forced on the server, 720p doesn't work and streams in 540p instead when simulcast is off. With simulcast on, it works fine.

<@U03QZ9A4R2T> Can you post your ios devide model, and sdp offer &amp; answer when you reproduce the bug?

Hello <@U02MAJLGN65> <@U02GP9AENTH>, sorry for the delay, I had to find some time to investigate. I can give you both the server and the client logs when I try to stream in 720p60. From what I can tell everything is fine serverside but on the client side at some point we get:

```[notify] track.didUpdate dimensions: Optional(__C.CMVideoDimensions(width: 540, height: 960))```
and I can't explain why. At first I thought it was because of the size of the `VideoView`, but it happens on every client I've tested (iOS, macOS, and web) no matter the size of the view.

As a reminder, it works as expected when streaming in 1080p60.

Hi I made changes recently, can you try v1.0.4 ?

<@U03QZ9A4R2T> would love to hear updates regarding this issue :slightly_smiling_face:

Hi <@U02MAJLGN65>, I'm focused on other features of our app at the moment, I'll try to get back to it by end of week. I'll keep you posted!

Hi <@U02MAJLGN65>, good news, the last update has fixed all the issues (we can also remove the forced VP8 serverside)

Hello <@U03S4003WJU>,

If I recall correctly Livekit can scale to multiple nodes although 1 room cannot be auto-scaled passed a single node. So if you have a need for a big room with 100s of users and you're exceeding the node limits, I do not think it is capable as of now to autoscale that room through multiple nodes.

This said, someone from the LiveKit Team should be able to confirm this. <@U01KZ61GV5Z> ?

<@U032TUAL4KT> is right. One room cannot span multiple media nodes.

tester.png

SCREEN.png

caddy says it exited with code 1. something isn't correct with your configuration

Oh no! That would be from the init_script right?

Hi brian ! The Token that  you pasted is not a token

Please Generate a JWT Token using LiveKit Cli or any Server SDK

Hey there! Gave it a shot with the *proper* token this time (hehehe), but unfortunately turned up the same result.

Yesterday thay code was working but Today it's not working

I don't understand....what did you just say

Can you reproduce the issue on the sample app

Actually i am not that much familiar with github:neutral_face:

If i have to create new issue on GitHub then i can do that

But you can download the sample app code and run it correct?

I don't understand what reproduce? And how....

Do you see the same issue of data not being sent/received in the sample app?