LiveKit Community

It looks like example app is using unreleased code.

Can you try cloning <https://github.com/livekit/client-sdk-swift> to same directory as the example app’s repo

~/your-dir/<https://github.com/livekit/client-sdk-swift|client-sdk-swift>/
~/your-dir/<https://github.com/livekit/client-example-swift|client-example-swift>/

then open the `LiveKitExample-dev.xcworkspace` which will use the cloned repo. (main branch)

I switched to tag 1.0.12 and that builds and runs. I’m running the standard docker configuration. But I’m having trouble getting/sharing the token to get the desktop app talking with my iPad.

Umm, where is “tony_stark” coming from?

I suspect the iPad connection isn’t working because of the local network configuration.

We got there! Thanks everyone! :pray::heart:

congrats on launching Chris! you built this really fast.

Thanks! Its been really fun leveraging Livekit. Im continuing dev work, just need more help on the GTM side.

I just imported the package on Unity.  I get this error.

EntryPointNotFoundException: InitCopyPaste assembly:&lt;unknown assembly&gt; type:&lt;unknown type&gt; member:(null)
CopyPaste.Init () (at Assets/Samples/LiveKit WebGL SDK/1.1.3/Example/ExampleRoom/CopyPaste.cs:16)

Hey <@U03MSH39RPZ>, are you trying to use this package on other platforms than WebGL ?

<@U03CRDEDBDK>  I tried with WebGL only.  I got the error above.  Now I tried to export the build then I got the below error.

BuildFailedException: Incremental Player build failed!
UnityEditor.Modules.BeeBuildPostprocessor.PostProcess (UnityEditor.Modules.BuildPostProcessArgs args) (at &lt;1f0be198f5164d2489de92f22c998266&gt;:0)
UnityEditor.WebGL.WebGlBuildPostprocessor.PostProcess (UnityEditor.Modules.BuildPostProcessArgs args) (at /Users/bokken/buildslave/unity/build/PlatformDependent/WebGL/Extensions/Unity.WebGL.extensions/BuildPostprocessor.cs:158)
UnityEditor.Modules.DefaultBuildPostprocessor.PostProcess (UnityEditor.Modules.BuildPostProcessArgs args, UnityEditor.BuildProperties&amp; outProperties) (at &lt;1f0be198f5164d2489de92f22c998266&gt;:0)
UnityEditor.PostprocessBuildPlayer.Postprocess (UnityEditor.BuildTargetGroup targetGroup, UnityEditor.BuildTarget target, System.Int32 subtarget, System.String installPath, System.String companyName, System.String productName, System.Int32 width, System.Int32 height, UnityEditor.BuildOptions options, UnityEditor.RuntimeClassRegistry usedClassRegistry, UnityEditor.Build.Reporting.BuildReport report) (at &lt;1f0be198f5164d2489de92f22c998266&gt;:0)
UnityEngine.GUIUtility:ProcessEvent(Int32, IntPtr, Boolean&amp;)

Yes, I use the same version. Did you added the package from the package manager?

Yes, I created a new 3d project and then imported the package through package manager from git

I think there is something wrong with your project configuration. When a C# compilation fails, you should get another error so there’s something unrelated to LiveKit when you’re building

What are your build settings ? Can you send me a screenshot ?

I think the problem with CopyPaste can be ignored

" * This script is only used as a workaround for copying and pasting text into text fields,
 * as it is not supported by Unity on the WebGL platform. You can ignore it "

So, is this the main problem ?  "JoinMenu+&lt;StartPreviewCamera&gt;d__14.MoveNext () (at Assets/Samples/LiveKit WebGL SDK/1.1.3/Example/ExampleRoom/JoinMenu.cs:38)"

To debug the demo, which Scene should I run ?  Is it the JoinScene ?  or RoomScene ?

<@U03CRDEDBDK>   It worked on another computer with new unity installation.  Sorry for the trouble

<@U03CRDEDBDK> I ran the unity Join Scene successfully.  But I cannot connect to my local server.  (I could conned to my local server through your client at <http://example.livekit.io|example.livekit.io> ).  I do not know whats wrong.  After I press connect, camera gets disconnected and I see only the last video frame.  Nothing logged on the server.

This unity sample contains the complete Robot game or only the video call ?

It is working fine for me, did you check your browser console?

I will check that now.  Could you please tell me your  right version of unity 2021.3.1f1 .  Is your also ending with "1f1" ?

Yes, I have the same version :wink: ( The LTS one )

But I don’t think this should change anything

You are right, Console asked me to add the Room scene.  Now I am diverted from JoinRoom Scene to Room Scene

This is another repository: <https://github.com/livekit/client-unity-demo>

Thank you very much.  I will try and let you know.

I see the above UI now.   How can I connect my client to my server ?

<@U03CRDEDBDK>  I spent 3 days to make the Robot Demo work.  But no luck.  I get NullReferenceException for CameraProjection class

How to configure prefabs.  I thought they are ready to use!  I can configure the prefabs if You can tell me what should I do

But if you got a NullReferenceException, maybe the prefab of the camera project isn’t configured on the Player prefab

Yes, I did "build and run".  Then it ran on browser.  I go the same error

Click on the JoinHandler, the scripts should have all the variable configured with all the prefabs

If not, can you try to repull the repository?

<@U03CRDEDBDK> I am sorry again.  It works 100 percent.  In just one click

Reason:  I only extracted the unity-project folder to import in unity

Oh, it makes sense. Yes, you need to directly open the project on Unity :smile:

Now I open unity-project the whole repository.  Then it works

Is this always time consuming to build ?  Every time I build and run, it takes nearly 10 minutes.  Is "build and run" the only way to debug this ?

I have 16 gb ram.  When I run only unity on my computer, it hangs.

Yes, unfortunately, WebGL builds are slow on Unity. If you want to accelerate them, you can disable compression and enable the development builds

<@U022KB72NFJ>  Thanks.  Disabling compression accelerated the process.   Even for  every small change in the scene do I have to export a build and wait for couple of minutes ?

Ok.  Thanks a lot for your time and effort

Do you know why I cannot run it within Unity ?  Is that a limitation from Unity ?  If I can run it within unity, it will be much faster.  It will be impossible to BuildAndRun after every change.  I don't know how you developed this project in this way.

I tried to run it within Unity.  I get some errors like JSNative.pushMessage() method is not available.  But when I checked the generated code, the method exists.

<@U022KB72NFJ> Unable to import the <https://github.com/livekit/client-unity-demo> via unity Github import. I am getting the error, package manifest can't be found.

This isn't a package. This is a Unity project, download it and open it directly on Unity :smiley:

Tried it, But the connection is not established.
Meanwhile I tried the other sample.

Screenshot 2022-07-28 222547.jpg

Tried it, But the connection is not established.
Meanwhile, I tried the other sample, and the second screen is appearing like this.

Hi <@U03GAB3TP8F> :wave::skin-tone-4: 

We don't support it yet, but we plan to! :blush: 

<https://twitter.com/VocalSoftware/status/1545231740511301632> - Anyone a jazz fan? Used the Go Livekit server SDK with the help of <@U01KZ0SCDKL>, <@U01KZ61GV5Z>, and <@U02SGSET1RT> to build a music player into our virtual offices.

Hey Uma, you can check out our sample projects that do both video/audio. happy to point you to them if you can tell me the platform.

For audio-only, simply skip publishing video tracks. :slightly_smiling_face:

<@U02U3MSKYF7> Thanks for the reply.  I am sorry.  I wanted to ask about text chat ( not audio )

for text chat, you can use data channels to send messages: <https://github.com/livekit/client-sdk-js/blob/main/example/sample.ts#L335>

<@U01KZ61GV5Z>   Thanks a lot.  Can I send and receive files as attachments also ?

yeah, you can send any binary steam with it

Video Call with Random Stranger!!

Tech: Go <http://livekit.io|livekit.io> <http://centrifugal.dev|centrifugal.dev> Svelte

<https://ome.web8.is/>

Hey all, we just released livekit <https://github.com/livekit/livekit/releases/tag/v1.1.2|1.1.2>. For those of you that are experiencing connectivity issues with 1.1.0, please upgrade to this version.

Hey David, which Kube implementation are you using? this is likely a bug in the latest set of helm changes

I'm investigating this, it might be an issue with when we updated to autoscaling.v2. Will keep you posted

hey <@U02T8UUS3J8> this is fixed! turned out to be an issue with Kube 1.23+. I'll release a chart update shortly.

Or some other player. That is not working at the level of the sample of attach track to HTML video element.

Just release another side project

Anonymous Voice Chat App

Backend: Go
RTC: LiveKit
Frontend: Svelte &amp; KonstaUI

<https://voice.web8.is/>

Hello <@U03M86BE4H0>, I'd be curious to know what you are after exactly? What's your end goal? My gut feeling is the way to work this out is through egress but I could be wrong. If you want to join a room, then you'll need to configure the JS Player to work with the livekit JS SDK. it would require some custom dev / bridge Id say.

If I put on my web page a video and audio element, I have to style it myself. Video.js and Vime.js are well-known players. So I was wondering about connecting the LiveKit track to them.

I connected to the room. I have the track. Now I want the track to show in Video.js or Vime.js.

I do not believe egress is relevant here.

With video and audio HTML elements I do attach on the track.

I brought Egress because I think it can output RTMP stream which some of these Players could ingress, but now that I think of it.. I don't think browsers currently support RTMP streams straight up. So my bad on that one.

<https://videojs.com/guides/video-tracks/> Thats probably what you'd be looking for.

Keep in mind, if I recall correctly I think the LiveKit Team are working on an HLS solution. This said, Im not sure of the progress nor when will this be made available.

Been there. Want to get back there. Did not figure yet how to specify the source for the track. 

Hello <@U032TUAL4KT>, Video.js can be used with Livekit client JS SDK. As on the HTML it looks like a video element with some class. However, it shows an error message saying, “embedded videos are not supported”. And the player does not really look good. My code is like the sample in the client JS SDK. So for the meantime I decided to stick with plain video and audio elements. FYI

I see. To be honest, I've never tried any of those third party integration myself.

Hello <@U03PMN3FVRQ>, you'll need to get a token off any of the Server SDK,<https://docs.livekit.io/references/server-sdks/>, or through the CLI found here: <https://github.com/livekit/livekit-cli>.

As for the LiveKit URL, you'll need to deploy your own instance of LiveKit : <https://github.com/livekit/livekit>. Great information on how to deploy, can be found here: <https://docs.livekit.io/deploy/>

we are making progress on all platforms :slightly_smiling_face:

haha, i know, we are using flutter for the mobile version and mostly for the web soon, that’s why i asked

hello <@U03PS3FGYF5>!

LiveKit's Flutter SDK uses flutter-webrtc underneath. On the server side though, LiveKit is built using Go.

Yes, you can certainly use it for 1 on 1 calls, many do. What is your use case? LiveKit does provide a set of features that you don't get in 1 on 1. take a look at <https://docs.livekit.io/|our docs>

We're encountering some issues developing a Flutter web app that seem related to signaling complexity. As LiveKit is declared to be very simple, we're wondering if it would help to switch to LiveKit.

Ah yes, it should definitely be simpler with LiveKit. we expose higher level constructs while having our SDKs handle complexities with signaling.

Hello - I am very need for implementation of E2EE (WebRTC - frame encrypted/decrypted ) in Swift SDK and ready to pay for this features

Hi Thomas, which part in particular are you struggling with?

Hi :wave: 

Mostly with the backend side of things. Swift client seems like no problem. But we encounter a lot of track dropping, crashes and video quality limitations. Some problem might come from other part of our system linked to LiveKit but someone with hands on experience with LiveKit could be a great help for us. 

We can jump on a call with our dev team to deep dive and see what could be done. 

Cheers 



That’s pretty unexpected to hear. Are you seeing these issues when developing locally or is this happening with LK deployed somewhere?

Would be great to see some logs, is the crash on the server side ?

Hi there, I'm one of the developer working with Thomas

We are working with livekit with both the Swift client (which is mostly working now) and the Go server sdk acting as participant which streams the video of 2 cameras

To be able to see the 2 cameras at the same time, we publish 2 tracks for the same participant, using `pion/mediadevices` to get the video stream from the cameras.

And here begins our troubles, since it seems that livekit is doing some sort of congestion control (we see logs related to congestion detection) and starts to pause one of the 2 tracks (I suppose, it's not clear for us if a track is paused or just not working).

This happening when we deployed into produciton with about 10 participants.

Our other problem is that our go client seems to lose connection, or to not detect video source stream has ended. Which leads to the client not sending anymore the video, and not being able to restart it automatically

And this last problem already happens in our small test environments with only 2 participants.

Both environments are deployed using kubernetes, using UdpMux to have only one udp port

I have never been able to reproduce this problems locally on my dev machine.

I want to add that, apropos of the congestion control: We tried deactivating it entirely and just deactivating the functionnality that pause the track when congestion is detected. It did make thing a little bit better, but we still have track that go down

we have a lot of `2022-07-22T13:58:21.646Z	INFO	livekit	rtc/participant.go:873	connection quality not optimal	{"room": "nts-0-10", "roomID": "RM_AuP3222bfhNn", "participant": "redacted", "pID": "PA_AdgAT6mrBdfK", "remote": false, "totalScore": 7.99, "numTracks": 2, "rating": "GOOD", "publisherScores": {"TR_VCXdFiCbAhUsC4":3.97,"TR_VCY2VpQnTYkip2":4.02}, "subscriberScores": {}}`  on the livekit server also

Hey Assem, livekit would handle the in-call experience, but it doesn't currently handle "ringing" another user.

that's likely something you'd want to implement with push notifications on mobile platforms. When a user goes into the call, you'd join the livekit room then

Hey Richard, 1.0 was a major release for us and it did come with a couple of changes. We announced the release <https://blog.livekit.io/react-core-components/|here>.

In this particular case, the original options have been split into `roomOptions` and `connectOptions`. You can take a look at the various fields <https://github.com/livekit/livekit-react/blob/master/packages/components/src/LiveKitRoom.tsx#L12|here>.

Thanks! Appreciate you guys. Maybe you guys could consider declaring breaking changes in a few bullet points at the top of new releases :slightly_smiling_face:

yeah, we def need to get better about this moving forward

Currently it's not simple to publish WAV files from the client SDK. We are working on making this easier tho.

On the server side, you can currently do this by <https://github.com/livekit/server-sdk-go#publishing-tracks-to-room|publishing static files> via the Go SDK.

Hi <@U01KZ61GV5Z>! You mention it's not simple but it's possible right? Would it involve creating `LocalAudioTracks`  and publishing them?

hah yeah everything's possible :slightly_smiling_face: For swift, it's a bit involved because limitations in the webrtc SDK.

Hi David! Is there a high level overview on how we'd approach this? Or should we wait for the client to support publishing static files?

Livekit is awesome , thank you for the amazing documentation  :  )

image.png

I tried it out and it didn't seem to work for me, any idea why?

Hello guys, can i store video content on LiveKit server?
or is there a way to store stream video ?

yeah, you can use our recording stack, called <https://docs.livekit.io/server/egress/|Egress>

From the doc, I can see that it's possible to stream to other platform and store it on other platform but my aim is to Livestream and store to Livekit Cloud

ah I see what you mean. Today we do not host any videos for archival. You would need to provide your own cloud storage account for that.

We will support storage in the future though!

hi <@U03DUKK5K0T>:
<@U032TUAL4KT> has done fantastic work on a PHP server SDK here:
<https://github.com/agence104/livekit-server-sdk-php>

<@U03QQD55S74> This depends on your use case and what kind of load you are planning to support.

You can see some performance benchmarks <https://docs.livekit.io/deploy/benchmark/|here>.

Based on your requirements, you can choose a configuration. Performance wise, you can expect roughly linear scale, i. e. the benchmarks above were run on a 16 vCPU machine. So, if you were to use a 4 vCPU machine, you can expect roughly 1/4th the numbers.

<@U02CM28PB4Y> I have my first milestone of 100 meetings concurrently and in each meeting, there were 1 to 9 publishers and about 10 to 1000 subscribers

You can calculate the number of streams at the edges and figure out the minimum requirement.

Smallest case: 100 meetings x 1 publisher x 10 subscribers = 1000 video + 1000 audio streams. I think a 4 vCPU could be enough.

However you should measure in your deployment to ensure that it is okay.

<@U02CM28PB4Y> got it. Thank u so much for your assistance.