LiveKit Community

I'm a user &amp; minor contributor and not LiveKit staff. However, I consider it pretty stable. I was previously using Jitsi as a solution, and I've found LiveKit to be much more stable for my use case. The devs has also been very responsive in fixing issues that have cropped up.

My use case isn't mission critical for anything important (I'm using it for D&amp;D games :joy:), but if I needed an SFU for an enterprise app, LiveKit would be at the top of my list based on my experience so far.

same here, I'm just a user, and I find it better than supposedly production ready solutions like Intel Collaboration Suite for WebRTC (where I'm migrating away from). So far the issues I found on livekit, were very quickly fixed by the devs when I reported them, couldn't be happier so far.

<@U02C10ZEP8R> personal use or for a company? We use LiveKit at Astral TableTop as well!

<@U01TC9Z6ELD> Somewhere in between :slightly_smiling_face: I created a module for FoundryVTT to provide in-game A/V using LiveKit. I provide a hosted LiveKit cluster to users of that module if they sub to my Patreon, but they can always spin up their own instance and use it for free. So, not my primary business, but monetizing it a little bit.

hey Ash, we have a number of folks running all sorts of workloads on livekit today. (I hope to be able to talk about some of them very soon!). we take efforts to ensuring its stability and compatibility with clients.
so in short, yes. :slightly_smiling_face: we do consider it to be production-ready.

We’ve just deployed a production-ready app on LiveKit and couldn’t be happier. We’re testing it heavily and so far it’s the most reliable solution we’ve found.

I can just confirm what has been said so far: We‘ve been running LiveKit in production for about two months now and it’s been *by far* the most robust (and easiest to implement!) WebRTC solution we’ve evaluated, from open source to highly expensive enterprise „solutions“. The few issues we‘ve encountered have been addressed and resolved in an extraordinarily attentive and timely manner that I have yet to experience with any premium class support contract. 
I‘m aware that this reads like an ad but I‘m really just very, very grateful for what the team has done so far and I guess every new user contributes to their well deserved success.

Just gotta rebuild LiveKit in Elixir and it'll be even more stable

If two participants with the same identity connect, the oldest one will be kicked, I believe.

I'm using the uuid package for identities but I'll add a fmt.print to make sure that the identity in the token generation is different for everyone

you were correct. i guess im not parsing the json correctly because the server is not seeing an identity string, but the client is sending one.

that was it. i think the json parser in gin gonic suffers from the same problem as every other json parser where the deserialized variable name cannot be the same case as the json field name. I was passing a json map with a field name uuid and trying to save that to a variable named uuid. It did not like that. Had to change the variable to Uuid and then it worked fine.

<@U02KRGALLKV> The flickering happens when the RTCVideoRenderer is rebuilt on UI updates. To avoid that what I do is to set autoSubscribe to false in connect(), because autoSubscribed tracks don't trigger a "TrackSubscribedEvent". Instead: after joining the room I iterate over each participant's video trackPublication and set the publication.subscribed=true. That indeed triggers the TrackSubscribedEvent.

And now you can create and initialize the RTCVideoRenderer on TrackSubscribedEvent and dispose it on TrackUnsubscribedEvent.

no more flickering that way. I've tried it on flutter (iOS, Web &amp; Android) it works perfectly

sorry to take so long to respond. I get what you're saying here, but does that help in the event that room updates are causing the flicker and not just subscribes? like, when someone changes to be the active speaker in the room (mic level changes), that triggers the room object to update which triggers setstate which rerenders my rtcvideorenderer in my case.

any update to the room object triggers a setstate in my case, but at the same time, I would think that you would want to call setState after every update to the room object, assuming it is a stateful variable. maybe not? maybe you don't need to call setstate unless you want to trigger a rerender? im still new to flutter state management so i guess that's the missing piece for me to kinda get this together.

yes, I keep using setstate to redraw the widgets whenever a room event occurs, active speaker, etc.. and it doesn't flicker, because my RTCVideoRenderer's are not reinitialized on each change.. that's why I use the track subscribed/unsubscribed events to create/dispose each renderer.

Here's the class I use to store the RTCVideoRenderer
<https://dartpad.dev/?id=45748bff491f7771f5cac3f3c8469d3b&amp;null_safety=true>

I create a List&lt;VideoRenderer&gt; on my room controller, then on the TrackSubscribedEvent I add an instance of VideoRenderer to the list.. then I dispose it and remove it from the list on the TrackUnsubscribedEvent

and then you can iterate that list, filtering however you may need, to create a widget for each renderer

okay, that makes sense. i just need to find a way to separate my render logic such that the vidoerenderers only rerender when the list of participants is updated, which would happen only on track subscribe and track unsubscribe and then the room and the participant audio can change all it wants

thank you very much. I would have not been able to figure all of that out on my own

<@U02KRGALLKV> no problem, you can also create some getters to make it easier to work with. like:
``` VideoRenderer? get localRenderer =&gt; videoRenderers.firstWhereOrNull((v) =&gt; v.participant is LocalParticipant);
List&lt;VideoRenderer&gt; get remoteRenderers =&gt; videoRenderers.where((v) =&gt; v.participant is RemoteParticipant).toList();```

then you have localRenderer and remoteRenderers getters to use on your views/widgets

you can also make the remoteRenderers getter more advanced, sorting the renderers based on participant's status (is speaking, audio level, last time it spoke, if it has video, etc) just like _sortParticipants() in <https://github.com/livekit/client-sdk-flutter/blob/main/example/lib/pages/room.dart>

I fixed it! Thank you! No flickering :smile:

thanks <@U02JMAJ1ZAQ>, and Welcome! I think we'll be cutting out a new version this week. Finishing up a few solid improvements. cc <@U01NZKTNE1H>

Hey <@U02JMAJ1ZAQ>, sorry about the delay, the v0.7.0 release has been uploaded to sonatype and should be propagated to maven central within a couple hours

<@U01NZKTNE1H> awesome, I've noticed your new version this morning too. Thank you.

hi <@U02LFDQ09D4>, in order to be able to access your LK server from another host, you will need to have SSL termination

for that, you should be able to purchase an SSL certificate for a domain that you control, and set up Nginx for SSL termination

we don't have any guides to do this, but you should be able to adapt this Nginx configuration for your needs: <https://github.com/livekit/livekit-server/blob/master/deploy/livekit.nginx.conf>

ah! I see your other thread now, where it looks like others already put you in the right direction

I haven't used Cognito before, but does it support shared secret JWTs? if so, I suppose you could configure it to use the same secret as livekit.

At the moment, the server doesn't support JWKS or public/private key encryption. Though we'd welcome contributions to that effect!

Otherwise, you could have a Lambda function that authenticates the Cognito JWT and then creates a LiveKit token.

Thanks for your input! Could you point me in the right direction within the LiveKit code, if we could contribute towards handling JWKS?

yeah so there are a few spots:
1. implement a key provider to allow server to load the public key or JWKS: <https://github.com/livekit/protocol/blob/main/auth/interfaces.go#L20>
2. implement verification of such a key: <https://github.com/livekit/protocol/blob/main/auth/verifier.go>

lKit.png

you need a <https://docs.livekit.io/deploy/#domain-ssl-certificates-and-load-balancer|SSL cert> when it's deployed.  Browsers only allow you to connect to insecure websockets when it's localhost.

Hi David, do you mean it should look as either <wss://publicIP:7880> or <https://publicIP:7880> ? Is there a documentation how would I apply the SSL cert to to server codes?

lKitC.png

Something is weird, I have successfully port forwarded the client app. As per the screenshot attached, my client IP is not secure, its running on http and it works well as long as im using <ws://localhost:7880> or <http://localhost:7880>. So, how to i make my server available to my clients using something like <http://publicIp:7880>. Or, its runs only with an SSL cert? or my server and my client scripts must be hosted on 2 different IP address? Thank you

as soon as you want access to user devices (like microphone or camera) you will need a SSL certificate (and domain). that's a browser security policy. What you need is described in the docs that david has linked for you.
the fact that it works without a SSL certificate on localhost is an exception of the browser security policy for local development only.

Hi, I am quite new in this field. Okay I have a free domain that is running on <HTTPS://xxxx.tk> . Do I have to generate the SSL certificates or once its included in the HTTPS im okay? Now, how to point my localhost <http://localhost:8080> to <https://xxxx.tk> ?

The basic setup you will need:
• some sort of server (VPS is enough) that runs livekit-server
• a DNS entry that links your domain to the public IP address of that server
• a SSL Certificate on the server that is valid for your domain (you could use certbot)

I mean, I want to run the whole systems through IP systems. For the moment, I am using Ubuntu 20 and how can I create a DNS example for <https://xxx.tk> towards <http://localhost:7880>? Where do I place the SSL certificate afterwards? Can you provide some configurations through pictures? Thanks

<@U02LFDQ09D4> you need to point your dns to a public ip address (not localhost) and install a reverse proxy with SSL certificates that will listen on port 443 and forward the requests to your livekit server (localhost).. you can use nginx as reverse proxy, here's an example of the configuration for it <https://raw.githubusercontent.com/livekit/livekit-server/master/deploy/livekit.nginx.conf>

Hi. From my experience and testing abilities, try to use Ubuntu instead of Windows OS. Its less complex and easy to manipulate if there is error.

I'm not a Linux pro, so is this a correct command line syntax  in Linux?   LIVEKIT_KEYS="&lt;api-key&gt;: &lt;api-secret&gt;" ./bin/livekit-server --dev

<@U0294KT11T2> we have built a Vue app with the JS SDK, it’s pretty straightforward

<@U02EJ2AP755> wanna extract that into a Vue SDK and open source it?

That is my plan actually, just a little under the weather right now but I’ll get to it in the next two weeks

livekit-flyio-metrics.json

I made a quick one built for LiveKit running on <http://fly.io|fly.io>. Should be easy enough to adapt for other environments.

I'll check it out once I finish my project, looks great

I got one we've been using internally at LiveKit. Maybe I can publish it to GitHub for others.

<@U02C10ZEP8R> <https://github.com/livekit/livekit-server/pull/188>

<https://grafana.com/grafana/dashboards/15236>

<@U02BBTRGF98> Nice. The values in Participant Connections seem odd to me, they are all super low fractional values like 0.0467. I noticed that when I was making my graph as well and am not sure what to make of the data.

its a "rate" per 5 minutes. I _think_ its right unless you have tons of users constantly making connections

I'm still not sure how it ends up with such small values, though. If 5 users join within a 5m time period, wouldn't `rate(...)[5m] be "5" for the timespan that they joined? Maybe I've just got the way that works mixed up in my head. At the moment, the values that are listed seem rather meaningless with the exception of "the graph went up" or "the graph went down".

<https://prometheus.io/docs/prometheus/latest/querying/functions/#rate>

so 5 users join in 5m it should be 5 / (60 * 5) = 0.016667

Okay, this makes for values that make sense for my graphs: `sum(rate(livekit_node_service_operation{status="success", type="participant_join", app=~"$app"}[$__rate_interval])) by (app) * $__rate_interval`

and this fits for the first query in your Participant Connections graph `sum(rate(livekit_node_service_operation{status="success"}[$__rate_interval])) by (type) * $__rate_interval`

I threw my <http://fly.io|fly.io> version up on grafana's repo: <https://grafana.com/grafana/dashboards/15237>

<https://github.com/livekit/livekit-server/blob/master/LICENSE>

I think I've found here: <https://docs.livekit.io/server-sdk-js/classes/roomserviceclient.html#updateroommetadata>

But using that method we can update data after create. Will be better if we can add metadata during create room like:

`const opts = {`
  `name: 'room-id',`
  `// timeout in seconds`
  `emptyTimeout: 10 * 60,`
  `maxParticipants: 20,`
  `metadata: {`
    `title: 'Room Title',`
    `params: {`
      `'test': 01`
    `}`
  `}`
`}`
`svc.createRoom(opts).then((room: Room) =&gt; {`
  `console.log('room created', room)`
`})`

what a coincidence, I was looking for the same thing today
+1 to the request :+1:

I've added ticket here: <https://github.com/livekit/livekit-server/issues/196>

hey Sayan, you can change the audio level of individual tracks on the receiving end. once the track is bound to an element for playback, you could change its <https://developer.mozilla.org/en-US/docs/Web/API/HTMLMediaElement/volume|volume> property

O thanks David. I have tried this previously with other MediaStream and seems to be a browser bug that doesn't allow the volume controls to work properly with RTCPeerconnections click <https://blog.twoseven.xyz/chrome-webrtc-remote-volume/|this> for more details. Though I haven't tried it with LiveKit will give it a try.

ah that's interesting. we will check it out.. it'd be great to have the SDK support this natively though.

Yaa it would really be helpful to have SDK support for this feature!!!!

<https://github.com/livekit/livekit-recorder/pull/23>
my first collaboration to the project :partying_face:

Hi <@U02KRGALLKV>! native macOS support will be available soon with our Swift SDK <https://github.com/livekit/client-sdk-ios>
Additionally, we have plans to expand support for macOS/Windows with our Flutter SDK :slightly_smiling_face:

yeah, we do plan to add support for MacOS/Windows in the near future. Windows support is fairly new in flutter-webrtc, getting better very quickly

<@U02KRGALLKV> until there's windows support for livekit, what I do is make a web build on flutter, and then a simple electron app that provides a static webserver for the web build and opens a electron window to that webserver.. not ideal, but it works

Update: We released Flutter/macOS initial support <https://pub.dev/packages/livekit_client> :slightly_smiling_face:

Y'all are great and there is a big thank you section in my app dedicated to y'all and the other OSS we're using for this project

I had the same requirement, and made a quick and ugly change for setting the URL as environment variable, it's not pretty, but it works <https://github.com/alex-bluetrain/livekit-recorder/commit/6d16ac439601c4a6045a11a03231be51517a2be6>

then I just set the RECORDER_SITE_ADDRESS environment variable in my livekit-recorder container

PRs are always welcome if you have the time. GitHub issues are good too, although GitHub issues for feature requests might take us a bit longer to get to since stability/reliability is our main focus

That's hilarious, <@U02HN8GPUBY> !  I was looking at `proto` and trying to figure out how to tie it together, got intimidated and thought "maybe to get by for the moment, I'll just hack in an environment variable."

<@U01UB0LHTTQ> I think a proper fix would be the way I and my team would prefer to go - so I'll try and set how to do it correctly in the next little bit and then put up a PR to keep us out of fork-land, longer term.  I'm thinking something like `server_url` in the `template`, where it'll fall back on the current hardcoded value if one is not supplied.

If I read it right (long time programmer, first time golang programmer), there needs to be a change in the <https://github.com/livekit/protocol/blob/9ba7d5ce77ac1d8a9001ec76032dee11bb404323/proto/livekit_recording.pb.go#L209|RecordingTemplate> and the <https://github.com/livekit/livekit-recorder/blob/main/pkg/recorder/request.go#L100|GetInputUrl function> .

It might be cleaner (and simpler) to just add a `recorder_address` to the config with a default of `<https://recorder.livekit.io|https://recorder.livekit.io>` than to add it as request field - if someone wants it changed, chances are they want it changed for every request

For my get-me-through-the-night solution, I may just steal your implementation <@U02HN8GPUBY>, if that wouldn't be unfriendly, and customize that.

<@U02HN8GPUBY> <@U02MN6G6HPW> this was a quick one so I threw it in:
<https://github.com/livekit/livekit-recorder/commit/59d18585fcce8622ce94d0660e1c7417aa32e5d0>

Nice <@U01UB0LHTTQ> that's better looking than my env hack :smile:

Brilliant, <@U01UB0LHTTQ>.  I was almost ready to push mine up - but it's essentially the same, and of course you've got some extras in there.  Thanks so much.

For <https://github.com/ct7t/livekit-recorder/commit/e0abcd7f515e25f6373dce7022cab1bd5539e000?diff=unified|comparison> , but of course I'll take <@U01UB0LHTTQ> 's

Tried it out.  Works a treat.  :raised_hands:

at-the-tavern-logo.png

Not sure if it fits what you are looking for, but I'm using LiveKit to add a better A/V chat client to FoundryVTT as a module (FVTT's plugin system). I don't have a formal page around it yet, but this is the project source page: <https://github.com/bekriebel/fvtt-module-avclient-livekit>

I also run a LiveKit server cluster that I provide to subscribers of my Patreon. This is for those who are using my module but don't want to run their own server or want to help support my work on it: <https://www.patreon.com/bekit>

Let me know if this is something you'd want to have listed. I've been meaning to spin up a site under the moniker "At the Tavern" (my livekit cluster uses the domain `<http://tavern.at|tavern.at>`). I did recently start up a community Discord for my patrons and created a quick logo for it at least.

yup, you could use the cli or go SDK to publish to the room: <https://github.com/livekit/livekit-cli#publishing-to-a-room|https://github.com/livekit/livekit-cli#publishing-to-a-room>

nice! I wonder how I missed that one :wink:

ahh, I've been looking for the equivalent on server-sdk-js which lacks the "interacting as participant" features of server-sdk-go, I'll just write it in go :+1:

the media interactions require a WebRTC engine. with pion it was pretty easy to add in Go

There isn’t a C++ version today, but our aim is to eventually have native integrations across all platforms.

Thank you very much for your reply. From your work plan, when will the C++ version be released?

<@U02PFLUCZ08> there isn’t a set timeline for it yet, as right now we’re focused on having the best and most reliable SFU and existing sdks. Our Unity SDK was community driven (shoutout to <@U01UEMQ8C3F>), so if you wanted to get started on it we’d be happy to add it to the project in the same way

Okay, I'm very glad that you can have such a good way to drive projects. I look forward to the birth of the C++ version. We will also be deeply involved in community building to make livekit more cool.

<https://ws.wemeta.team/> returns 502 bad gateway

Sorry, I closed the service earlier, you can visit now

give it a try with the connection tester: <https://livekit.io/connection-test>

i tried it and got this : <http://meta-cdn.wehome.cn/cmn/png/META-H8UKVHWU-7ESV38P3YQVD03IQP2KI3-CAK6TLWK-0.png> ，this is my config.yaml content about "turn" ： <http://meta-cdn.wehome.cn/cmn/png/META-H8UKVHWU-7ESV38P3YQVD03IQP2KI3-5TP8TLWK-1.png>，and this is my boot cmd : "<http://meta-cdn.wehome.cn/cmn/png/META-H8UKVHWU-7ESV38P3YQVD03IQP2KI3-KPEATLWK-2.png>"

i'm very sure my firewall is fully opened

屏幕快照 2021-12-01 上午10.27.23.png

I got it，now i test the group-chat well，But there is still an error message, "Can connect via TURN✗",Is it necessary to configure a layer 4 load balancer in front of tcp port?

still seems like a set up issue.. can you check <chrome://webrtc-internals> after connecting to see what `iceServers` it's reporting?

i configured a layer 4 load balancer in front of tcp port , now i  solved the error，Thanks for you supports!

having a server timestamp would make it easier to sequence. I'll approximate uniqueness, but wouldn't guarantee it.. perhaps there could be some sort of event id too

filed issue: <https://github.com/livekit/livekit-server/issues/230>

:wave: Hi everyone!
I'm MERN stack developer. A month ago I decided to develop a remote collaborative eLearning platform so I started learning WebRTC and I found that developing such kind of server will take long time than I imagined (A lot of complexity). So I started searching for some 3rd party services like Twilio TURN server, Zoom video sdk ..etc but the Cost of using their service in my case will not be affordable .

Few days ago, I started searching for an open source server and the surprise is LIVEKIT project. This project has all what I need to start developing my platform.

Really I want to thank you from my heart. and once I finish my project I'll contribute in the React section.

Thanks again

is v0.10.3 protocol on recorder compatible with v0.10.5 protocol on server ?

yes, it’ll work as long as everything is v0.10.3 or higher

hi, we don't have a date in mind. We'd like to build one, but it's not the top priority currently. Neil has graciously started contributing to one; but only to scratch his own itch. If you are interested in helping to take it further, we are available to guide you through that.

thanks, may be i can do it by myself, then contribute to livekit community

about the video not being playable, I compiled my own version of livekit-recorder with this change to make it work:

add this to line#98 of <https://github.com/livekit/livekit-recorder/blob/main/pkg/pipeline/input.go|pkg/pipeline/input.go>
```x264Enc.SetArg("dct8x8", "false")```


I will try that thanks man. But the output is weird, where is the 16 FPS coming from :sweat_smile: ? The sample rate also did not catch from setting (48000) etc... Any idea why? The code seem to take them all in but somehow did not make it effective...!

16 FPS sounds like it couldn't keep up (usually because not enough CPU). Preset ignores all other options so audio frequency is 44100 as intended

<https://github.com/livekit/livekit-recorder#config>

Screen Shot 2021-12-09 at 5.46.05 PM.png

<@U02HN8GPUBY> is that the only change you made? That property is false by default

<@U01UB0LHTTQ> yup, here's the mediainfo from each (original and mine)

original livekit-recorder
```Encoding settings                        : cabac=1 / ref=1 / deblock=1:0:0 / analyse=0x3:0x113 / me=hex / subme=2 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=0 / me_range=16 / chroma_me=1 / trellis=0 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=6 / threads=4 / lookahead_threads=4 / sliced_threads=1 / slices=4 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=0 / weightp=1 / keyint=100 / keyint_min=10 / scenecut=40 / intra_refresh=0 / rc_lookahead=0 / rc=cbr / mbtree=0 / bitrate=750 / ratetol=1.0 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / vbv_maxrate=750 / vbv_bufsize=450 / nal_hrd=none / filler=0 / ip_ratio=1.40 / aq=1:1.00```
with dtc8x8 off
```Encoding settings                        : cabac=1 / ref=1 / deblock=1:0:0 / analyse=0x1:0x111 / me=hex / subme=2 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=0 / me_range=16 / chroma_me=1 / trellis=0 / 8x8dct=0 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=6 / threads=4 / lookahead_threads=4 / sliced_threads=1 / slices=4 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=0 / weightp=1 / keyint=100 / keyint_min=10 / scenecut=40 / intra_refresh=0 / rc_lookahead=0 / rc=cbr / mbtree=0 / bitrate=750 / ratetol=1.0 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / vbv_maxrate=750 / vbv_bufsize=450 / nal_hrd=none / filler=0 / ip_ratio=1.40 / aq=1:1.00```
see the 8x8dct=1 on the original, somehow it's not disabled by default

Woah, interesting. Is your reason for turning it off to play recordings on Android (or some other device that can't handle high profile)?

I only tested them on windows, and I was only been able to play them back on vlc, so I needed to change that for more compatibility with the customer trying to display the video output easily

Got it. I do plan on finding more compatible defaults (I don't think these recordings can play on Android), and I'll probably end up including a `profile` option, but I'll put this change into the next release if I don't get to it by then

<@U01UB0LHTTQ> I run it on a dual Xeon 54 cores, 1T RAM mate, SSD all the way, I think  it is more than enough, and almost nothing is running on that beast while recording. Gotta be something else ?

<@U01UB0LHTTQ> Is it possible to use PyAv to write recording instead ?

<@U02Q369F4BF> I'll see if I can reproduce. Our integration tests check fps using ffprobe but I might need to add more tests with different parameters

PyAv would be a full rewrite, we also use gstreamer instead of ffmpeg because it gives us better error handling

Hi y'all I was wondering how to troubleshoot the publishData method of livekit_client

No, just the standard data channel as far as I'm aware. I tried to stay close to the example implementation, so I'm sending a string encoded to a list of ints with the utf8 package

is this the flutter SDK? someone else reported an issue with sending data there: <https://github.com/livekit/client-sdk-flutter/issues/44>

could you try publishing data from the server SDK? just to isolate if it indeed is the issue

Can confirm. When sent from the go server a datareceived event is triggered and i can see the content of the data

It appears to be an issue with the flutter sdk

ah ok, i'll reopen the issue.. we'll look into it!

sounds good. if you need me to submit a MWE to recreate the issue, let me know.

I’m investigating this issue now :slightly_smiling_face: