LiveKit Community

Interested to see what the numbers look like for video-stack as a service platforms like agora/twilio. I’ll check out their numbers.

yeah, Twilio crushed it last quarter too.. Agora is going through the clubhouse effect rn

Clubhouse effect as in blowing up? I personally feel like the clubhouse valuation is extremely premature but I’m not a VC/angel and still have a lot to learn when it comes to forecasting companies like clubhouse 

clubhouse using agora, generating sig. revenue for them.. and inspiring others to build audio apps on top of agora

Aha right. That’s how I heard about agora. Their 2021 results will be :rocket: 

What does the 2021 roadmap look like for livekit, if you don’t mind me asking?

Will there be a livekit cloud by the time you launch? Or will customers host themselves? And have you guys decided on pricing/licensing?

I’m so excited to watch this ship take off

those are all options, but haven't decided on them..

we won't hold up launch for it tho.. but trying to get a few folks like you guys successful with a production deploy before we go out

Step 1 Launch
Step 2 1B :rocket:
Step 3 Buy agora for fun

just released `0.5.7`. Use this instead of 0.5.6 as it had a regression from upstream.

<https://vectorly.io/docs/docs-page.html#section-1|https://vectorly.io/docs/docs-page.html#section-1>

yeah, def. I think it's pretty straight to make the javascript SDK work with react native

to help us get a better idea on timelines, i'm curious to know if this is something that your team is going to be working on and if so, how much of a priority is it for you guys?

hey, this isn't on our radar at the moment.. but we'd welcome contributions!

happy to help guide your folks if this is the path you are going down

would these imports need to be in the sdk? 

I think it *should* be ok with `registerGlobals` <https://github.com/react-native-webrtc/react-native-webrtc#registerglobals>

chances are it will still require some modifications to the SDK depending on the environment. so LK wouldn't try to call a function that isn't supported on RN

ok we’ll try to do some exploration, probably send some thoughts here so you guys can help guide us (if needed)

looks like this is working well so far, thanks for the recommendation!

what's awesome! did you have to change anything?

quick update on trying the `registerGlobals`:

1. Client can connect (react native iphone)
2. New participants are detected through `ParticipantConnected` events
3. New tracks are detected through `TrackPublished`
4. No `TrackSubscribed` events are fired

here's the `TrackPublished` event:

``` room event trackPublished {"_events": {"muted": [Function anonymous], "unmuted": [Function anonymous]}, "_eventsCount": 2, "_maxListeners": undefined, "isMuted": false, "kind": "video", "track": undefined, "trackName": "Reincubate Camo", "trackSid": "TR_THGcPNj8fQaT"} {"_events": {"metadataChanged": [Function anonymous], "trackMessage": [Function anonymous], "trackMuted": [Function anonymous], "trackPublished": [Function anonymous], "trackSubscribed": [Function anonymous], "trackSubscriptionFailed": [Function anonymous], "trackUnmuted": [Function anonymous], "trackUnpublished": [Function anonymous], "trackUnsubscribed": [Function anonymous]}, "_eventsCount": 9, "_maxListeners": undefined, "audioLevel": 0, "audioTracks": Map {"TR_NeUESYNi9hBB" =&gt; {"_events": [Object], "_eventsCount": 2, "_maxListeners": undefined, "isMuted": false, "kind": "audio", "track": undefined, "trackName": "", "trackSid": "TR_NeUESYNi9hBB"}}, "dataTracks": Map {}, "identity": "0xFFC80bd2A413f37E125D39C281Cc85B88dcebF20", "metadata": {"email": "<mailto:abe@asmibo.com|abe@asmibo.com>", "name": "Abe", "role": "admin"}, "participantInfo": {"identity": "0xFFC80bd2A413f37E125D39C281Cc85B88dcebF20", "metadata": "{\"email\":\"<mailto:abe@asmibo.com|abe@asmibo.com>\",\"name\":\"Abe\",\"role\":\"admin\"}", "sid": "PA_JYn2FF8tWCCD", "state": 2, "tracks": [[Object], [Object]]}, "sid": "PA_JYn2FF8tWCCD", "tracks": Map {"TR_NeUESYNi9hBB" =&gt; {"_events": [Object], "_eventsCount": 2, "_maxListeners": undefined, "isMuted": false, "kind": "audio", "track": undefined, "trackName": "", "trackSid": "TR_NeUESYNi9hBB"}, "TR_THGcPNj8fQaT" =&gt; {"_events": [Object], "_eventsCount": 2, "_maxListeners": undefined, "isMuted": false, "kind": "video", "track": undefined, "trackName": "Reincubate Camo", "trackSid": "TR_THGcPNj8fQaT"}}, "videoTracks": Map {"TR_THGcPNj8fQaT" =&gt; {"_events": [Object], "_eventsCount": 2, "_maxListeners": undefined, "isMuted": false, "kind": "video", "track": undefined, "trackName": "Reincubate Camo", "trackSid": "TR_THGcPNj8fQaT"}}}```
if we could get the `TrackSubcribed` event working, we should be able to render publications which gets us 90% of the way there on react-native

it looks like the `react-native-webrtc` library uses a different callback fro new tracks?

<https://github.com/react-native-webrtc/react-native-webrtc/blob/765952ced72c566654d9cab6ab611e003082104e/MediaStream.js#L24>

also found this in the ios bridge <https://github.com/react-native-webrtc/react-native-webrtc/blob/a1c4ded7321c85fb881ec6a78118a330699d1064/ios/RCTWebRTC/WebRTCModule%2BRTCPeerConnection.m#L457|https://github.com/react-native-webrtc/react-native-webrtc/blob/a1c4ded7321c85fb88[…]18a330699d1064/ios/RCTWebRTC/WebRTCModule%2BRTCPeerConnection.m>

<https://github.com/react-native-webrtc/react-native-webrtc/issues/433> maybe related?

ah yes.. this uses `<https://developer.mozilla.org/en-US/docs/Web/API/RTCPeerConnection/addStream>`

an older API.. we can probably get livekit to support it..

I can spend some cycles on tuning the engine.. if there's an easy way for me to test this

I can share our react native project with you if you’d like

it'll be really helpful to have a react-native version of the LK sample app.. if you are able to help with that.

It doesn’t contain any sensitive info so I don’t see a problem with sharing it

In the meantime if you’d like access to our app just lmk, could save you some time

just something that can sit inside the client sdk repo, so we can use it to verify future releases

<https://github.com/livekit/client-sdk-js/pull/8>

if you're running on ios, open `ios/livekitsample.xcworkspace` with xcode and run the project

all the app does right now is hook into the events. Once the `TrackSubscribed` gets fired correctly I'll update the sample so that it shows the streams

and add the mute audio/mute video buttons similarly to the sample app, and maybe chat too

Here’s what it looks like on my iPhone 12 mini 

please lmk if there's anything else I can do to help get this working

nice this is awesome. I'll take a look at this tonight/tomorrow

1. this project is not actively maintained, missing a bunch of APIs that we end up relying on.


2. they use the now deprecated onaddstream callback to process streams. while it's not ideal, it's not a big deal to support this in LK.

3.  the current blocker is <https://github.com/react-native-webrtc/react-native-webrtc/issues/738> where when a remote participant publishes both audio and video, it's only able to receive one of them.

due to the state of react-native-webrtc lib, I think this isn't going to be a simple port and adapt. will likely involve diving deeper into RN-webrtc stack to resolve some of these bugs

I pushed the livekit work-in-progress to `react-native` branch if you guys want to take a look

<@U01KZ61GV5Z> is there any chance you could release that branch to <http://npmjs.com|npmjs.com> as a preview package so we can install it easily?

hey Abe.. how does that work? I'm not too familiar with how that's done

You should be able to just publish the package and use a “react-native” as the version

would it be simple for you to pull it down locally? and reference as a `file:../client-sdk-js`

I tried that but it’s complicated to bundle a local module with react native, from what I could tell. We’re you able to do that on the example project I pushed?

I'm hesitant to rely on pushing to NPM as a dev validation process

yeah.. it worked fine on the example project

Oh, perfect! I must’ve overcomplicated it. I’ll look at the example project

I had an odd import error that kept cascading to a dependencies dependency over and over

yeah just do a `yarn build` in the client-sdk directory

I found that it doesn't always refresh.. so I had to delete the `node_modules/livekit-client` directory manually between changes

call me crazy but audio is coming in for me

I'm not sure how much effort.. but didn't have enough time to dig in

I have a user called in and both audio and video and streaming to to the device

adding publishing now but ya, first subscriber is working fine

both audio and video going to the device?

when I tested.. only one of the tracks went through

the networking on emulators is very diff from a real device

perhaps a livekit bug: only the first publishers tracks trigger a `TrackSubscribed`

I called in with a second user and don't see the event firing

the bug is only the first track from a participant.. will fire the subscribed event

for the first _publisher_, all tracks get subscribed to fine, for all future publishers, the track doesn't subscribe

so for the first user, I do in fact see 2 tracks, one audio one video

the bridge for android vs ios looks different for the `addStream` function

notice in the ios bridge it takes a streamid as a number <https://github.com/react-native-webrtc/react-native-webrtc/blob/a1c4ded7321c85fb881ec6a78118a330699d1064/ios/RCTWebRTC/WebRTCModule%2BRTCPeerConnection.m|https://github.com/react-native-webrtc/react-native-webrtc/blob/a1c4ded7321c85fb88[…]18a330699d1064/ios/RCTWebRTC/WebRTCModule%2BRTCPeerConnection.m>

not that link, this one <https://github.com/react-native-webrtc/react-native-webrtc/blob/a1c4ded7321c85fb881ec6a78118a330699d1064/ios/RCTWebRTC/WebRTCModule%2BRTCPeerConnection.m#L115|https://github.com/react-native-webrtc/react-native-webrtc/blob/a1c4ded7321c85fb88[…]18a330699d1064/ios/RCTWebRTC/WebRTCModule%2BRTCPeerConnection.m>

on android it takes a mediastream object <https://github.com/react-native-webrtc/react-native-webrtc/blob/268933f82ebca295e769d6c54085b22cb2bd47e0/android/src/main/java/com/oney/WebRTCModule/PeerConnectionObserver.java#L64|https://github.com/react-native-webrtc/react-native-webrtc/blob/268933f82ebca295e7[…]src/main/java/com/oney/WebRTCModule/PeerConnectionObserver.java>

if you have an xcode project that uses most of the functionalities of livekit that would be awesome. If that does not exist then something that uses the most basic functionalities would also do. Would you be able to share such a project/codebase with me?
My goal here is to evaluate the possibility of building a React Native bridge from native Ios/Android libraries.. This is sort of a plan B to the react-native-webrtc approach thats being currently worked on.

yeah, I can share a test project that we have.

this repo should give you an idea of how it works on iOS: <https://github.com/livekit/ios-test-apps>

all of the client docs can be found here: <http://docs.livekit.io/references/client-sdks>

Thanks David, this should be good enough for me to get started

Screenshot 2021-03-30 at 10.37.10 PM.png

I have just cloned the repo and opened <https://github.com/livekit/ios-test-apps/tree/main/LiveKitApps.xcworkspace|LiveKitApps.xcworkspace> in Xcode

Screenshot 2021-03-30 at 10.47.01 PM.png

fixed by adding print stubs for unimplemented methods

soon, we'll be making a bunch of these optional, so you won't have to do this :slightly_smiling_face: