This message was deleted.

hi john! we’re planning on releasing something that should simplify this this week!

Hello @polite-kilobyte-67570 - is it going to be announced somewhere?

yeah, We will post an update here in this thread and also in a message in #general!

Nice. Thanks!

we just made https://github.com/livekit/track-processors-js public where you can test this out!

Hi @polite-kilobyte-67570, Livekit is indeed amazing product so far. Love it. Do you have any update on thee direct support of using blur and virtual background processor in components-react?

@bumpy-queen-608 https://github.com/livekit/track-processors-js

Hi @high-exabyte-20673, Yes, I know this is the track processor but needs to manually publish the track. We are using react-component so it would be good to get it integrated.

hey, the work for this can be tracked in https://github.com/livekit/components-js/pull/534 it’s not quite finished yet

Awesome. Thanks @polite-kilobyte-67570. 🙏

Hi @polite-kilobyte-67570, thanks for making track processor public. 🙌 This makes it really easy to use. But compared to teams or google meet there is almost always some "margin" around the cut-out person. With enabled background image replacement, this results in seeing a "glow" of original background around the person. Is there a ways around or to improve it?

the quality difference wrt google meet and teams could be due to the fact that they have better models than the OSS version that mediapipe (google) provides. the only way you can adjust some of that glow on the background transformer is by playing with this value.

3px

seemed like a good compromise, but if you find out that other values work better for most cases, then we can consider updating this value

Thanks, I'll take a look 🙂

Hey! Just jumping in on this thread. Really exciting to see that background blur and virtual backgrounds are being worked on, with a view to them being fully supported - this is great news! 🙌 Having tried the pull request in

components-js

the integration with the components framework looks like it’s progressing well too - thanks for all the hard work on this one. A couple of questions: 1. Is there any likelihood of the pull request being resumed / reviewed / merged any time soon? 2. The results when testing the VirtualBackground are a little mixed - quite a lot of the actual background is bleeding through the background image. If I understand correctly, this is due to the quality of the mediapipe models. Is it likely that we’ll see some improvement in this space?

hi Tomos, 1. you should be able to use it already today within components-react, the PR that’s pending is only for the

meet

example. We’ll get back to that sometime later. 2. Unfortunately we don’t have a lot of influence on that. Those are the models that google provides for segmentation.

Background blur and virtual backgrounds are working nicely on Chrome. Thanks! However, it looks like there is no support on Firefox and Safari. Does anyone know if they will get support in the near future?

The underlying functionality that this relies on is currently only implemented in Chrome as

MediaStreamTrackGenerator

. However there are efforts across browsers to support this behaviour in a slightly adjusted way under the name

VideoTrackGenerator

. However, as of now, no browser implements this new interface without any special flags enabled.