This message was deleted.

this is a really interesting idea.. we don't currently support it natively, but would be interested to add the capability into the SDK. are you interested in collaborating on this?

I’m definitely interested, at least for JS SDKs 😍 On our project using LiveKit we’re working with Audio API and AudioWorklets anyway for volume monitors. So it’d be great to generalise that and make it part of LiveKit 👍

that'd be awesome! CC: @polite-kilobyte-67570 maybe this could be part of a local media plugin where observers could be added/etc.

that sounds like a nice idea! we have an open issue for the general functionality on GH: https://github.com/livekit/client-sdk-js/issues/509 Regarding the custom plugins, we currently have experimental APIs to insert webaudio nodes into the remote tracks’ audio flow, but haven’t explored the local path yet. would make sense to model it in a similar way. @limited-flower-94405 do you think something like this (for local tracks) would be sufficient to connect the worklets you have? https://github.com/livekit/client-sdk-js/blob/main/src/room/track/RemoteAudioTrack.ts#L154-L164

@polite-kilobyte-67570 Yes that’d be sufficient, together with option to pass own

AudioContext

(I saw that you’ve added that recently).

AudioWorklet

needs to be added as a module on

AudioContext

and then it can be just inserted into the nodes array as

AudioWorkletNode