set the channel description: Building robotics with LiveKit? Meet other builders and the LiveKit team to get help, updates, and share ideas.

👋

🤖 🤖 🤖

Well, I am not sure how much this classifies as robotics but to kick off the conversation here is a little project I was playing with for a voice controlled home using LiveKit. (sped up the raise and lower because it is slow)

This is the last robot I built. I am currently building v2 of this since that one did not handle rain and failed. I custom trained computer vision model so has labels for baby Canadian goose, Canadian goose, dog, person, etc. It only fires if only Canadian geese or baby Canadian geese are there. So if my dog, a person, some one fishing on a boat the laser will not fire. It runs on a raspberry PI (image capture, does inference, and trigger laser), ESP8266 (motor/laser control) and cheap IP camera (IP65 water resistent) mounted on a tree.

Anyone worked with insertible streams for telemetry and syncing with video with any robotics projects.

Is there a plan to support an esp32 client sdk for livekit? also, i’m new to this but i thought esp32 is not powerful enough for supporting webrtc, which livekit uses

https://youtube.com/shorts/CueXQUa94Ss I saw this and i thought of LK, this would be a fun project.

Anyone worked with LiveKit and the DJI v5 MSDK? https://developer.dji.com/mobile-sdk/ I want to make a opensource app to stream and control the drone. The video side is a bit to much for me to understand, I've worked on the virtual sticks and other stuff. Thought about converting this one and updating the SDK version to the latest. https://github.com/Penkov-D/DJI-MSDK-to-PC I have drones to test with just the video / lk side is going to stump me.

Hi! Does anyone have experience building a voice agent on a RaspberryPi zero? I am having some issues understanding the agent lifecycle using python clients and would greatly appreciate any support 🙂

We have our first version of the ESP32 SDK available here: https://github.com/livekit/client-sdk-esp32

Hi i am leaning the physical robotics in the drone, I need to know what are the jobs available in as of now

suberb.

Hi team, we're currently using the DJI docks in our system and are looking into using LiveKit to scale up the streaming component of this (we're currently using RTMP with local MediaMTX servers). What I'm trying to understand is whether we have to use the ingestion service to pipe the dock/drone video output to LiveKit or whether we can generate the WebRTC URL for the room and hand it off to the docks to connect like any other client? Their API is pretty simple in that we can just give it these few parameters: https://developer.dji.com/doc/cloud-api-tutorial/en/api-reference/dock-to-cloud/mqtt/dock/dock2/live.html#start-live-streaming

Hi Team, Great day! @gentle-refrigerator-18414 On our custom board we are using only two peripherals: audio codec (ES8311) and microphone ADC (ES7210). We are reusing the code from livekit/client-sdk-esp32, with only changes in the pin configuration inside

third-party/webrtc/codec_board/board.cfg

. However, when we build and run, it throws an error indicating that I2C initialization failed for both ES8311 and ES7210. On the hardware side, everything looks fine (proper pull-ups are present). From reviewing the code, I see that the project uses a global instance for pin configuration in

bsp_init()

. My question is: Do we need to explicitly disable all unused peripheral configurations (like LCD, IMU, buttons, etc.) in order to avoid ambiguity in the BSP init sequence, so that ES8311/ES7210 initialization over I2C does not fail?

hey there 👋 I'm super excited about having an voice agent via an ESP32... I have a respeaker light and a SAT1 Dev Board to test this... but I'm somewhat lost as whatever I tried there was always some form of "road" block - so I'm "back to the basics" just get the official demo running - but I failed there as well 🙈 If someone could help me to get my first step in right direction I would really appreciate it 🤞 I opened an issue to share my exact steps + config https://github.com/livekit/client-sdk-esp32/issues/27

Hey guys 👋 Can anyone gives me heads up to where I can start my physical AI journey? Where to start? I am python Dev but no idea where to start and where to continue. I want to run voice AI on physical AI as receptionist Cheers 🙌🏻

📣 LiveKit for ESP32 v0.3.2 has been released, adding support for H.264 video publishing