https://www.boundaryml.com logo
🟡 Using BAML with WebGPU for browser-based tiny c...
# questions
d
I searched but I'm thinking about something and curious if anyone has thought about this 1. i know baml wasm support is like, mostly not shipped yet? 2. I want to do tiny classifications / structured output in users browser with like a 1B to 500M model w/ webGPU 3. I want to use baml parser/runtime/etc to push performance (accuracy) for this classification 4. is this a thing that has been discussed / will be possible in 1/3/6/12 months? use case "task jira eng-1234" -> {"action": "createTask", "source": "jira", "ticket": "eng-1234"}
g
This is a super interesting idea.
v
I can help set this up!
There are a few hacks we can use to empower this use case
d
thats sick
2 Views