https://www.boundaryml.com logo
🟡 Request for Structured Test Grouping in BAML Pl...
# questions
a
Is there a way to group the tests so that the BAML playground tests suits have tests grouped with structure like pytest does? I have defined 3 diff sets of tests for my BAML function. The current BAML pipeline has run a batch job but with some edge cases that I want to capture as regression tests. So in the coming iteration, I would like to just easily trigger only the tests defined in
desc_denoise_reg.baml
but not in the other 2 files. But the current tests UI provide no structure within the function, hence i would have to either click on individual tests or run everything together. https://cdn.discordapp.com/attachments/1253172394345107466/1473913823990775939/image.png?ex=6997f0b7&is=69969f37&hm=c90cae3acfa1f319a13f62158f8d0a1c1dcb9e61908283420b95554695808932& https://cdn.discordapp.com/attachments/1253172394345107466/1473913824431181908/image.png?ex=6997f0b7&is=69969f37&hm=e5ba759434770b7e2834118bae108e39b1adc4054f29ccf0ea99edadf17adab1&
a
ah you would have to use a test prefix, and then in the search, you can seach for those tests only, and press 'run all'
does searching not filter them down for you correctly?
will take a look in a bit!
a
The prefix thing does via baml cli tool using "reg_*. But the playground search doesn't quite work. As per the screenshot, the search highlight the ones matched without doing the filter, and if I click on run-all, it still run everything. If I hit enter after typing the prefix, it makes everything blank https://cdn.discordapp.com/attachments/1473913824833700026/1475617629807841563/image.png?ex=699e2382&is=699cd202&hm=c25252de6cfee87d0e370e79166f20a7af2a8d00470fbd50b092ef4d0a568e5f&
a
ok until we fix the UI definitely try using
baml-cli test -i
, use
baml-cli test --help
and point it to claude code
it has specific filters to run only certain tests
we will fix the UI search + running of tests soon
thanks for the screenshot
a
Thank mate, appreciate the prompt response!
This is the env btw in case you need it Cursor Version: 2.4.37 VSCode Version: 1.105.1 Commit: 7b9c34466f5c119e93c3e654bb80fe9306b6cc70 Date: 2026-02-12T23:15:35.107Z Build Type: Stable Release Track: Default Electron: 39.2.7 Chromium: 142.0.7444.235 Node.js: 22.21.1 V8: 14.2.231.21-electron.0 OS: Darwin arm64 25.2.0
2 Views