https://www.boundaryml.com logo
🟡 Running Assertions Separately from LLM Call in ...
# questions
s
Could BAML run assertions on results separately from the call to the LLM in the eval? e.g. I fixed my code:
-  @@assert(picks_weekday_form, {{ this.week_offset != null and this.after_date == null }})
+  @@assert(picks_weekday_form, {{ this.week_offset is not none and this.after_date is none }})
This makes the tests pass but the LLM results don't change. Ideally I don't want to rerun the LLM eval but just the assertion on prev LLM data. How can I do that?
v
yea the new stuff makes that possible!
see my note in #1119375594984050779 ! it'll be out soon
2 Views