https://www.boundaryml.com logo
​Hey guys, I was just wondering: what you think is...
# general
y
​Hey guys, I was just wondering: what you think is the best way to handle tool calls alongside user messages (for generating the final response) in BAML? ​I've realized that if I have the user message shaped as just another tool call, the quality reduces a little bit compared to standard text generation. Maybe because the modelnis trying to fit the response within JSON... So what im doing these days is i have a tool FINAL_USER_RESPONSE with no args. I use that to trigger another baml request which returns a pure string. ​Do you guys have any opinions on this, or have you noticed a similar drop in quality when forcing text responses within a structured response?