Hey guys, I was just wondering: what you think is the best way to handle tool calls alongside user messages (for generating the final response) in BAML?
I've realized that if I have the user message shaped as just another tool call, the quality reduces a little bit compared to standard text generation. Maybe because the modelnis trying to fit the response within JSON...
So what im doing these days is i have a tool FINAL_USER_RESPONSE with no args. I use that to trigger another baml request which returns a pure string.
Do you guys have any opinions on this, or have you noticed a similar drop in quality when forcing text responses within a structured response?