🟡 Confusion with JSON braces, exploring YAML reli...
# questionsn
nikitoshina
12/02/2025, 7:05 PMI find smaller models get confused with braces for JSONish output. Has anyone looked if yaml output format produces more reliable output?
nikitoshina
12/02/2025, 7:05 PMHappy Thanksgiving! Minimax M1 and M2, Kimi-K2 (thinking), and Cohere models were the most inconsistent. Other models struggled occasionally as well, but these were noticeably less stable—especially when responding in non-English languages.
nikitoshina
12/02/2025, 7:07 PMHas anyone compared various output formats?
g
greg (BAML)
12/02/2025, 8:54 PMWe had starting implementing alternative output format parsers for BAML at some point, but we did not finish it or have a chance to verify that those formats produce more reliable outputs from smaller models.
n
nikitoshina
12/02/2025, 8:56 PMoki ty
g
greg (BAML)
12/02/2025, 8:57 PMWant to brainstorm a bit on how to make the small models work better on your schema?
greg (BAML)
12/02/2025, 8:58 PM(using today's json output?)
n
nikitoshina
12/02/2025, 8:58 PMwould love that. I have a meeting right now. What time works for you? I am in SF
g
greg (BAML)
12/02/2025, 8:59 PMI'm in the same time zone. I'm free for the next few hours, feel free to ping me when you're ready!
n
nikitoshina
12/02/2025, 8:59 PMsg!
nikitoshina
12/02/2025, 9:40 PMdmed
g
greg (BAML)
12/02/2025, 10:34 PMHello! Sorry, I was in a long meeting. Still free?
n
nikitoshina
12/02/2025, 10:54 PMYup call you I. A few mins