Hey guys we have this gh issue open about getting the thinking results when showThinking: false due to the content being empty so it outputs the thinking when in reality it should not. Sorry to be pedantic about the issue but it is blocking us from moving forward with more testcases and development. Any chance to get some more 👀 into it? Thank you!

Hello, I see a fix was made for this in 0.117.11, however it's still broken for certain providers 😅 left a comment in the github issue

Hello, the fix for qwen is here: https://github.com/promptfoo/promptfoo/pull/5416

Amazing! Thank you so much Faizan!