https://promptfoo.dev/ logo
How to debug/print logs for assertion prompts?
# ❓|questions
t
I'm using TypeScript package for running the tests. However, I'm having a weird problem with almost all LLM-based assertion types... Almost everything passes even though I have random value for factuality or "model-graded-closedqa" assertions. I was digging to find on how to enable verbose logs to see what is going on under hood, but could not. How to enable verbose logs using TypeScript package? And any idea why I'm having false positive assertions? See my config attached. https://cdn.discordapp.com/attachments/1297648623076773919/1297648623382823044/image.png?ex=6716b0f4&is=67155f74&hm=5f241649bd3f9e112041ba7beaa9c4ccd73097994e647c2b47c14614ecb2ec4e&
m
to enable verbose logging you can set process.env.LOG_LEVEL = 'debug'; (export LOG_LEVEL=debug) Re. your model graded assertions always passing - please share your debug output or share an eval and I'll take a look
t
@michaelmichaelmichael shared through DM.
@michaelmichaelmichael did you had a chance to look at this? Do you need additional info?