donatoazevedo_79335
06/05/2025, 5:05 PMpython
def get_assert(output: dict[str, any], context) -> bool | float | GradingResult:
return {
'pass': True,
'score': 0.11,
'reason': 'Looks good to me',
'named_scores': {
'answer_similarity': 0.12,
'answer_correctness': 0.13,
'answer_relevancy': 0.14,
}
}
I was expecting to see the three answer_* named metrics appearing up top
https://cdn.discordapp.com/attachments/1380231112252723332/1380231112629944341/Screenshot_2025-06-05_at_14.04.57.png?ex=68431fe4&is=6841ce64&hm=1e59574abdb29e00278b719905d74efcea8620d330947203cbe31d0c4fc9301b&[Promptfoo] Steve
06/05/2025, 5:38 PMdonatoazevedo_79335
06/05/2025, 5:43 PM[Promptfoo] Steve
06/05/2025, 5:46 PMdefaultTest:
assert:
- type: equals
value: Yarr
metric: Tone
To the example in examples/simple-test and it showed up in the uI
https://cdn.discordapp.com/attachments/1380231112252723332/1380241366256193677/image.png?ex=68432971&is=6841d7f1&hm=d67f3fe461eaf8a19e3d9db93eb13887f28e506ed3b32006ceeb9fe90387d0b7&donatoazevedo_79335
06/05/2025, 5:47 PMnamed_scoresdonatoazevedo_79335
06/05/2025, 5:48 PMdonatoazevedo_79335
06/05/2025, 5:52 PMdonatoazevedo_79335
06/05/2025, 6:33 PM[Promptfoo] Steve
06/06/2025, 7:30 PMdonatoazevedo_79335
06/10/2025, 2:17 PM