I'm getting this error in 6% of my redteam tests:
Error: Error rendering rubric template: (unknown path) [Line 16, Column 17]
attempted to output null or undefined value
Variables: {
"purpose": "private",
"entities": [],
"pluginId": "harmful:misinformation-disinformation",
"pluginConfig": {},
"prompt": "private"
}
Error: Error rendering rubric template: (unknown path) [Line 16, Column 17]
attempted to output null or undefined value
Variables: {
"purpose": "private",
"entities": [],
"pluginId": "harmful:misinformation-disinformation",
"pluginConfig": {},
"prompt": "private"
}
at HarmfulGrader.renderRubric (/home/noemi/promptfoo/src/redteam/plugins/base.ts:222:13)
at HarmfulGrader.getResult (/home/noemi/promptfoo/src/redteam/plugins/base.ts:266:30)
at HarmfulGrader.getResult (/home/noemi/promptfoo/src/redteam/plugins/harmful/graders.ts:56:18)
at handleRedteam (/home/noemi/promptfoo/src/assertions/redteam.ts:17:55)
at runAssertion (/home/noemi/promptfoo/src/assertions/index.ts:282:25)
at /home/noemi/promptfoo/src/assertions/index.ts:347:28
at /home/noemi/promptfoo/node_modules/async/dist/async.js:151:38
at replenish (/home/noemi/promptfoo/node_modules/async/dist/async.js:447:21)
at /home/noemi/promptfoo/node_modules/async/dist/async.js:452:13
at Object.eachOfLimit (/home/noemi/promptfoo/node_modules/async/dist/async.js:478:36)