https://promptfoo.dev/ logo
Sort output ui by metadata
# ❓|questions
s
Hi! First off thanks for creating such a useful and concise tool - its really easy to set up and use. Is there a way to display sort output by metadata in the output UI? I have different sets of questions arranged by metadata e.g. "type" as follows: - vars: question: "Who is known as the Father of International Law?" type: ["Simple Fact Retrieval"] multiturn: N uses_documents: N assert: - type: equals value: "Hugo Grotius" and it would be good to know how well each model is doing on each subsection of questions (type). Is this possible? Will it be in the future?
i
hey Seb, this is a very reasonable request. currently not possible, but I'll see what I can do
one workaround is you should be able to at least filter by
type
using the search bar. I know that is not ideal, but maybe helps. Additionally, if you set the metadata as an assertion
metric
rather than var, you will also be able to click the pills in the headers to filter.
Copy code
yaml
assert:
  - type: equals
    value: ...
    metric: Foobar
This will make
Foobar
appear up top and you can click-to-filter
s
thanks!