https://promptfoo.dev/ logo
context-faithfulness vs context precision
# ❓|questions
u
Hello, I have been using the ragas metrics to help evaluate my rag pipeline and I wanted to understand the context faithfulness metric. Is it the same as context precision which ensures that the ground truth relevant items in the contexts are ranked higher or not. According to https://docs.ragas.io/en/latest/concepts/metrics/context_precision.html, they compute the precision@k which I don’t think the faithfulness metric does compute.
i
Context faithfulness breaks down the answer into a list of statements, which are then checked against the context. So it is different from ragas's context precision. I believe it is equivalent to what ragas now calls "context recall"
u
Ok but then how is it different from the context recall metric then because there are both context faithfulness and context recall in promptfoo.
i
sorry, I was wrong about faithfulness being equivalent to context recall. context recall in promptfoo is the same as ragas - it compares context vs ground truth