description: "RAG - End to end test with comparison"
prompts:
- prompts.json
providers:
- id: customProvider.js
tests:
- vars:
filePath: Question - What is the difference between supervised and unsupervised learning in machine learning?
noOfvariants: 1
application: AGA
assert:
- type: llm-rubric
provider: ollama:llama3.1
value: Content after Comprehensiveness: makes sense in the context of comprehensivness with respect to the Question-Answer pair defined by 'Question -' and 'Answer -' which comes before Correctness:, always return in JSON format
- vars:
filePath: Question - What is the difference between supervised and unsupervised learning in machine learning?.
noOfvariants: 1
application: answergen
assert:
- type: similar
value: 'Supervised learning involves training a model on labeled data, where each input is paired with a corresponding output.'
provider: ollama:embeddings:bge-large
this is the kind of structure I want to replicate in google sheets