peanutshawn
04/16/2024, 4:20 PMassert:
- type: llm-rubric
value: ensure that the response is relevant to the question
provider:
id: openai:gpt-4
config:
apiKey: API_KEY
apiBaseUrl: BASE_URL
but not sure how to properly define providers in the csv I pass in. the docs only show how to define the metrics themselves.peanutshawn
04/16/2024, 5:04 PMpeanutshawn
04/16/2024, 5:12 PMian
04/17/2024, 3:56 PMpeanutshawn
04/18/2024, 6:25 PM__expected column in my csvpeanutshawn
04/18/2024, 6:25 PMpython: file://custom_relevance.pypeanutshawn
04/18/2024, 6:26 PMPython code execution failed: SyntaxError: invalid syntaxpeanutshawn
04/18/2024, 8:15 PMpeanutshawn
04/18/2024, 8:40 PM