theboxhead
02/15/2024, 9:56 PMtheboxhead
02/15/2024, 9:57 PMian
02/16/2024, 5:05 AMLOG_LEVEL=debug environment variable and send the output? kinda hard for me to tell what's going on. For example: LOG_LEVEL=debug promptfoo evaltheboxhead
02/16/2024, 9:43 AMtheboxhead
02/17/2024, 10:50 AMyaml
description: 'My first eval'
prompts:
- 'Write a tweet about {{topic}}'
providers:
- id: ollama:openhermes
config:
num_predict: 1024
tests:
- vars:
topic: bananasian
02/17/2024, 4:44 PMbasePath and rejecting the requestian
02/17/2024, 5:12 PMbasePath issue. It will be in the next release: https://github.com/promptfoo/promptfoo/pull/480theboxhead
02/17/2024, 7:31 PMtheboxhead
02/17/2024, 7:32 PMian
02/17/2024, 7:45 PMian
02/17/2024, 7:45 PMian
02/17/2024, 7:46 PMtheboxhead
02/17/2024, 7:46 PMlongc5772
02/27/2024, 8:45 AMlongc5772
02/27/2024, 8:46 AMdescription: 'My first eval'
prompts:
# - file://prompt1.json
- "Answer the question: {{question}}"
providers:
- ollama:chat:openchat:7b
tests:
- vars:
question: What's your name?
assert:
- type: equals
value: Hello, How may I assist you today?
- vars:
question: Helloian
03/01/2024, 6:42 PM