buytslacalls_
08/22/2024, 8:46 PMbuytslacalls_
08/22/2024, 8:46 PMdefaultTest:
options:
provider: openai:gpt-4o
description: Pharmaceuticals - Is information accurate (Lisinopril Side Effects)
env:
OPENAI_API_KEY: >-
some-key
evaluateOptions: {}
prompts:
- What are the common side effects of the drug {{drug_name}}?
providers:
- id: openai:gpt-4o-mini
config:
apiKey: >-
some-key
organization: ''
temperature: 0.5
max_tokens: 1024
top_p: 1
frequency_penalty: 0
presence_penalty: 0
scenarios: []
tests:
- description: ''
vars:
drug_name: Lisinopril
assert:
- type: context-recall
value: >-
Common side effects include dizziness, cough, high potassium levels
(hyperkalemia), and fatigue.
provider: openai:gpt-4o-minibuytslacalls_
08/22/2024, 8:47 PMian
08/22/2024, 11:18 PMOPENAI_API_KEY envar instead of the env config key?buytslacalls_
08/23/2024, 8:54 PMbuytslacalls_
08/23/2024, 8:54 PMbuytslacalls_
08/23/2024, 8:54 PMian
08/25/2024, 3:57 AMenv property is not applied properly in provider overrides