not_one_idea
05/16/2024, 6:13 PMsystem to pass the system prompt with the messages param restricted to user & assistant content.
Promptfoo docs state that the anthropic provider plays nicely with openai style "messages" prompt templates: https://www.promptfoo.dev/docs/providers/anthropic#prompt-template. When the anthropic provider runs across that style of template it will parse the template and properly set the system and messages params sent to the Anthropic endpoint.
Unfortunately, the bedrock provider makes no mention of similar functionality: https://github.com/promptfoo/promptfoo/tree/main/examples/amazon-bedrock. The examples for bedrock all use pretty elementary prompt templates with variables being appended at the end some static instructions.
Can i use the openai style "messages" prompt templates with Anthropic via Bedrock? If not, how can i set the system prompt separately from the user messages when working with Anthropic via Bedrock?not_one_idea
05/16/2024, 6:43 PMian
05/17/2024, 12:16 AMian
05/17/2024, 12:16 AMnot_one_idea
05/17/2024, 1:13 AMian
05/17/2024, 1:14 AM