https://promptfoo.dev/ logo
Malformed input when using Bedrock model for gradi...
# ❓|questions
r
I configured a Bedrock provider to grade the output:
Copy code
defaultTest:
  options:
    provider:
      id: bedrock:anthropic.claude-3-haiku-20240307-v1:0
When promptfoo is running the assertions:
Copy code
assert:
      - type: llm-rubric
        value: "the agent returns..."
I get
Copy code
API call error: ValidationException: Malformed input request: #: subject must not be valid against schema {"required":["messages"]}#/messages/0/role: system is not a valid enum value, please reformat your input and try again.
i
👍 closing this out as we solved it on github!
r
@ian Thanks! Do you have a link to the GitHub Issue, Pull Request, or Commit?
m