Unable to test PDFs with Bedrock boundary #help

Unable to test PDFs with Bedrock

mikeopentug

09/30/2025, 6:12 PM

I'm unable to test PDFs with Anthropic via Bedrock because the file name passed by BAML appears to not meet bedrock requirements. It seems it passed document.pdf, but I think Bedrock wants just "document" based on this issue opened on Bedrock github. https://cdn.discordapp.com/attachments/1422647367206699028/1422647367437647892/CleanShot_2025-09-30_at_11.10.332x.png?ex=68dd6f1b&is=68dc1d9b&hm=9bf689031a6ef835e4b9d89aafe6e310049f7e1f1b697b5aed079fb3c4271f1e& https://cdn.discordapp.com/attachments/1422647367206699028/1422647367693242550/CleanShot_2025-09-30_at_11.12.132x.png?ex=68dd6f1b&is=68dc1d9b&hm=15fcf2a8e6c7adbc33a175dad9b653ad230ace657879a06a2018403d73d7a17d& https://cdn.discordapp.com/attachments/1422647367206699028/1422647368054214656/CleanShot_2025-09-30_at_11.12.212x.png?ex=68dd6f1c&is=68dc1d9c&hm=e3fb53cc71602beb1a80aad7a3e257235029c4c3851757eb9b248f0c33df7445&

mikeopentug

09/30/2025, 6:12 PM

https://github.com/simonw/llm-bedrock/issues/8

mikeopentug

09/30/2025, 6:17 PM

client Sonnet3_7BedrockInvoices { provider aws-bedrock options { model "us.anthropic.claude-3-7-sonnet-20250219-v1:0" region "us-east-1" inference_configuration { max_tokens 8192 temperature 0 } additional_model_request_fields { citations {"enabled": true} } } }

greg (BAML)

09/30/2025, 6:25 PM

I'll try changing the hardcoded name from document.pdf to document and see if that fixes the issue. If so, I'll get a PR up and we'll aim to have it in for the Tuesday night release.

greg (BAML)

09/30/2025, 7:09 PM

Do you need the

additional_model_request_fields { citations { enabled true } }

? I've found that changing the default document name from "document.pdf" to "document" does fix the issue you were seeing, but only if I remove

additional_model_request_fields

. When I run with

additional_model_request_fields

, I get a validation error from Bedrock: "The model returned the following errors: citations: Extra inputs are not permitted".

mikeopentug

09/30/2025, 7:18 PM

according to this blog post we do need that, but maybe I am passing it incorrectly: https://builder.aws.com/content/2yuuUoj0uthPd6M3GR7t2SZ4r8E/claude-pdf-support-on-amazon-bedrock

greg (BAML)

09/30/2025, 8:02 PM

Ahh, I see.

{citations: { enabled: "true" } }

switches the model from Converse (text-only) mode, to Claude PDF Chat Mode (which visually analyzes the PDF). Your PDFs likely won't get extracted as nicely if we can't pass this in. I'm reading about additional_model_request_fields now to see if it should let us pass

citations

in the way you were using it.

greg (BAML)

09/30/2025, 8:15 PM

Ok, I believe additional_model_request_fields passes its data only to the top-level inference request. It will not inject its contents into individual message blocks, but the

citations

object does need to be used at the level of the document message (not the top-level inference request). It may be safe to hardcode this too, for the time being at least. We haven't settled on a syntax for allowing modification of Pdf values within BAML the language.

mikeopentug

09/30/2025, 11:59 PM

Okay great! Glad that it can be hardcoded. Is there a good way for me to pass in the citations param to each message block?

greg (BAML)

10/01/2025, 2:29 AM

We don't have a way to customize the blocks. But every PDF block going to Bedrock after the upcoming release (which I'm working on now) will have citations enabled.

greg (BAML)

10/01/2025, 5:51 AM

0.210.0 release just came out. Please give it a try on your BAML code when you can, Mike 🙂

Previous Next