https://www.boundaryml.com logo
🟡 Using Botocore Config Parameters with Bedrock i...
# questions
j
Is there any way to use the parameters from botocore config for Bedrock in BAML (https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html). Such as setting the
max_pool_connections
or using their
adaptive
retry mode?
a
you can specify some timeouts: https://docs.boundaryml.com/ref/llm-client-strategies/timeouts We could see if we can expose literally every config that the rust HTTP client we use offers
but for now we just exposed timeouts