Any clever way to dynamically pass in temp at runtime or get similar behavior? Was thinking to create a "low", "medium", and "high" temp client and just bucket requests into those 3 classes, but am looking for a better way to do this. The number of clients really starts to explode with various parameters we need a bucket for

we are aiming to have a more ergonomic way to override just a single param for an existing client at runtime by end of december

Got it - thanks for the info!

What other overrides would you like to see? Yep the main one is client params

oh no that's perfect - tysm!! We just need client param overrides is all - but being able to override any combination of the client params would be ideal

Adding my client params use case here: I'm looking for a way to set the

labels

option for my Vertex AI clients at runtime so that I can track usage and costs in GCP. I will start with these labels: -

environment

(from an environment variable) -

baml-function

for the function name -

baml-client

for the client name -

organization-id

to track per-customer spend

Yep you should be able to do this with custom clients from client registry but it s not nice and ergonomic so we will let you know when we fix it