Hello, we are in the process of upgrading our serv...
# ask-for-helpt
Thomas Busath
09/11/2024, 10:18 PMHello, we are in the process of upgrading our services from 1.1 to 1.3. In the past, we have utilized configuration overrides with environmental variables. Is this possible in 1.3 or is the only way to set configuration variables like timeout and number of workers in the service definition?
Thomas Busath
09/11/2024, 10:30 PMOur use case is that we are deploying our bentos in kubernetes and sometimes we deploy the service with GPU's and sometimes we don't. We liked to set the configuration parameters via env variables for each of those situations differently
j
Jian Shen Yap
09/13/2024, 1:10 AMI believe BENTOML_CONFIG_OPTIONS would still work and take precedence over the code decorator definition, and of course since you can define the variable in code, you can always inject your own environment variable
s
Shihgian Lee
09/13/2024, 2:38 PMThanks for your reply @Jian Shen Yap. We tried
BENTOML_CONFIG_OPTIONSBENTOML_CONFIG_OPTIONS='services.MyService1.workers=1 services.MyService2.workers=3' bentoml serve ...Shihgian Lee
09/13/2024, 5:11 PMIt looks like
BENTOML_CONFIG_OPTIONS='services.MyService1.workers=1 services.MyService2.workers=3'j
Jian Shen Yap
09/17/2024, 10:46 AMThanks! We will update the docs accordingly! otherwise, contribution is welcomed too