Slackbot
08/23/2022, 3:49 PMEduardo
env.something.yaml
file. Soopervisor will pick that up and use it instead of the env.yaml
by default. Let me know if this solves your issue!Cecilia Brizzolari
08/24/2022, 1:50 PMapiVersion: <http://argoproj.io/v1alpha1|argoproj.io/v1alpha1>
kind: Workflow
metadata:
generateName: project-name-
spec:
entrypoint: dag
arguments:
parameters:
- name: param1
value: value1
- name: param2
value: value2
templates:
- inputs:
parameters:
- name: task_name
name: run-task
script:
command:
- bash
image: image-name
source: |-
ploomber task {{inputs.parameters.task_name}} --entry-point pipeline.yaml --force \
--env--param1 {{workflow.parameters.param1}} --env--param2 {{workflow.parameters.param2}}
volumeMounts: []
workingDir: null
- dag:
...
basically being able to override parameters from the workflow.Eduardo
env.yaml
contains your environment default values
env.argo.yaml
contains the values you can use in Argo (you can use import from
to get the values from env.yaml
so this second file only has the values you need to override, see here)
then, if your soopervisor environment is called argo
, then soopervisor will use env.argo.yaml
as the environment, achieving the same effect as if you did --env--param
inside the YAML. Does this work?Cecilia Brizzolari
08/24/2022, 2:17 PMenv.argo.yaml
I can specify parameters for any environment, but those parameters are also bundled within the generated image.
The use case I'm facing is instead generating more of a "template" - I have a pipeline which has some default parameters, but I can choose to run the workflow with new parameters without re-running soopervisor.
(That is, if I have understood correctly how env files work)Eduardo
Eduardo
Cecilia Brizzolari
08/25/2022, 7:07 AM