This message was deleted.

that’s a great suggestion! We have been discussing this internally, and we think this should be on our roadmap especially considering the requests for adding support for batch inference on apache spark

I would love to have this as it would integrate so well with Argo workflows, I can simply pass the parquet file as an input artifact and work exclusively with yml files specifying the docker image and cmd.