hey there folks,
Just a background ask on this pipeline.
We do not need to specify max resources which gave the impression that you don't need to configure this pipeline with any memory usage. The pipeline will instinctively resize instances to accommodate the ask on it. Am I right to assume this? At least up until your memory is maxed and if it rightfully asks for more than what can be supplied you will error out.