Compare to a baseline. I often find it's good to deploy early because I often learn a lot when the model is in production. Also the biggest win for me is fixing mislabeled data. And for some projects, I do need some creative feature engineering to solve it. Rarely do my projects fail succeed because of good HPO. It matters, I just find it matters less than other things and it's not worth the extra training time until the very end