Hello. Did anybody experience crashes on last version (0.27.2) of Atlantis? It crashed with exit code 2, not leaving anything useful in the logs. I've looked into the source code, and could see only

os.exit(1)

which makes me wonder, it's some underlying dependency, however, I'm not too much into Golang.

How do you run it? ECS, EKS, anything else?

I have it on EKS, there are other workloads running on same node, and they are stable, only Atlantis crashed with rc=2. All metrics regarding capacity look fine. Shortly before crash Atlantis reported builder error in the metrics and then died. It's first time we have such issue, and we use Atlantis for couple years already.

If you use 0.27.1, does the issue go away?

We are on 0.27.2, and there was some bug in 0.27.1, that's why we've upgraded. It was stable for ~3 weeks already. Nothing interesting in the logs really. Just randomly died. If it happens again and we register any logs, I'll create an issue. Opened thread here, because I hoped I'm not alone with this.

I think that when is running the first hour fine and your workflows work as expected nothing will change overtime unless you change a setting in atlantis during that time

We are strict on configuration changes, it all goes via IaC, and Atlantis wasn't touched for sure, with even minimal config changes, so it had to be something in runtime.

so then I will say to look into you atlantis.yaml and see if tha specific project is different or not

We have hundreds of repositories integrated with single Atlantis instance, hard to say which atlantis.yaml was loaded during issue, but I'll try to investigate it. Thanks for idea.