I’m not seeing any configuration option for tagging a server. Do you just have to create the server then manually tag afterword?

yes

So how does one achieve autoscaling if you have to manually tag new servers?

@Xiang Fu ^^

it’s not for manually tagged servers, only for default tenant