I was able to deploy the frontend with the non-Route53 custom domain by following https://docs.serverless-stack.com/constructs/StaticSite#configuring-externally-hosted-domain would like to get the backend API over to a custom domain as well.