That's perfectly reasonable, in my opinion. Prisma seems to be happy with > 1gb of ram. Scale accordingly and all should be well.
I have a smaller, non-critical server on Digital Ocean that uses docker-compose to orchestrate Prisma + Yoga + Postgres + Nginx. Zero problems with it in 6 months.