do we need to upgrade each project? I have taken ship plan but every new project i create is on build plan and it ask me to upgrade. So, does it mean we need to pay for each project separately?

That's right, yes.