i seem to be only able to connect to the postgres DB eventhough i have created other databases within the postgres instance

The Supabase infrastructure works with one database only. https://github.com/supabase/supabase/discussions/4471 You might be able to access different databases with postgres connection.

thanks got it