Supabase is an open source Firebase alternative. Start your project with a Postgres database, Authentication, instant APIs, Edge Functions, Realtime subscriptions, and Storage.

Supabase

What do you mean?  Nothing is down that I'm aware of.

our API requests are dropping on our go live

https://app.supabase.io/project/bpzricpsuaeqlvanvnxf

You had a huge spike in usage on your api server, where network usage went from 0 to over 300MB/sec.  Something's using your server bigtime.  Check your support ticket.

You're running this on a t4g.micro instance with one gig of ram!

You can upgrade your instance yourself immediately from the dashboard.

Settings / Billing & Usage / Change Subscription / Edit Plan Configuration.

Idk how we didnt figure this out fromt he last time

I'm so happy that this problem is a super successful project and not an attack or anything.  This is easy to solve!  Just jump up to a big instance...

you can always dial it down later -- but I'd go big then see how it goes and back off if you have too much power.

Happy to help, and happy to see developers be successful!

I sent you a new Grafana shot in your support ticket.  Looks MUCH better now!

You're still handling 1-3GB/sec network traffic but the server is barely sweating now

What kind of application is this that's using so much network?

CPU on the API server is going higher now, though

What's doing the 1.5GB/sec of network traffic?  That's huge

most likely multiple servers pulling API data

yea we are on the biggest at 400$ right now

I can see if any of our backend engineers are available now to look at this.

one of our other team members is looking at your server configuration to try to optimzie it

tell them we are fine with spending $$$ for this

From our engineer:
Requests look fine right now but I’d like to upsize their DB to 4 or 8xlarge to be on the safe side. @Mark Burggraf when can I do this?

Can they upgrade you right now?  It may mean a little downtime.

as long as its less then 3 mins we should be good

Ok so your traffic looks fine and healthy right now, but to be on the safe side I'd like to bump your DB up a tier. Max 5 min downtime.

My suggestion would be: unless you're expecting bursty traffic in the next 24 hour (e.g. there's a new wave of users coming in in an hour), we can just leave it as-is for now, and upsize if we see error rates start to spike.

But if you know you're expecting larger traffic later, we should probably do it before that comes in.

<@739905536845152337> will we have any problems with EBS balance or anything like that?

Didn't cause any errors afaict. If that happens our hand will be forced into upsizing the DB.

Even for a 5k users drop the amount of egress traffic your project is seeing is pretty substantial. If I had to take a stab in the dark I'd guess there's a lot of unnecessary `select *`s happening

I saw it peak at 3.28GB/sec.  I've never seen that kind of traffic.

DB load is still around 200% -- is that ok?

It's at the upper limit of its perf ability

(signing off discord; your DB could still use a resize whenever most opportune)

Also from the Supabase team here, just sent over a friend request <@152236657305714688>

Also just wanted to say sorry to the team here for not knowing about the upgradeability of the slugs - absolutely stupid on that one

We're happy to help, any time!  Just reach out whenever you know you're going to have a need 😀

Yea def should of opened a ticket earlier as well to get some of this dialogue going, if you guys collect NFTs at all - got some free 1s on me.

I don't, but that sounds like a really nice offer!

Hey guys how are we holding up? Seeing some errors

@here any ideas? Looks like we are hard down

Div still wanted to upgrade your db server.  When is the best time for us to do that?

I don't see him online.  Do you know what size you wanted to upgrade the DB to?

db is now: m6g.2xlarge
api is now: m6g.12xlarge

I'll see if Inian can weigh in on this, hold on.

How has it been over the last 12 hours or so?

Sorry I'm  not sure how big they wanted to go, so I'll hold off for now unless you're having big problems?

I just want to make sure it doesn't fall through the cracks.

Yea I think its less of a DB issue and more just network requests - we are working on some things on our end

Ok once Div gets back and has a chance to analyze things we can upgrade that box.

hmmm looks like still getting some intermittent issues with upserts

Ok, when is a good time to upgrade your db instance?

Your API instance is on 12xl, your DB is on 2xl -- did you want to go all the way up to 12xl for the DB just to be safe, or Div said you might be ok with 8x or 4x.  It's your call.

Good to know others are facing it too haha. I thought I brought down the db

Projects are running just fine, so if you have an app running, it's fine.  It's just the dashboard that's a problem... they're still working on it.   Thanks for your patience!

Should be another 5-10 minutes... thanks for your patience.

<@845250139706753044> Is the recommended way to ensure you get better stability to be self-hosted?

Not unless you’re an expert in PostgreSQL and server and network infrastructure

If I don't set any RLS polices does it default to no access?

in the self hosted (docker) version of supabase, why is there no access to functions? is there a way to enable them?

also, i might remember incorrectly but there used to be an editor in supabase studio for remote procedures, right?

Seems Supabase Logs are down? I'm getting 502 Bad Gateway

Hi <:vmathi:812484657547313212> i don't have any issue with logs on my side. Can you try again by reloading your page using CTRL + SHIT + R? (it reloads without the cache of the website) <@180452788168294400>

The issue is resolved now, but at the time I messaged, attempting to access API logs and Postgres logs on app.supabase.io would yield a 502 error.

<@845250139706753044> the dashboard seems to be down again

I'm not having any problems.  Is this still a problem for you?

Can access it now but +1 to what <@180452788168294400> said. Seems to be intermittent

Hi <:vmathi:812484657547313212> Please ask in <#843999948717555735> so it would be easier for us to help you <@414737824374587393>

<@845250139706753044> Hey! Are you planning on offering the cloud functions feature in the self hosted version of supabase as well?

I think if you self host the cloud functions are easy.  You can either install a Deno runtime on your server or anywhere you want to deploy them or just use Deno Deploy.

heroku postgres guy sharing heroku reflections: https://www.craigkerstiens.com/2022/05/18/unfinished-business-with-postgres/ - could be useful for supabase folks

how would you write tests using jest/react-testing-library  that fetches data using rpc functions in useEffect?