Some logs not being displayed shuttle #help

Some logs not being displayed

orange-table-49219

04/15/2023, 2:55 AM

Hey, I just noticed that some log messages (tracing) is not being displayed when running

cargo shuttle logs

. While I was debugging something earlier I had no clue why something was failing, and I didn't see any error logs in

cargo shuttle logs

. When running my app locally and reproducing the bug, I could see error logs and it was very obvious how to fix it. Since I can see

INFO

level logs from my deployment, I would expect to also see

ERROR

level logs, but I am not for some reason. I fixed my bug now but it's quite annoying that the log messages from shuttle are seemingly unreliable; if I get another bug that's harder to reproduce I might not be able to trace back what happened 🫤

orange-table-49219

04/15/2023, 3:28 AM

My deployment has also been stuck for literally half an hour now

Copy code

2023-04-15T04:59:08.637076156Z  INFO shuttle_deployer::deployment::run: loading project from: /opt/shuttle/shuttle-executables
/dfb7514f-2a5a-49ba-865b-63aab0319859

orange-table-49219

04/15/2023, 3:31 AM

Copy code

TwitchBot.git/master ❯ cargo shuttle deploy                                                                   master 05:30:51
Error: 503 Service Unavailable
message: project not ready

enough-oil-62271

04/15/2023, 4:12 AM

yeah I've had that happen a few times. Not sure what causes it. You can get things running again with

cargo shuttle project restart

. There will sometimes be a still-running (but stuck, seemingly) deployment shown after that point, so do

cargo shuttle stop

and then

cargo shuttle deploy

to get things running. In theory the

stop

shouldn't be needed, but I had a few times like this where not manually stopping it first caused me to get right back into the stuck state with the project saying it's not ready.

orange-table-49219

04/15/2023, 4:36 AM

I've tried restarting the project multiple times and it still doesn't work

orange-table-49219

04/15/2023, 4:36 AM

stopping also does not work unfortunately

Copy code

TwitchBot.git/master ❯ cargo shuttle stop
Error: 503 Service Unavailable
message: project not ready

orange-table-49219

04/15/2023, 4:37 AM

https://cdn.discordapp.com/attachments/1096629925659811891/1096655512810037319/image.png▾

orange-table-49219

04/15/2023, 4:37 AM

seems like servers are down or something

enough-oil-62271

04/15/2023, 4:40 AM

you need to do them in that specific order: restart project, stop deployment, then you can start another one. If it still doesn't work after that specific sequence, then yeah I guess it must be something else.

orange-table-49219

04/15/2023, 4:41 AM

If I do that it gives me a 404 when running

cargo shuttle stop

orange-table-49219

04/15/2023, 4:41 AM

https://cdn.discordapp.com/attachments/1096629925659811891/1096656595640918066/image.png▾

orange-table-49219

04/15/2023, 4:41 AM

~~I'm trying it again, but I think it's gonna get stuck again~~ it's stuck again

enough-oil-62271

04/15/2023, 4:42 AM

yeah that's weird, I haven't gotten it stuck quite that bad yet myself, I think

enough-oil-62271

04/15/2023, 4:42 AM

if you restart the project once more and do

cargo shuttle deployment list

, what does it show?

orange-table-49219

04/15/2023, 4:43 AM

1 running service and a bunch of stopped ones

orange-table-49219

04/15/2023, 4:43 AM

is it supposed to show deployments for this project only or all my projects?

enough-oil-62271

04/15/2023, 4:43 AM

afaik just the current project

enough-oil-62271

04/15/2023, 4:44 AM

but I haven't played with a bunch so maybe more?

orange-table-49219

04/15/2023, 4:44 AM

because I do have a different project that is running, so I don't know if the 1 running deployment shown in the list is that or not

enough-oil-62271

04/15/2023, 4:44 AM

you could check the deployment list from that project folder and compare the GUIDs?

orange-table-49219

04/15/2023, 4:45 AM

yeah, it seems like it's per project

orange-table-49219

04/15/2023, 4:45 AM

so there is a running deployment apparently

orange-table-49219

04/15/2023, 4:45 AM

🤔

orange-table-49219

04/15/2023, 4:45 AM

if I check its status it says last updated about 2 hours ago

orange-table-49219

04/15/2023, 4:46 AM

I'm not sure if that's the newest version of my code

enough-oil-62271

04/15/2023, 4:46 AM

I'd guess that running deployment is for whatever reason not responding and causing shuttle to get stuck when trying to tell it to gtfo so it can bring up a new deployment. But the 404 when you try to

stop

it is a new one for me, not sure what to do about that.

orange-table-49219

04/15/2023, 4:46 AM

it's not

orange-table-49219

04/15/2023, 4:47 AM

alright, stop now suddenly worked

enough-oil-62271

04/15/2023, 4:47 AM

👀 oh heck yeah

enough-oil-62271

04/15/2023, 4:47 AM

🤞🏼 a new deployment just works then

orange-table-49219

04/15/2023, 4:47 AM

it's building, let's see if it gets stuck or not

orange-table-49219

04/15/2023, 4:51 AM

alright, it's running again

orange-table-49219

04/15/2023, 4:52 AM

this might still be happening though, can't tell because it's not consistent

enough-oil-62271

04/15/2023, 4:52 AM

nice! Just as I seem to hit that one again myself x.x. Time to do the dance.

enough-oil-62271

04/15/2023, 4:52 AM

yeah, the logs... are odd. Sometimes stuff is missing, sometimes it's there

orange-table-49219

04/15/2023, 4:52 AM

and since I can't modify the tracing setup without expanding any macros, I can't even put them anywhere else

kind-area-3810

04/15/2023, 10:48 AM

We had a report of missing debug logs last week as well: (which should also be viewable), so there seems to be a bug here. We'll try to take a look at this next week.

Previous Next