<@U0A6M3XN9KP> 500 error submitting an agent obser...
# general
r
@Vince 500 error submitting an agent observation example - i think there's too much data associated with the getActivityRhythm tool (at least that's my hypothesis because this is the first time I called it with 30d)
đź‘€ 1
CleanShot 2026-07-24 at 13.41.52.png,CleanShot 2026-07-24 at 13.41.55.png
v
you're in staging yeah?
r
yeah
endpoint has a data cap
cap is 100kb
v
bumped to 5mb for the agent examples, and pushed to staging, if you wait a minute or two it should work
r
is it surprising that the tool call would be using that much?
m
that makes me nervous in terms of server memory
would rather we not be loading massive objects into memory for tool calls if we can avoid
v
the full saved example includes all the tool calls for the example (and the original response), so if you have a couple tool calls with long timelines it can get big (particularly the user timeline stuff with all the <1m sessions)
but the full example is only shuffled through the api to a gcp bucket, it's not "processed" when it's saved so it shouldn't be a big impact on memory then
also the getactivityrhythm results are a bit verbose and the main culprit here, I'll change the way it's stored in json and it'll cut down on things a lot
m
I think it's ok but we should definitely keep memory allocation in mind when it comes to these large tool calls. That would be great. Also just a reminder to use TOON when sending these to the LLM
👍 1
v
they are in fact being TOON'd for the agent, but when they're run through the admin console routes we need to be able to parse them for formatting and rendering nicely so they stay in json
👍 1
is there a view in render where I can watch memory usage?
m
r
@Vince the agent should do a policy audit. When a policy gets deleted that should always be mentioned and there should be like a several day “reminder” of some sorts for observation agent
v
got it, there's currently just the last 24 hours in its prompt but I will bump that up and make sure it's highlighted properly in the prompt