Are folks having their agents keep track of their ...
# proj-agent
a
Are folks having their agents keep track of their own budgets? Curious if this is a common ask. (It feels easily solvable)
🔥 1
m
That's cool, letting the agent estimate it's token usage would be super useful
a
In the UI we have the total token usage, so it wouldn't have to estimate - could there be a way to get that to the agent?
m
We could have a skill that the agent can trigger and get this information… actually we also remarked that our agent has no idea of which model it is using
a
I think that info would really help the agent when we have it orchestrating and making decisions about the approach it should take
m
@average-processor-75195 I meant going a step forward and letting it see how many tokens a similar task too before, then using that for estimation
🙌 1
@modern-fireman-99755 I'm working on model awareness for intelligent model routing.
👍 1
b
Not sure if you already know this but here is a paper that studies budget aware agents: https://arxiv.org/abs/2606.00198
🙌 3
👀 1
m
@busy-branch-28834 interesting find!
(2) frontier models are consistently over-optimistic, continue spending on tasks that are unlikely to succeed, instead of alerting the user early.
(3) budget-aware signal is actionable and trainable. Early stop saves 28-64% tokens on failed trajectories,
seems like a specialized tool would be needed
c
Oh! I gave the paper to my agent to save it in our records, and it recognized Xingyao 😂
💯 1
😂 2