https://docs.all-hands.dev/ logo
Join Slack
Powered by
Hi all, I’m wondering if we should seriously consi...
# proj-agent-server
l
Hi all, I’m wondering if we should seriously consider a sqllite database for indexing conversation metadata? I’m starting to accumulate lots of conversations on my disk, and it seems that things get a bit slow. I know others have observed this before, like @calm-artist-7206, and we have some PRs in this direction
• Directly About Slow Conversation Search - Issue #3142: O(N) full scan for conversation search and count (github.com/OpenHands/software-agent-sdk/issues/3142) — Open - PR #3905: Optimize conversation search and count (github.com/OpenHands/software-agent-sdk/pull/3905) — Open draft, review required; fixes #3142 with an incremental metadata index. - Issue #3153: SDK and agent-server performance investigation (github.com/OpenHands/software-agent-sdk/issues/3153) — Open tracking issue that includes #3142. Closely Related - Issue #3140: Agent server loads all conversations eagerly at startup (github.com/OpenHands/software-agent-sdk/issues/3140) — Open - PR #3895: Lazy-load persisted conversations at startup (github.com/OpenHands/software-agent-sdk/pull/3895) — Open draft, changes requested. Search/count uses persisted metadata without hydrating every conversation. - PR #3266: Evict idle terminal conversations (github.com/OpenHands/software-agent-sdk/pull/3266) — Open, review required. Preserves search/count visibility for evicted conversations. - Issue #2623: Expose Python conversation/event search APIs (github.com/OpenHands/software-agent-sdk/issues/2623) — Open, but primarily about API parity rather than performance.
w
agreed, startup is really slow for me in particular, since we load every convo from disk
l
I added lazy loading which should probably help a lot
🙌 1
c
The lazy loading PR is great to have! I think maybe it can use @fierce-account-55183 👀 if possible. My agent left some comments and it claims it reproduced some races, I’m not totally sure if all are realistic though. I had it try to make failing tests so we can see
l
Thanks! I had OpenHands address the comments. FWIW I’m using it extensively now and it’s working fine, loading is so much faster. github.com/OpenHands/software-agent-sdk/pull/4100
gratitude thank you 1
c
The Cloud resolver cannot load, I don’t know what’s up with it. But I gave my local canvas the same questions I had, and it answered here: https://github.com/OpenHands/software-agent-sdk/pull/4100#issuecomment-4961497968 These are nits, the red crossed ones are apparent unnecessary code, because the agent kept test fixtures as they were 😅
2 Views
Open in Slack
PreviousNext
Powered by