Finally got CodeActAgent somewhat working! This PR should be ready for review. https://github.com/OpenDevin/OpenDevin/pull/1290 For general OpenDevin components: • Add

IPythonRunCellAction

that allows the agent to use Jupyter plugin introduced in feat(sandbox): Candidate Implementation of Sandbox Plugin to Support Jupyter #1255 for task solving. •

AgentTalkAction

that allows the agent to communicate with the user (either to communicate results OR ask for clarification) • Agent-User Interaction: Now allow agent's wait for user's response before proceed to task completion. • Added

__str__

method to some of the actions to get the printed in a readable way For CodeActAgent: • Allow CodeActAgent to do two things for environmental interactions: (1) use

ipython

AND (2) use

bash

• Tweak the prompts of CodeActAgent to ensure its generality. • The ability to use SWE-Agent's tool for task solving (may still need more extensive testing). Here's the demo video (no speed up)👇! Something we should fix for the frontend: https://github.com/OpenDevin/OpenDevin/pull/1290#issuecomment-2074880406