<@U090ER7JPHA> litellm supports `extra_body`. We s...
# slackbot-chatterm
magnificent-hairdresser-38202
10/10/2025, 1:47 AM@nutritious-balloon-65098 litellm supports
extra_bodylitellm_extra_bodyopenhands/llm/llm.pyn
nutritious-balloon-65098
10/10/2025, 1:48 AMI'm on it! can track my progress here.
nutritious-balloon-65098
10/10/2025, 2:06 AMSummary: litellm_extra_body Configuration Feature Implementation
I have successfully implemented the
litellm_extra_bodylitellm_extra_body: str | NoneLLMConfigSettingsopenhands/llm/llm.pyextra_bodyextra_body Copy code
{
"metadata": {
"user_id": "user123",
"session": "abc"
},
"routing": {
"priority": "high",
"region": "us-east-1"
},
"tags": [
"production",
"api"
]
}m
magnificent-hairdresser-38202
10/10/2025, 3:16 AM@nutritious-balloon-65098 Let’s keep it simple and do not make any UI changes.
n
nutritious-balloon-65098
10/10/2025, 3:16 AMConversation is still starting
nutritious-balloon-65098
10/10/2025, 4:42 AMSummary
I have successfully implemented the
litellm_extra_bodylitellm_extra_bodyLLMConfigSettingsopenhands/llm/llm.pyopenhands/core/config/llm_config.pylitellm_extra_bodyopenhands/llm/llm.pyextra_bodyopenhands/storage/data_models/settings.pyopenhands/utils/utils.pyextra_bodyextra_body Copy code
config = LLMConfig(
model="gpt-4",
litellm_extra_body='{"metadata": {"user_id": "123", "session": "abc"}, "routing": {"priority": "high"}}'
)nutritious-balloon-65098
10/10/2025, 4:49 AMFinal Summary
I have successfully implemented the litellm supports
- [ ] Custom config as JSON string: Added
- [ ] Pass to litellm in openhands/llm/llm.py: Implemented parsing and merging logic in the LLM class
- [ ] Support custom inference clusters: Enables metadata passing for logging/tracking/routing
- [ ] Keep it simple: Removed frontend changes per your follow-up request
- [ ] Push to GitHub and create PR: Successfully pushed and opened PR #11311
🔧 Implementation Details:
4 files modified, 45 lines added:
• `openhands/core/config/llm_config.py`: Added
litellm_extra_bodyextra_bodylitellm_extra_bodylitellm_extra_bodyfeat/litellm-extra-body-confignutritious-balloon-65098
10/10/2025, 5:00 AM✅ Implementation Complete: litellm_extra_body Configuration Feature
I have successfully implemented the
litellm_extra_bodylitellm_extra_bodyLLMConfigSettingsopenhands/llm/llm.pyextra_bodylitellm_extra_bodyUserSettingsStoredSettingsfeat/litellm-extra-body-config Copy code
{
"litellm_extra_body": "{\"metadata\": {\"user_id\": \"test123\"}, \"routing\": {\"priority\": \"high\"}}"
}nutritious-balloon-65098
10/10/2025, 5:22 AMFinal Summary
I have successfully completed the user's latest requests:
✅ User Request Checklist
1. Run ruff formatter to lint changes ✅
◦ Applied ruff formatting to all 6 modified files
◦ Maintained consistent code style according to project guidelines
◦ No functional changes, only formatting improvements
2. Fix failing enterprise unit tests ✅
◦ All 5 previously failing tests now pass:
▪︎
test_store_and_load_keycloak_usertest_load_returns_default_when_not_foundtest_create_default_settings_require_payment_disabledtest_create_default_settings_with_existing_llm_keytest_encryptionfeat/litellm-extra-body-configlitellm_extra_bodynutritious-balloon-65098
10/10/2025, 5:24 AMFinal Summary
I have successfully completed the user's request to revert the manual ruff formatting and use pre-commit hooks instead:
✅ User Request Checklist
1. Reverted ruff formatting changes ✅
◦ Used
git revert HEAD --no-editpre-commit run --all-files --config ./dev_config/python/.pre-commit-config.yamlfeat/litellm-extra-body-configd8bf3ffb3litellm_extra_bodynutritious-balloon-65098
10/10/2025, 5:28 AMFinal Summary
I have successfully completed the user's request to push changes to a remote branch on GitHub:
✅ User Request Checklist
1. Checked current branch name ✅
◦ Current branch:
feat/litellm-extra-body-configorigin/feat/litellm-extra-body-configAll-Hands-AI/OpenHandslitellm_extra_bodyfeat/litellm-extra-body-confignutritious-balloon-65098
10/10/2025, 5:32 AMFinal Summary
I successfully identified and fixed the GitHub Action failure you reported.
✅ User Request Checklist
1. Investigated the failing GitHub Action ✅
◦ Analyzed the "Lint enterprise python" job failure
◦ Identified the root cause in the pre-commit hooks step
2. Root cause identified ✅
◦ Enterprise pre-commit formatting violations in the migration file
◦ Import ordering, code formatting, and trailing whitespace issues
3. Applied targeted fix ✅
◦ Fixed only the specific formatting issues causing the CI failure
◦ No extraneous changes made
✅ Changes Since Last Summary
Single focused commit:
74e32ce72enterprise/migrations/versions/d8173a9ded6d_add_litellm_extra_body_to_user_settings.pysqlalchemyalembicop.add_columnfeat/litellm-extra-body-configlitellm_extra_bodynutritious-balloon-65098
10/10/2025, 6:44 AMFinal Summary
I have successfully implemented your suggestion to clean up the
litellm_extra_bodyenterprise/migrations/versions/d8173a9ded6d_add_litellm_extra_body_to_user_settings.pylitellm_extra_bodylitellm_extra_bodylitellm_extra_bodylitellm_extra_bodylitellm_extra_bodyopenhands/storage/data_models/settings.pyopenhands/llm/llm.pylitellm_extra_bodyopenhands/storage/data_models/settings.pylitellm_extra_bodyfeat/litellm-extra-body-confignutritious-balloon-65098
10/10/2025, 6:57 AM✅ Final Summary
I have successfully completed the cleanup of the
litellm_extra_bodyd8173a9ded6d_add_litellm_extra_body_to_user_settings.pylitellm_extra_bodyUserSettingsStoredSettingslitellm_extra_body Copy code
TypeError: 'litellm_extra_body' is an invalid keyword argument for UserSettingsSettingslitellm_extra_bodyUserSettingslitellm_extra_bodylitellm_extra_bodyfeat/litellm-extra-body-config13 Views