This message was deleted.

The adaptive batching is still static batching. It is impossible to combine them. The team are bringing dynamic batching to llm cases.

Thanks @Jian Shen Yap. Do you have an ETA?

From an internal discussion, it's likely 3-4 weeks away from now