Zuofeng Zhang
03/02/2026, 6:46 AMdocs/connectors/models/triton
End-to-end SQL examples for model definition and inference
Advanced configuration (auth, batching, compression, priority, headers)
Stateful / sequence model examples
Array-type inference examples
Performance considerations & troubleshooting
Chinese documentation aligned with EN version
• Minor updates to CREATE MODEL / ML_PREDICT docs to reference Triton
No runtime or API changes are introduced.
Why this matters
Triton is a widely adopted inference serving system. This documentation aims to:
• Lower the barrier for integrating real-time inference into Flink SQL pipelines
• Clarify configuration best practices
• Improve overall model inference documentation consistency
CR feedback is highly appreciated, especially regarding:
• Documentation structure & clarity
• Consistency with existing model docs (e.g., OpenAI)
• Terminology and SQL examples
• Translation accuracy (EN/ZH consistency)
Thanks in advance 🙏