🍱 Hi <!channel>, BentoML v1.0.3 release is here and has brought a list of performance and feature improvement.
• Improved Runner IO performance by enhancing the underlying serialization and deserialization, especially in models with large input and output sizes. Our image input benchmark showed a 100% throughput improvement (see comparison in attachments 1 & 2).
• Added support for specifying URLs to exclude from tracing.
• Added support custom components for OpenAPI generation (see attachment 3).
🙌 We continue to receive great engagement and support from the BentoML community.
• Shout out to
Ben Kessler for helping benchmarking performance.
• Shout out to
Jiew Peng Lim for adding the support for configuring URLs to exclude from tracing.
• Shout out to
Susana Bouchardet for add the support for JSON IO Descriptor to return empty response body.
• Thanks to
Keming and
mplk for contributing their first PRs in BentoML.