Overview¶

This section provides the tutorials for a curated list of example projects to help you learn how BentoML can be used for different scenarios. See the following lists for a complete collection of BentoML example projects. Browse through different categories to find the example that best suits your needs.

LLMs¶

Deploy an OpenAI-compatible LLM API service:

Choose your LLM Inference runtime:

Advanced examples:

Image and video¶

Serve text-to-image and image-to-image models with BentoML:

Audio¶

Serve text-to-speech and speech-to-text models with BentoML:

Computer vision¶

Serve computer vision models with BentoML:

Embeddings¶

Build embedding inference APIs with BentoML:

Custom models¶

Serve custom models with BentoML:

Others¶