Log in Get started

Back to Mistral Rs

Rust SDK

docs/src/content/docs/guides/rust/index.md

0.8.23546 B

Original Source

The mistralrs crate embeds the engine into a Rust program.

Getting started - load a model in-process and send a chat request.
Streaming - handle Response variants, tool progress, and cancellation.
Embed in Axum - mount the HTTP API inside an existing Axum app.
Rust SDK reference - summary of the Model API.
docs.rs - full API documentation.