Back to Mistral Rs

Deploy

docs/src/content/docs/guides/deploy/index.md

0.8.3563 B
Original Source

When mistral.rs runs anywhere other than a development laptop, several development conveniences (ephemeral storage, no TLS, single model, forgiving network) no longer apply.

  • Docker: building and running the official container images.
  • Production checklist: pre-flight: TLS termination, authentication, observability, model warm-up, monitoring.

For configuration options (host, port, CORS, body limits), see the HTTP server guide.