Back to Sglang

SGLang Cookbook

docs/cookbook/intro.mdx

0.5.171.4 KB
Original Source

A community-maintained repository of practical guides and recipes for deploying and using SGLang in production environments. Our mission is simple: answer the question "How do I use SGLang (and related models) on hardware Y for task Z?" with clear, actionable solutions.

import { popularModels } from "/src/snippets/configs/popular-models.jsx"; import { PopularModels } from "/src/snippets/_popular_models.jsx";

{/* Edit the list in /src/snippets/configs/popular-models.jsx — the docs landing page's featured hero reads the same file. */} <PopularModels models={popularModels} />

Guides

<CardGroup cols={3}> <Card title="Autoregressive Models" mode="card" href="./autoregressive/intro" img="/cards/Autoregressive-card.png" /> <Card title="Diffusion Models" mode="card" href="./diffusion/intro" img="/cards/Diffusion-card.png" /> <Card title="VLA (Vision-Language-Action) Models" mode="card" href="./vla/intro" img="/cards/VLA-card.png" /> </CardGroup>

Benchmarks

<CardGroup cols={2}> <Card title="Autoregressive Model Benchmark" mode="card" href="./base/benchmarks/autoregressive_model_benchmark" img="/cards/Autoregressive-benchmark-card.png" /> <Card title="Diffusion Model Benchmark" mode="card" href="./base/benchmarks/diffusion_model_benchmark" img="/cards/Diffusion-benchmark-card.png" /> </CardGroup>