Back to Sglang

Diffusion Cookbook

docs/cookbook/diffusion/README.mdx

0.5.183.6 KB
Original Source

SGLang Diffusion Cookbook

<div style={{display: 'flex', gap: '8px'}}> <a href="https://opensource.org/licenses/Apache-2.0"></a> <a href="https://github.com/sgl-project/sglang/pulls"></a> </div>

Create a comprehensive cookbook for diffusion models in SGLang, demonstrating SGLang's performance advantages for image and video generation workloads.

🎯 What You'll Find Here

This cookbook aggregates battle-tested SGLang recipes covering:

  • Models: Mainstream Image and Video generation Models
  • Use Cases: Inference serving, deployment strategies
  • Hardware: GPU and CPU configurations, optimization for different accelerators
  • Best Practices: Configuration templates, performance tuning, troubleshooting guides

Each recipe provides step-by-step instructions to help you quickly implement SGLang solutions for your specific requirements.

🚀 Quick Start

  1. Browse the recipe index above to find your model
  2. Follow the step-by-step instructions in each guide
  3. Adapt configurations to your specific hardware and requirements
  4. Join our community to share feedback and improvements

For memory placement, prefer the unified --component-residency selector. Each component resolves to exactly one of resident, component-offload, or layerwise-offload. Existing options such as --dit-cpu-offload, --text-encoder-cpu-offload, --image-encoder-cpu-offload, and --vae-cpu-offload remain supported by all recipes that already use them.

The sglang diffusion cookbook directory structure are shown below:

text
docs/cookbook/diffusion/
├── README.mdx             # Main cookbook (this file)
├── Qwen-Image/            # Qwen-Image series docs
│   ├── Qwen-Image.mdx
│   └── Qwen-Image-Edit.mdx
├── Wan/                   # Wan series docs
│   ├── Wan2.1.mdx
│   └── Wan2.2.mdx
├── Z-Image/               # Z-Image series docs
│   └── Z-Image-Turbo.mdx
├── Ernie-Image/           # ERNIE-Image series docs
│   └── Ernie-Image.mdx
└── ...

🤝 Contributing

We believe the best documentation comes from practitioners. Whether you've optimized SGLang for a specific model, solved a tricky deployment challenge, or discovered performance improvements, we encourage you to contribute your recipes!

💪How to Contribute

  • Comment below if interested (mention which role)
  • Join discussion on implementation details
  • Fork repo and work on assigned section
  • Submit PR following SGLang cookbook standards
  • Iterate based on review feedback

To contribute:

shell
# Fork the repo and clone locally
git clone https://github.com/YOUR_USERNAME/sglang.git
cd sglang

# Create a new branch
git checkout -b add-my-recipe

# Add your recipe under docs/cookbook/diffusion/
# Submit a PR!

📖 Resources

📄 License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.


Let's build this resource together! 🚀 Star the repo and contribute your recipes to help the SGLang community grow.