Awesome gpt-oss

This is a list of guides and resources to help you get started with the gpt-oss models.

• Inference
  • Local
  • Server
  • Cloud
• Examples / Tutorials
• Tools
• Training

Inference

Local

• Ollama
  • How to run gpt-oss locally with Ollama
  • Ollama & gpt-oss launch blog
  • Check out the models Ollama
• LM Studio
  • LM Studio & gpt-oss launch blog
  • Use gpt-oss-20b with LM Studio
  • Use gpt-oss-120b with LM Studio
• Hugging Face & Transformers
  • How to run gpt-oss with Transformers
  • Hugging Face & gpt-oss launch blog
  • Collection of Hugging Face examples
• NVIDIA
  • gpt-oss on RTX
• AMD
  • Running gpt-oss models on AMD Ryzen AI Processors and Radeon Graphics Cards
  • Running gpt-oss on STX Halo and Radeon dGPUs using Lemonade
• llama.cpp
  • Running gpt-oss with llama.cpp
  • Running gpt-oss with Unsloth GGUFs

Server

• vLLM
  • How to run gpt-oss with vLLM
  • vLLM & gpt-oss recipies
• NVIDIA
  • Optimizing gpt-oss with NVIDIA TensorRT-LLM
  • Deploying gpt-oss on TensorRT-LLM
• AMD
  • Running the Latest Open Models from OpenAI on AMD AI Hardware

Cloud

• Groq
  • Groq & gpt-oss launch blog
  • gpt-oss-120b model on the GroqCloud Playground
  • gpt-oss-20b model on the GroqCloud Playground
  • gpt-oss with built-in web search on GroqCloud
  • gpt-oss with built-in code execution on GroqCloud
  • Responses API on Groq
• NVIDIA
  • NVIDIA launch blog post
  • NVIDIA & gpt-oss developer launch blog post
  • Use gpt-oss-120b and gpt-oss-20b on NVIDIA's Cloud
• Cloudflare
  • Cloudflare & gpt-oss launch blog post
  • gpt-oss-120b on Cloudflare Workers AI
  • gpt-oss-20b on Cloudflare Workers AI
• AMD
  • gpt-oss-120B on AMD MI300X
• AWS
  • Deploy via Tensorfuse: Deploy gpt-oss for both 20b and 120b models on AWS EKS
  • AWS launch blog post
• Google Colab
  • gpt-oss-20b inference notebook

Examples & Tutorials

• OpenAI harmony response format

Tools

• Example python tool for gpt-oss
• Example browser tool for gpt-oss

Training

• Hugging Face TRL examples
• LlamaFactory examples
• Unsloth examples

Reinforcement Learning

• Auto solving the 2048 game

Contributing

Feel free to open a PR to add your own guides and resources on how to run gpt-oss. We will try to review it and add it here.