ContextQMD
Back to Openclaw

NVIDIA

docs/providers/nvidia.md

2026.5.285.2 KB
Original Source

NVIDIA provides an OpenAI-compatible API at https://integrate.api.nvidia.com/v1 for open models for free. Authenticate with an API key from build.nvidia.com.

Getting started

<Steps> <Step title="Get your API key"> Create an API key at [build.nvidia.com](https://build.nvidia.com/settings/api-keys). </Step> <Step title="Export the key and run onboarding"> ```bash export NVIDIA_API_KEY="nvapi-..." openclaw onboard --auth-choice nvidia-api-key ``` </Step> <Step title="Set an NVIDIA model"> ```bash openclaw models set nvidia/nvidia/nemotron-3-super-120b-a12b ``` </Step> </Steps> <Warning> If you pass `--nvidia-api-key` instead of the env var, the value lands in shell history and `ps` output. Prefer the `NVIDIA_API_KEY` environment variable when possible. </Warning>

For non-interactive setup, you can also pass the key directly:

bash
openclaw onboard --auth-choice nvidia-api-key --nvidia-api-key "nvapi-..."

Config example

json5
{
  env: { NVIDIA_API_KEY: "nvapi-..." },
  models: {
    providers: {
      nvidia: {
        baseUrl: "https://integrate.api.nvidia.com/v1",
        api: "openai-completions",
      },
    },
  },
  agents: {
    defaults: {
      model: { primary: "nvidia/nvidia/nemotron-3-super-120b-a12b" },
    },
  },
}

When an NVIDIA API key is configured, OpenClaw setup and model-selection paths try NVIDIA's public featured-model catalog from https://assets.ngc.nvidia.com/products/api-catalog/featured-models.json and caches the ranked result for 24 hours. New featured models from build.nvidia.com therefore appear in setup and model-selection surfaces without waiting for an OpenClaw release.

The fetch uses a fixed HTTPS host policy for assets.ngc.nvidia.com. If no NVIDIA API key is configured, or if that public catalog is unavailable or malformed, OpenClaw falls back to the bundled catalog below.

Bundled fallback catalog

Model refNameContextMax outputNotes
nvidia/nvidia/nemotron-3-super-120b-a12bNVIDIA Nemotron 3 Super 120B262,1448,192Featured fallback
nvidia/moonshotai/kimi-k2.5Kimi K2.5262,1448,192Featured fallback
nvidia/minimaxai/minimax-m2.7Minimax M2.7196,6088,192Featured fallback
nvidia/z-ai/glm-5.1GLM 5.1202,7528,192Featured fallback
nvidia/minimaxai/minimax-m2.5MiniMax M2.5196,6088,192Deprecated, upgrade compatibility
nvidia/z-ai/glm5GLM-5202,7528,192Deprecated, upgrade compatibility

Advanced configuration

<AccordionGroup> <Accordion title="Auto-enable behavior"> The provider auto-enables when the `NVIDIA_API_KEY` environment variable is set. No explicit provider config is required beyond the key. </Accordion> <Accordion title="Catalog and pricing"> OpenClaw prefers NVIDIA's public featured-model catalog when NVIDIA auth is configured and caches it for 24 hours. The bundled fallback catalog is static and keeps deprecated shipped refs for upgrade compatibility. Costs default to `0` in source since NVIDIA currently offers free API access for the listed models. </Accordion> <Accordion title="OpenAI-compatible endpoint"> NVIDIA uses the standard `/v1` completions endpoint. Any OpenAI-compatible tooling should work out of the box with the NVIDIA base URL. </Accordion> <Accordion title="Slow custom provider responses"> Some NVIDIA-hosted custom models can take longer than the default model idle watchdog before they emit a first response chunk. For custom NVIDIA provider entries, raise the provider timeout instead of raising the whole agent runtime timeout: 
```json5
{
  models: {
    providers: {
      "custom-integrate-api-nvidia-com": {
        baseUrl: "https://integrate.api.nvidia.com/v1",
        api: "openai-completions",
        apiKey: "NVIDIA_API_KEY",
        timeoutSeconds: 300,
      },
    },
  },
  agents: {
    defaults: {
      models: {
        "custom-integrate-api-nvidia-com/meta/llama-3.1-70b-instruct": {
          params: { thinking: "off" },
        },
      },
    },
  },
}
```
</Accordion> </AccordionGroup> <Tip> NVIDIA models are currently free to use. Check [build.nvidia.com](https://build.nvidia.com/) for the latest availability and rate-limit details. </Tip> <CardGroup cols={2}> <Card title="Model selection" href="/concepts/model-providers" icon="layers"> Choosing providers, model refs, and failover behavior. </Card> <Card title="Configuration reference" href="/gateway/configuration-reference" icon="gear"> Full config reference for agents, models, and providers. </Card> </CardGroup>