ContextQMD
Back to Langflow

OpenAI Compatible

docs/versioned_docs/version-1.11.0/Components/bundles-openai-compatible.mdx

1.12.0.dev32.7 KB
Original Source

import Icon from "@site/src/components/icon";

The OpenAI Compatible bundle includes no components. It instead adds a provider through the providers[] block in its extension.json manifest, which is included in the global model provider registry.

Point Langflow's model provider at any OpenAI-compatible endpoint, and Langflow discovers available models live from the /v1/models endpoint.

Install OpenAI Compatible

The OpenAI Compatible provider installs automatically with uv pip install langflow.

For more information, see Langflow Extensions overview.

Configure the OpenAI Compatible provider

Configure Langflow to connect to your OpenAI-compatible provider by providing a Base URL and optional API Key. To find your Base URL, see your provider's documentation.

  1. To open the Model Providers pane, click your profile icon, select Settings, and then click <Icon name="Brain" aria-hidden="true"/> Model Providers.

  2. Select the OpenAI Compatible model provider.

  3. Set the following fields:

    FieldEnvironment variableRequiredDescription
    Base URLOPENAI_COMPATIBLE_BASE_URLYesBase URL of the OpenAI-compatible endpoint from your provider's documentation, such as https://openrouter.ai/api/v1.
    API KeyOPENAI_COMPATIBLE_API_KEYNoBearer token for the endpoint. Leave empty for local servers that do not require authentication.

  4. Click Save. Langflow validates the connection to the endpoint's /v1/models route and discovers available models. Discovered models appear under Language Models and Embedding Models.

  5. Enable the models you want to use.

  6. In any Language Model, Embedding Model, or Agent field, select OpenAI Compatible and a discovered model.

Local and private endpoints

Langflow enables SSRF protection by default. Loopback and private addresses such as localhost, 127.0.0.1, and ::1 are blocked unless you allow them.

Before you save a Base URL like http://localhost:8000/v1, set LANGFLOW_SSRF_ALLOWED_HOSTS to include that hostname:

bash
export LANGFLOW_SSRF_ALLOWED_HOSTS=localhost

You can also allowlist an IP address or CIDR range, for example 127.0.0.1 or 10.0.0.0/8.

For more information, see SSRF protection.

See also