ContextQMD
Back to Gitlabhq

Model selection

doc/administration/gitlab_duo/model_selection.md

19.1.03.4 KB
Original Source

{{< details >}}

  • Tier: Premium, Ultimate
  • Add-on: GitLab Duo Core, Pro, or Enterprise
  • Offering: GitLab Self-Managed, GitLab Dedicated

{{< /details >}}

Every GitLab Duo feature has a default large language model (LLM) chosen by GitLab.

GitLab can update this default model to optimize feature performance. Therefore, a feature's model might change without you taking any action.

If you do not want to use the default model for each feature, or have specific requirements, you can choose from an array of other available supported models.

If you select a specific model for a feature, the feature uses that model until you select another.

Select a model for the instance

{{< history >}}

  • Introduced in GitLab 18.4 with a flag named instance_level_model_selection. Enabled by default.
  • Introduced to GitLab Dedicated in GitLab 18.5.
  • Feature flag instance_level_model_selection removed in GitLab 18.6.
  • Changed to include GitLab Duo Core and Pro in GitLab 18.6.

{{< /history >}}

You can select a default model for a feature and that default applies to the entire instance. If you do not select a specific model, all GitLab Duo features use the default GitLab model.

[!note] For GitLab Self-Managed instances with an offline license, to change the model for features in the GitLab Duo Agent Platform, you must have the GitLab Duo Agent Platform Self-Hosted add-on.

Prerequisites:

  • You must be an administrator.

To select a model for a feature:

  1. In the upper-right corner, select Admin.
  2. In the left sidebar, select GitLab Duo.
  3. On Configure AI features, select Configure models for GitLab Duo. If Configure AI features is not displayed, verify that the GitLab Duo Enterprise add-on is configured for your instance.
  4. For the feature you want to configure, select a model from the dropdown list to set as the default model.
  5. Optional. To apply the model to all features in the section, select Apply to all.

Select a model for Agentic Chat

{{< history >}}

  • Ability to restrict GitLab Duo Agentic Chat to specific models added in GitLab 19.1.

{{< /history >}}

  1. In the upper-right corner, select Admin.

  2. In the left sidebar, select GitLab Duo.

  3. On Configure AI features, go to the GitLab Duo Agentic Chat section.

  4. Select a model from the dropdown list to set as the default model. If you plan to restrict access to other models, select a GitLab-managed model as the default.

  5. Optional. To restrict what other models users can select for Agentic Chat:

    1. Under Available models, select Configure.
    2. In the Available models: Agentic Chat dialog, select the Restrict to specific models checkbox.
    3. Select the models that you want Agentic Chat to be able to use.
    4. Select Save.

    [!note] To restrict Agentic Chat to specific models, you must select a GitLab-managed model as the default model. If you do not restrict Agentic Chat to specific models, users can choose from all GitLab-managed models.