Back to Continue

Intro to Roles

docs/customize/model-roles/intro.mdx

1.5.451.3 KB
Original Source
  • chat: Used for chat conversations in the extension sidebar
  • autocomplete: Used for autocomplete code suggestions in the editor
  • edit: Used to generate code based on edit instructions
  • apply: Used to decide how to apply edits to a file
  • embed: Used to generate embeddings used for vector search (@Codebase and @Docs context providers)
  • rerank: Used to rerank results from vector search

These roles can be specified for a config.yaml model block using roles. See the YAML Specification for more details.

Selecting model roles

You can control which of the models in your config for a given role will be currently used for that role. Above the main input, click the 3 dots and then the cube icon to expand the Models section. Then you can use the dropdowns to select an active model for each role.

<Frame> </Frame> <Note> ### INFO

roles are not explicitly defined within config.json (deprecated) - they are infered by the top level keys like embeddingsProvider

</Note>