Back to Localai

Model & Backend Management

core/http/views/manage.html

4.1.32.9 KB
Original Source

Model & Backend Management

Manage your installed models and backends

System RAM Reclaimer Active

System RAM RAM

Total VRAM:

Models storage

{{template "views/partials/inprogress" .}} {{ if eq (len .ModelsConfig) 0 }}

No models installed yet

Get started by installing a model from the gallery or importing it

Browse Model GalleryImport ModelDocumentation {{ if ne (len .Models) 0 }}

Detected Model Files

These models were found but don't have configuration files yet

{{ range .Models }} {{.}} {{end}}

{{end}}

{{ else }} {{ $modelsN := len .ModelsConfig}} {{ $modelsN = add $modelsN (len .Models)}}

Installed Models

{{$modelsN}} model{{if gt $modelsN 1}}s{{end}} ready to use

Update

NameStatusBackendUse CasesActions
{{$galleryConfig:=.GalleryConfig}} {{ $loadedModels := .LoadedModels }} {{ range .ModelsConfig }} {{ $backendCfg := . }} {{ $cfg:= index $galleryConfig .Name}}

{{ if and $cfg $cfg.Icon }} {{ else }} {{ end }} {{ if index $loadedModels .Name }}

{{ end }} {{.Name}} | {{ if index $loadedModels .Name }} Running {{ end }} {{ if and $backendCfg (or (ne $backendCfg.MCP.Servers "") (ne $backendCfg.MCP.Stdio "")) }} MCP {{ end }} | {{ if .Backend }} {{.Backend}} {{ else }} Auto {{ end }} | {{ range .KnownUsecaseStrings }} {{ if eq . "FLAG_CHAT" }} Chat {{ end }} {{ if eq . "FLAG_IMAGE" }} Image {{ end }} {{ if eq . "FLAG_TTS" }} TTS {{ end }} {{ if eq . "FLAG_SOUND_GENERATION" }} Sound {{ end }} {{ end }} | {{ if index $loadedModels .Name }} {{ end }} | {{ end }} {{ range .Models }} | {{.}} | No Config | Auto | — | — | {{end}}

{{ end }}

Installed Backends

{{ if gt (len .InstalledBackends) 0 }} {{ end }}

{{len .InstalledBackends}} backend{{if gt (len .InstalledBackends) 1}}s{{end}} ready to use

{{ if eq (len .InstalledBackends) 0 }}

No backends installed yet

Backends power your AI models. Install them from the backend gallery to get started

Browse Backend GalleryDocumentation

{{ else }}

NameTypeMetadataActions
{{ range .InstalledBackends }}
{{.Name}}
{{ if .IsSystem }} System {{ else }} User {{ end }} {{ if .IsMeta }} Meta {{ end }}
{{ if and .Metadata .Metadata.Alias }} Alias: {{.Metadata.Alias}} {{ end }} {{ if and .Metadata .Metadata.MetaBackendFor }} For: {{.Metadata.MetaBackendFor}} {{ end }} {{ if and .Metadata .Metadata.InstalledAt }} {{.Metadata.InstalledAt}} {{ end }}
{{ if not .IsSystem }} {{ else }} — {{ end }}
{{end}}

{{ end }}

{{template "views/partials/footer" .}}