mirror of https://github.com/docker/docs.git
DMR: plugin install (#22664)
<!--Delete sections as needed --> ## Description Add DMR Docker Engine plugin install cmd. ## Related issues or tickets <!-- Related issues, pull requests, or Jira tickets --> ## Reviews <!-- Notes for reviewers here --> <!-- List applicable reviews (optionally @tag reviewers) --> - [X] Technical review - [ ] Editorial review - [ ] Product review --------- Co-authored-by: Jacob Howard <jacob@xenoscopic.com>
This commit is contained in:
parent
4678e937a1
commit
f18151f86c
|
@ -38,6 +38,7 @@ exceptions:
|
||||||
- DCT
|
- DCT
|
||||||
- DEBUG
|
- DEBUG
|
||||||
- DHCP
|
- DHCP
|
||||||
|
- DMR
|
||||||
- DNS
|
- DNS
|
||||||
- DOM
|
- DOM
|
||||||
- DPI
|
- DPI
|
||||||
|
@ -85,8 +86,8 @@ exceptions:
|
||||||
- LTS
|
- LTS
|
||||||
- MAC
|
- MAC
|
||||||
- MATE
|
- MATE
|
||||||
- MCP
|
|
||||||
- mcp
|
- mcp
|
||||||
|
- MCP
|
||||||
- MDM
|
- MDM
|
||||||
- MDN
|
- MDN
|
||||||
- MSI
|
- MSI
|
||||||
|
@ -105,8 +106,8 @@ exceptions:
|
||||||
- PATH
|
- PATH
|
||||||
- PDF
|
- PDF
|
||||||
- PEM
|
- PEM
|
||||||
- PID
|
|
||||||
- PHP
|
- PHP
|
||||||
|
- PID
|
||||||
- POSIX
|
- POSIX
|
||||||
- POST
|
- POST
|
||||||
- QA
|
- QA
|
||||||
|
|
|
@ -8,7 +8,7 @@ params:
|
||||||
group: AI
|
group: AI
|
||||||
weight: 20
|
weight: 20
|
||||||
description: Learn how to use Docker Model Runner to manage and run AI models.
|
description: Learn how to use Docker Model Runner to manage and run AI models.
|
||||||
keywords: Docker, ai, model runner, docker deskotp, llm
|
keywords: Docker, ai, model runner, docker desktop, docker engine, llm
|
||||||
aliases:
|
aliases:
|
||||||
- /desktop/features/model-runner/
|
- /desktop/features/model-runner/
|
||||||
- /ai/model-runner/
|
- /ai/model-runner/
|
||||||
|
@ -45,6 +45,37 @@ Models are pulled from Docker Hub the first time they're used and stored locally
|
||||||
|
|
||||||
You can now use the `docker model` command in the CLI and view and interact with your local models in the **Models** tab in the Docker Desktop Dashboard.
|
You can now use the `docker model` command in the CLI and view and interact with your local models in the **Models** tab in the Docker Desktop Dashboard.
|
||||||
|
|
||||||
|
### Enable DMR in Docker Engine
|
||||||
|
|
||||||
|
1. Ensure you have installed [Docker Engine](/engine/install/).
|
||||||
|
2. DMR is available as a package. To install it, run:
|
||||||
|
|
||||||
|
{{< tabs >}}
|
||||||
|
{{< tab name="Ubuntu/Debian">}}
|
||||||
|
|
||||||
|
```console
|
||||||
|
$ sudo apt-get update
|
||||||
|
$ sudo apt-get install docker-model-plugin
|
||||||
|
```
|
||||||
|
|
||||||
|
{{< /tab >}}
|
||||||
|
{{< tab name="RPM-base distributions">}}
|
||||||
|
|
||||||
|
```console
|
||||||
|
$ sudo dnf update
|
||||||
|
$ sudo dnf install docker-model-plugin
|
||||||
|
```
|
||||||
|
|
||||||
|
{{< /tab >}}
|
||||||
|
{{< /tabs >}}
|
||||||
|
|
||||||
|
3. Test the installation:
|
||||||
|
|
||||||
|
```console
|
||||||
|
$ docker model version
|
||||||
|
$ docker model run ai/smollm2
|
||||||
|
```
|
||||||
|
|
||||||
## Integrate the Docker Model Runner into your software development lifecycle
|
## Integrate the Docker Model Runner into your software development lifecycle
|
||||||
|
|
||||||
You can now start building your Generative AI application powered by the Docker Model Runner.
|
You can now start building your Generative AI application powered by the Docker Model Runner.
|
||||||
|
|
|
@ -152,7 +152,7 @@ Docker GitHub Copilot:
|
||||||
availability: Early Access
|
availability: Early Access
|
||||||
Docker Model Runner:
|
Docker Model Runner:
|
||||||
availability: Beta
|
availability: Beta
|
||||||
requires: Docker Desktop 4.40 and later
|
requires: Docker Engine or Docker Desktop (Windows) 4.41+ or Docker Desktop (MacOS) 4.40+
|
||||||
for: Docker Desktop for Mac with Apple Silicon or Windows with NVIDIA GPUs
|
for: Docker Desktop for Mac with Apple Silicon or Windows with NVIDIA GPUs
|
||||||
Docker Projects:
|
Docker Projects:
|
||||||
availability: Beta
|
availability: Beta
|
||||||
|
|
|
@ -93,6 +93,7 @@
|
||||||
"RHEL-8",
|
"RHEL-8",
|
||||||
"RHEL-9",
|
"RHEL-9",
|
||||||
"RHEL-CentOS-or-Fedora",
|
"RHEL-CentOS-or-Fedora",
|
||||||
|
"RPM-base-distributions",
|
||||||
"Raw",
|
"Raw",
|
||||||
"React",
|
"React",
|
||||||
"Regular-install",
|
"Regular-install",
|
||||||
|
@ -106,6 +107,7 @@
|
||||||
"Specific-version",
|
"Specific-version",
|
||||||
"Svelte",
|
"Svelte",
|
||||||
"Ubuntu",
|
"Ubuntu",
|
||||||
|
"Ubuntu/Debian",
|
||||||
"Unix-pipe",
|
"Unix-pipe",
|
||||||
"Updated-Dockerfile",
|
"Updated-Dockerfile",
|
||||||
"Use-Docker-Init",
|
"Use-Docker-Init",
|
||||||
|
@ -114,6 +116,7 @@
|
||||||
"Using-the-GUI",
|
"Using-the-GUI",
|
||||||
"Using-the-MCP-Toolkit-Recommended",
|
"Using-the-MCP-Toolkit-Recommended",
|
||||||
"VS-Code",
|
"VS-Code",
|
||||||
|
"Via-Docker-Desktop-Recommended",
|
||||||
"Vue",
|
"Vue",
|
||||||
"WSL-2-backend-Arm-Early-Access",
|
"WSL-2-backend-Arm-Early-Access",
|
||||||
"WSL-2-backend-x86_64",
|
"WSL-2-backend-x86_64",
|
||||||
|
|
Loading…
Reference in New Issue