From d0378bc958d488d8911ebe80864478ca94470b0f Mon Sep 17 00:00:00 2001
From: =?UTF-8?q?Oleg=20=C5=A0elajev?= <shelajev@gmail.com>
Date: Tue, 27 Jan 2026 14:58:18 +0200
Subject: [PATCH] Add documentation on running with Docker Model Runner

---
 docs/providers/docker.md | 83 ++++++++++++++++++++++++++++++++++++++++
 docs/providers/models.md |  1 +
 2 files changed, 84 insertions(+)
 create mode 100644 docs/providers/docker.md

diff --git a/docs/providers/docker.md b/docs/providers/docker.md
new file mode 100644
index 000000000..a9b4a799f
--- /dev/null
+++ b/docs/providers/docker.md
@@ -0,0 +1,83 @@
+---
+summary: "Run Moltbot with Docker Model Runner (private local LLMs)"
+read_when:
+  - You want to run Moltbot with local models via Docker Model Runner (DMR)
+  - You use Docker Desktop and want to leverage the built-in model runner
+---
+# Docker Model Runner
+
+Docker Model Runner (DMR) is a private, local AI inference engine built into Docker Desktop and Docker Engine. It allows you to run open-source models like `gpt-oss` and `glm-4.7-flash` with full privacy on your own hardware.
+
+## Quick start
+
+1) **Install Docker Desktop**: Ensure you have the latest version of [Docker Desktop](https://www.docker.com/products/docker-desktop/) installed.
+
+2) **Enable Model Runner**: Open your terminal and enable TCP access for the model runner:
+
+```bash
+docker desktop enable model-runner --tcp
+```
+
+3) **Pull a model**: Pull a recommended model to your local machine:
+
+```bash
+docker model pull gpt-oss
+# or
+docker model pull glm-4.7-flash
+```
+
+4) **Configure Moltbot**: Update your configuration to point to the DMR server's OpenAI-compatible API endpoint (typically `http://localhost:12434/v1`).
+
+```json5
+{
+  models: {
+    providers: {
+      docker: {
+        baseUrl: "http://localhost:12434/v1",
+        apiKey: "docker-dmr", // Any value works as DMR doesn't require a real key
+        api: "openai-completions",
+        models: [
+          {
+            id: "gpt-oss",
+            name: "GPT OSS",
+            contextWindow: 8192,
+            maxTokens: 32768
+          }
+        ]
+      }
+    }
+  },
+  agents: {
+    defaults: {
+      model: { primary: "docker/gpt-oss" }
+    }
+  }
+}
+```
+
+## How it works
+
+Moltbot connects to Docker Model Runner via its OpenAI-compatible API. This allows you to leverage powerful local models while maintaining complete data privacy—your prompts and data never leave your machine.
+
+### Key Benefits
+
+- **Privacy**: All inference happens locally on your hardware.
+- **Simplicity**: No complex setup; works directly with Docker Desktop.
+
+## Advanced Configuration
+
+### Custom Models
+
+You can repackage and use models with larger context windows or specific capabilities using `docker model pull`. Once pulled, simply add the model ID to your `models` list in the configuration.
+
+### Troubleshooting
+
+- **Connection issues**: Ensure that TCP access is enabled with `docker desktop enable model-runner --tcp`.
+- **Port conflicts**: Check if another service (like Ollama) is already using port `12434`.
+- **Model availability**: Run `docker model ls` to see your currently installed models.
+
+## See Also
+
+- [Run a Private Personal AI with Moltbot + DMR](https://www.docker.com/blog/moltbot-docker-model-runner-private-personal-ai/) - Official Docker Blog Post
+- [Model Providers](/providers/models) - Overview of all supported providers
+- [Configuration](/gateway/configuration) - Full config reference
diff --git a/docs/providers/models.md b/docs/providers/models.md
index 8c2ed4f5b..e6c04e74c 100644
--- a/docs/providers/models.md
+++ b/docs/providers/models.md
@@ -43,6 +43,7 @@ See [Venice AI](/providers/venice).
 - [MiniMax](/providers/minimax)
 - [Venius (Venice AI)](/providers/venice)
 - [Amazon Bedrock](/bedrock)
+- [Docker Model Runner](/providers/docker)
 
 For the full provider catalog (xAI, Groq, Mistral, etc.) and advanced configuration,
 see [Model providers](/concepts/model-providers).