docs: add guide for using Claude Code with Docker Model Runner#24458
docs: add guide for using Claude Code with Docker Model Runner#24458Pradumnasaraf wants to merge 1 commit intodocker:mainfrom
Conversation
✅ Deploy Preview for docsdocker ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
brandonh6k
left a comment
brandonh6k
left a comment
There was a problem hiding this comment.
We may also want to update the Recommended Models table at the bottom of the DMR IDE Integrations page to include the models referenced in this guide.
| Claude Code now sends requests to Docker Model Runner instead of Anthropic's | ||
| hosted API. | ||
|
|
||
| ## Step 3: Make the endpoint persistent |
There was a problem hiding this comment.
It feels like we should have Step 5 here and shift everything else down one - to me, troubleshooting should be right after first launch and then we move through the rest of the steps in order. That way if a user runs into a problem, they don't have to scroll past 2 other steps to get to the troubleshooting section.
| package `gpt-oss` with a larger context window, and inspect requests. | ||
| keywords: ai, claude code, docker model runner, anthropic, local models, coding assistant | ||
| params: | ||
| tags: [ai] |
There was a problem hiding this comment.
Is this where tags goes? I've seen some inconsistency in the guides - some have tags as a top level element in the frontmatter and others have it here under params. I didn't see anything in STYLE.md that said one way or the other.
| model provider. You'll point Claude Code at the local Anthropic-compatible API, | ||
| run a coding model, and package `gpt-oss` with a larger context window for | ||
| longer repository prompts. | ||
|
|
There was a problem hiding this comment.
Do we want a learning outcomes list here? (see agentic-ai or localstack for example). Something like this for instance:
In this guide, you'll learn how to:
- Pull a coding model and start Claude Code with Docker Model Runner
- Make the endpoint configuration persistent
- Package a model with a larger context window
- Verify and inspect API requests
|
|
||
| - [Docker Model Runner overview](../manuals/ai/model-runner/_index.md) | ||
| - [Docker Model Runner API reference](../manuals/ai/model-runner/api-reference.md) | ||
| - [IDE and tool integrations](../manuals/ai/model-runner/ide-integrations.md) |
There was a problem hiding this comment.
The IDE Integrations page doesn't have a Claude Code section. Can we add one as part of this PR?
|
|
||
| ```bash {title="~/.bashrc or ~/.zshrc"} | ||
| export ANTHROPIC_BASE_URL=http://localhost:12434 | ||
| ``` |
There was a problem hiding this comment.
No Powershell equivalent after we had a Powershell in Step 2 above.
2 participants
Description
Add a guide for using Claude Code with Docker Model Runner
Reviews