Skip to content

docs: document dynamic model fetching feature #12112

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
nil957 wants to merge 1 commit into
base: main
Choose a base branch
from
+38 −0
Open

docs: document dynamic model fetching feature #12112

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
38 changes: 38 additions & 0 deletions docs/customize/models.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,44 @@ If no model is specified, Continue automatically uses the default agent with our
Explore models in [The Hub](https://continue.dev/hub?type=models).
</Info>

## Dynamic Model Discovery

Continue can automatically discover and load models from your configured providers, making it easy to access the latest models without manual configuration.

### Supported Providers

The following providers support dynamic model fetching:

| Provider | Auto-loads on startup | Refresh with API key |
|----------|----------------------|---------------------|
| **Ollama** | ✅ Yes | ✅ Yes |
| **OpenRouter** | ✅ Yes | ✅ Yes |
| **Anthropic** | ❌ No | ✅ Yes |
| **Google Gemini** | ❌ No | ✅ Yes |
| **OpenAI** | ❌ No | ✅ Yes |
| **Other providers** | ❌ No | ✅ Yes (if supported) |

### How It Works

1. **Automatic loading**: Ollama and OpenRouter models are automatically loaded when you open Continue
2. **Manual refresh**: For other providers, enter your API key in the "Add Model" UI and click the refresh icon to fetch available models
3. **Capability detection**: Continue automatically detects model capabilities (`contextLength`, `maxTokens`, `supportsTools`) and saves them to your `config.yaml`
Copy link
Copy Markdown
Contributor

@cubic-dev-ai cubic-dev-ai bot Apr 11, 2026 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2: Docs describe an internal field (supportsTools) as if it were persisted in config.yaml, which mismatches the config-facing capability key and can mislead users.

Prompt for AI agents 
Check if this issue is valid — if so, understand the root cause and fix it. At docs/customize/models.mdx, line 52:

<comment>Docs describe an internal field (`supportsTools`) as if it were persisted in `config.yaml`, which mismatches the config-facing capability key and can mislead users.</comment>

<file context>
@@ -28,6 +28,44 @@ If no model is specified, Continue automatically uses the default agent with our
+
+1. **Automatic loading**: Ollama and OpenRouter models are automatically loaded when you open Continue
+2. **Manual refresh**: For other providers, enter your API key in the "Add Model" UI and click the refresh icon to fetch available models
+3. **Capability detection**: Continue automatically detects model capabilities (`contextLength`, `maxTokens`, `supportsTools`) and saves them to your `config.yaml`
+
+### Using the Refresh Button
</file context>
Suggested change
3. **Capability detection**: Continue automatically detects model capabilities (`contextLength`, `maxTokens`, `supportsTools`) and saves them to your `config.yaml`
3. **Capability detection**: Continue automatically detects model capabilities (for example `contextLength`, `maxTokens`, and tool support via `capabilities.tools`) and saves them to your `config.yaml`
Fix with Cubic


### Using the Refresh Button

When adding a model from a provider that requires an API key:

1. Open the model selector and click "Add Model"
2. Select your provider (e.g., Anthropic, OpenAI, Gemini)
3. Enter your API key
4. Click the **refresh icon** that appears next to the model dropdown
5. Continue will fetch all available models from that provider
6. Select the model you want to add

<Tip>
Model capabilities like context length and tool support are automatically detected and saved when you add a model this way.
</Tip>

## Learn More About Models

Continue supports [many model providers](/customize/model-providers/top-level/openai), including Anthropic, OpenAI, Gemini, Ollama, Amazon Bedrock, Azure, xAI, and more. Models can have various roles like `chat`, `edit`, `apply`, `autocomplete`, `embed`, and `rerank`.
Expand Down
Loading