Skip to content

feat(server): add chat_template_kwargs#2168

Merged
abetlen merged 1 commit intomainfrom
abetlen/add-chat-template-kwargs-model-setting
Mar 30, 2026
Merged

feat(server): add chat_template_kwargs#2168
abetlen merged 1 commit intomainfrom
abetlen/add-chat-template-kwargs-model-setting

Conversation

@abetlen
Copy link
Copy Markdown
Owner

@abetlen abetlen commented Mar 30, 2026

Adds model-load chat_template_kwargs support to the server, matching the upstream llama.cpp server behavior.

@abetlen abetlen force-pushed the abetlen/add-chat-template-kwargs-model-setting branch from 2f044dd to bd0db41 Compare March 30, 2026 05:36
@abetlen abetlen changed the base branch from abetlen/add-reasoning-effort-chat-template-kwarg to main March 30, 2026 05:36
@abetlen abetlen force-pushed the abetlen/add-chat-template-kwargs-model-setting branch 2 times, most recently from 4a428a9 to 704039b Compare March 30, 2026 05:51
@abetlen abetlen changed the title feat(server): add model-load chat_template_kwargs feat(server): add chat_template_kwargs Mar 30, 2026
@abetlen abetlen force-pushed the abetlen/add-chat-template-kwargs-model-setting branch from 704039b to 44df2f2 Compare March 30, 2026 05:59
@abetlen abetlen force-pushed the abetlen/add-chat-template-kwargs-model-setting branch from 44df2f2 to 77219de Compare March 30, 2026 06:05
@abetlen abetlen merged commit 7257ba9 into main Mar 30, 2026
15 checks passed
@abetlen abetlen deleted the abetlen/add-chat-template-kwargs-model-setting branch March 30, 2026 06:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant