Changes

• MTP speculative decoding support: Add draft-mtp as a new --spec-type option. Auto-enabled when loading MTP GGUFs (e.g. Qwen 3.6 MoE MTP builds).
• Web search improvements:
  • Add snippet support to the web_search tool: results now include a short text excerpt that often answers the query directly, eliminating the need for a follow-up fetch_webpage call (#7548).
  • Drop link URLs from fetch_webpage output (links now appear as plain text instead of [text](url) markdown), significantly reducing tokens used per page.
  • Prettier rendering of web_search results in the chat, with a spinner during the call.
  • Add an info message to the "Activate web search" checkbox.
• Show live generation speed (tokens/s) and context size while generating (#7563).
• DGX Spark support: Add Linux aarch64 portable builds.
• Electron
  • Add "Check for updates" button in the Session tab.
  • Add a folder picker for the models directory.
  • Add right-click context menu for copying text.
  • Add a spellcheck toggle in the Session tab (#7550).
  • Store app data in user_data/cache/electron instead of the OS default location.
  • Disable DNS-over-HTTPS probes.
• One-click installer: Track the latest release tag instead of bleeding-edge main.
• Auto-detect and auto-select sibling mmproj files when loading a model (#7564).
• Detect mmproj-*.gguf files in the main models folder: They appear in the mmproj dropdown and are hidden from the regular model dropdown.
• Project icon: Add an icon, courtesy of LMLocalizer on Reddit.
• Treat negative --ctx-size values as auto (0).
• UI
  • Add drag-and-drop file upload support to the chat input (Gradio fork).
  • Reorganize the right sidebar with Mode/Character/Chat style on top.
  • Hide reasoning and tools controls in chat mode (only shown in instruct / chat-instruct).
  • Fade in new messages, fix scroll-up jump on send.
  • Rename "Send dummy message/reply" to "Insert user/assistant message".
  • Polish character dropdown in chat tab.
  • Tighten spacing between dropdowns and refresh buttons.
  • Improve the looks of the Session tab.

Security

• Restrict CORS to localhost by default to prevent drive-by API access. --listen and --public-api opt into network exposure.
• Sanitize character name in load_character to prevent path traversal.
• fix: prevent path traversal in load_template_by_name (#7562). Thanks, @Allen930311.
• UI: Improve web search security by rejecting non-HTTP links.

Bug fixes

• Fix llama-server not being killed when the parent process exits on Windows, e.g. when closing the console window or killing python.exe (#7574).
• Fix streaming output leaking across chats when switching mid-stream (#7555).
• Fix continue-mode regressions across template families.
• Fix incorrect prompts generated with continue mode. Thanks, @MeemeeLab.
• Fix thinking channel being lost across tool-call turns (#7578).
• Fix API model load silently dropping hyphenated arg keys (#7577).
• Fix chat deletion failing when user_data/logs is a symlink (#7579).
• Fix token count not being set in non-streaming mode.
• Keep web search blocks closed when the user closes them mid-stream.
• fix(win): set PYTHONUTF8 for non-ASCII locale Windows compatibility (#7560). Thanks, @jerry78424.
• Set TORCH_VERSION to 2.9.0 to match xformers 0.0.33's torch pin (#7581). Thanks, @AJ-Gazin.

Dependency updates

• Update llama.cpp to ggml-org/llama.cpp@e947228
• Update ik_llama.cpp to ikawrakow/ik_llama.cpp@40254a5
• Update ExLlamaV3 to 0.0.34

Portable builds

TextGen is now a desktop app for local LLMs. Download, unzip, double-click.

Windows

Linux

macOS

macOS note: You need to run xattr -cr /path/to/your/textgen-folder on the extracted folder before launching. See #7558.

Updating a portable install:

1. Download and extract the latest version.
2. Replace the user_data folder with the one in your existing install. All your settings and models will be moved.

Starting with 4.0, you can also move user_data one folder up, next to the install folder. It will be detected automatically, making updates easier:

textgen-4.6/
textgen-4.7/
user_data/    <-- shared by both installs

Changes

• Redesigned chat composer: Taller input area with the paperclip and message-action buttons pinned to the bottom, similar to Gemini and DeepSeek.
• Smooth scroll animation when sending a new message: Inspired by Gemini's chat UI.
• Electron improvements:
  • Persist window bounds and maximize state across launches.
  • Add a --no-electron flag to skip the desktop window and use the web UI in the browser instead.
  • Disable spellcheck in the chat input.
• API: Add support for list-format content in tool and assistant messages.
• Add more space below the last chat/chat-instruct message so its action buttons have breathing room.

Bug fixes

• Electron:
  • Fix --listen mode in the launcher.
  • Fix missing log colors on Windows.
  • Fix big character picture failing to load (#7540).
• Fix speculative decoding broken by upstream llama.cpp arg renames (#7541).
• Fix truncation length reverting after model load on UI reload (#7540).
• Don't clear the chat input when sending a message with no model loaded (#7542).

Dependency updates

• Update llama.cpp to ggml-org/llama.cpp@68380ae
• Update ik_llama.cpp to ikawrakow/ik_llama.cpp@9a26522

Portable builds

TextGen is now a desktop app for local LLMs. Download, unzip, double-click.

Windows

Linux

macOS

macOS note: You need to run xattr -cr /path/to/your/textgen-folder on the extracted folder before launching. See #7558.

Updating a portable install:

1. Download and extract the latest version.
2. Replace the user_data folder with the one in your existing install. All your settings and models will be moved.

Starting with 4.0, you can also move user_data one folder up, next to the install folder. It will be detected automatically, making updates easier:

textgen-4.6/
textgen-4.7/
user_data/    <-- shared by both installs

Changes

• Native desktop app: Portable builds now bundle Electron and open as a native window. Run textgen / textgen.bat instead of the previous start scripts. Pass --listen or --nowebui to skip the window and run the server directly.
• Major UI overhaul:
  • Replace Noto Sans with Inter as the default font.
  • Replace emoji refresh/save/delete buttons with Lucide SVG icons.
  • Turn the chat mode selector (chat / chat-instruct / instruct) into a 3-button segmented control.
  • Redesign the chat input as a single rounded card with a circular accent-colored send button.
  • Use a flat underline for the active tab indicator.
  • Replace the sidebar toggle buttons with 3px hairline handles on desktop.
• Tensor parallelism for llama.cpp: New --split-mode flag (replacing --row-split) with a tensor option that can make multi-GPU inference 60%+ faster. On the ik_llama.cpp backend, tensor and row fall back to graph.
• Replace DuckDuckGo HTML scraping in the web search tool with the ddgs library, which is more robust against DuckDuckGo's bot blocking.
• Add support for standalone .jinja/.jinja2 instruction template files in the UI, in addition to the existing .yaml format (#7517).

Bug fixes

• Fix Stop button being ignored during tool call approval, and not interrupting between tool turns in multi-turn tool loops.
• Fix race condition in the ExLlamaV3 backend that could affect concurrent API requests.
• Fix extension settings not saving for extensions inside user_data/extensions (#7525).

Dependency updates

• Update llama.cpp to ggml-org/llama.cpp@0929436
• Update ik_llama.cpp to ikawrakow/ik_llama.cpp@9f1deef
• Update transformers to 5.6

Portable builds

TextGen is now a desktop app for local LLMs. Download, unzip, double-click.

Windows

Linux

macOS

Updating a portable install:

1. Download and extract the latest version.
2. Replace the user_data folder with the one in your existing install. All your settings and models will be moved.

Starting with 4.0, you can also move user_data one folder up, next to the install folder. It will be detected automatically, making updates easier:

textgen-4.6/
textgen-4.7/
user_data/    <-- shared by both installs

Updated to v4.7.3

https://github.com/oobabooga/textgen/releases/tag/v4.7.3

Updated to v4.7.3

https://github.com/oobabooga/textgen/releases/tag/v4.7.3

Updated to v4.7.3

https://github.com/oobabooga/textgen/releases/tag/v4.7.3

Changes

• Tool call confirmation: Add inline approve/reject/always-approve buttons that appear before each tool call is executed. Enable via the new "Confirm tool calls" checkbox in the Chat tab.
• Stdio MCP server support: In addition to HTTP MCP servers, you can now configure local subprocess-based MCP servers via user_data/mcp.json, using the same format as Claude Desktop and Cursor. [Tutorial]
• preserve_thinking chat template parameter: New UI checkbox and --preserve-thinking CLI flag to control whether thinking blocks from prior turns are kept in the context.
• UI: Sidebars overhaul: Sidebars now toggle independently and persist their state on page refresh. Default visibility adapts to viewport width.
• llama.cpp: Pass --draft-min 48 by default for draftless speculative decoding.
• Only show the "Reasoning effort" and "Enable thinking" controls for models whose chat template actually uses them.
• Cache MCP tool discovery to avoid re-querying servers on each generation.
• Add model download branch handling in download_model_wrapper (#7506). Thanks, @Th-Underscore.
• UI: Improve border colors in light theme, fix code block copy button colors and centering, fix code block scrollbar flash during page load, improve past chats menu spacing.

Security

• Fix SSRF vulnerabilities in URL fetching: add backslash and userinfo rejection, validate every redirect hop.

Bug fixes

• Fix Gemma 4 thinking tags not hidden after tool calls (#7509).
• Fix GPT-OSS channel tokens leaking in UI after tool calls.
• Fix Slider preprocess not handling None from cleared number input. 🆕 - v4.6.1.
• llama.cpp: Fix multimodal by using server's random media marker. 🆕 - v4.6.1.

Dependency updates

• Update llama.cpp to ggml-org/llama.cpp@6217b49
• Update ik_llama.cpp to ikawrakow/ik_llama.cpp@286ce32
• Update ExLlamaV3 to 0.0.30

Portable builds

Below you can find self-contained packages that work with GGUF models (llama.cpp) and require no installation! Just download the right version for your system, unzip/extract, and run.

Windows

Linux

macOS

Updating a portable install:

1. Download and extract the latest version.
2. Replace the user_data folder with the one in your existing install. All your settings and models will be moved.

Starting with 4.0, you can also move user_data one folder up, next to the install folder. It will be detected automatically, making updates easier:

text-generation-webui-4.0/
text-generation-webui-4.1/
user_data/                    <-- shared by both installs

Updated to v4.6.2

https://github.com/oobabooga/textgen/releases/tag/v4.6.2

Updated to v4.6.2

https://github.com/oobabooga/textgen/releases/tag/v4.6.2

Changes

• The project has been renamed to TextGen! The GitHub URL is now github.com/oobabooga/textgen.
• Logits display improvements (#7486). Thanks, @wiger3.
• UI: Add sky-blue color for quoted text in light mode (#7473). Thanks, @Th-Underscore.
• Reduce VRAM peak in prompt logprobs forward pass.

Bug fixes

• Fix Gemma-4 tool calling: handle double quotes and newline chars in arguments (#7477). Thanks, @mamei16.
• Fix chat scroll getting stuck on thinking blocks (#7485).
• Prevent Tool Icon SVG Shrinking When Tool Calls Are Long (#7488). Thanks, @mamei16.
• Fix: wrong chat deleted when selection changes before confirm (#7483). Thanks, @lawrence3699.
• Fix bos/eos tokens not being set for models without a chat template. Defaults are now reset before reading model metadata.
• Fix duplicate BOS token being prepended in ExLlamav3.
• Fix version metadata not syncing on Continue (#7492).
• Fix row_split not working with ik_llama.cpp — --split-mode row is now converted to --split-mode graph (#7489).
• Fix "Start reply with" crash (#7497). 🆕 - v4.5.1.
• Fix tool responses with Gemma 4 template (#7498). 🆕 - v4.5.1.
• UI: Fix consecutive thinking blocks rendering with Gemma 4. 🆕 - v4.5.1.
• Fix bos/eos tokens being overwritten after GGUF metadata sets them (#7496). 🆕 - v4.5.2

Dependency updates

• Update llama.cpp to ggml-org/llama.cpp@5d14e5d
• Update ik_llama.cpp to ikawrakow/ik_llama.cpp@47986f0

Portable builds

Below you can find self-contained packages that work with GGUF models (llama.cpp) and require no installation! Just download the right version for your system, unzip/extract, and run.

Windows

Linux

macOS

Updating a portable install:

1. Download and extract the latest version.
2. Replace the user_data folder with the one in your existing install. All your settings and models will be moved.

Starting with 4.0, you can also move user_data one folder up, next to the install folder. It will be detected automatically, making updates easier:

text-generation-webui-4.0/
text-generation-webui-4.1/
user_data/                    <-- shared by both installs