alphacentri/comfyui-nvidia
1
0 Fork 0
Code Issues Pull Requests Actions Packages Releases Activity

Image Studio: lock in working config — Native + enable_thinking=false

Browse Source 
User confirmed end-to-end working stack:
  - base_model_id: huihui_ai/qwen3-vl-abliterated:8b
  - function_calling: native (gives 'View Result from edit_image'
    blocks, structured tool call traces)
  - custom_params:
      tool_choice: required        (forces tool call every turn)
      enable_thinking: false       (server-side disable; abliterated
                                    Qwen ignores the /no_think system
                                    prompt directive — when thinking
                                    is on the tool call leaks inside
                                    a thinking block as text)

Updated image_studio.json + the markdown setup table + the
'Qwen 3.x quirk' explainer to match. The /no_think line in the
system prompt stays in for non-abliterated Qwen variants but is now
documented as best-effort backup; enable_thinking=false is the
authoritative kill-switch.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
57_WolveandClaude Opus 4.7 committed 2026-04-19 18:12:24 -05:00
1 parent f5a222fe6f
commit d8c8421361
2 files changed
+12 -8
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

deployments/ai-stack/openwebui-models/image_studio.md
+9 -6
View File
@@ -47,11 +47,11 @@ In the **Advanced Params** section:
| Field | Value |
| ----- | ----- |
| Function Calling | `Default` — `Native` leaks Qwen 3.5's tool-call XML to chat as text instead of executing it. `Default` uses Open WebUI's own prompt-injection wrapper, which the parser reliably handles for any base model. Use `Native` only if you've swapped the base model to one with proven Open-WebUI-side parser support (e.g. `mistral-nemo:12b`). |
| Function Calling | `Native` — works cleanly on `huihui_ai/qwen3-vl-abliterated:8b` once thinking is disabled (see Custom Parameters). Native gives you the structured "View Result from edit_image" blocks and "Thought for X seconds" tracing in the UI. |
| Temperature | `0.5` (lower = more reliable tool-calling) |
| Top P | `0.9` |
| Context Length | leave default |
| Custom Parameters | `tool_choice: required` (forces the model to call a tool — bypasses planning behaviour on stubborn models like the abliterated Qwen 3.5) |
| Custom Parameters | `tool_choice: required` (forces the model to call a tool every turn) **and** `enable_thinking: false` (disables Qwen's thinking mode at the API level — the `/no_think` system-prompt directive isn't honored by abliterated Qwen builds, but this server-side flag is). Both required for reliable behaviour on `huihui_ai/qwen3-vl-abliterated:8b`. |
Save. The new model appears in the chat-model dropdown for any user with
access.
@@ -199,10 +199,13 @@ many image edit prompts even though the LLM's only job is dispatch
the LLM never sees). Abliterated VL gets us both reliable tool
calling AND a cooperative dispatcher.
**Qwen 3.x quirk:** thinking mode is on by default. The shipped
system prompt starts with `/no_think` to suppress it. If the model
still plans instead of firing the tool, set
`enable_thinking: false` in **Advanced Params → Custom Parameters**.
**Qwen 3.x quirk:** thinking mode is on by default and abliterated
builds ignore the system-prompt `/no_think` directive — the model
emits its tool call inside a thinking block that the parser treats
as final response text instead of a real tool invocation. The
shipped preset sets `enable_thinking: false` in `custom_params`,
which Ollama enforces server-side and the model can't ignore. Don't
remove it.
### Alternatives