Image Studio: revert function_calling to default — 0.9.6+ breaks Native

OWUI 0.9.6+ regression: Function Calling: Native on
huihui_ai/qwen3-vl-abliterated:8b produces empty assistant turns
even with enable_thinking=false in custom_params. The model's
tool-call output stops being dispatched and the chat completion
finishes successfully, so the failure presents as "the model
decided not to call the tool" — no error, no tool block, just
empty assistant content with follow-up chips. Diagnosed in a live
debug session: confirmed Function Calling was Native in the
running OWUI, enable_thinking was off, tool still didn't fire;
flipping to Default fixed dispatch immediately.

This supersedes d8c8421 ("lock in working config — Native +
enable_thinking=false"), which was correct through OWUI 0.9.5 but
no longer holds. Returns to the 1ed2e72 config (Default) for the
same fundamental reason: Native does not reliably parse Qwen 3.x
output on the current OWUI parser. Trade-off (unchanged from the
1ed2e72 era): no structured "View Result from edit_image" UI
block — tool results render as plain text in the assistant
message instead.

Kept enable_thinking=false in custom_params. It's no longer
strictly required (Default's wrapper doesn't read model thinking
output), but it saves the tokens Qwen would otherwise spend on
hidden thinking before each dispatch.

Updated image_studio.md to match: Function Calling table row,
Custom Parameters note, and Qwen-quirk explainer all rewritten;
added a new "Open WebUI 0.9.6+ regression" paragraph documenting
the empty-turn signature so the failure mode is recognisable
without re-deriving it.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
57_WolveandClaude Opus 4.7 committed 2026-06-06 20:20:05 -05:00
1 parent 698136c37e
commit 895725120a
2 files changed
+23 -9

No files matched your search

@@ -47,11 +47,11 @@ In the **Advanced Params** section:
| Field | Value |
| ----- | ----- |
| Function Calling | `Native` — works cleanly on `huihui_ai/qwen3-vl-abliterated:8b` once thinking is disabled (see Custom Parameters). Native gives you the structured "View Result from edit_image" blocks and "Thought for X seconds" tracing in the UI. |
| Function Calling | `Default` — Open WebUI's prompt-injection wrapper. `Native` was the working setting on OWUI ≤ 0.9.5 (paired with `enable_thinking: false`), but on 0.9.6+ Native produces empty assistant turns on `huihui_ai/qwen3-vl-abliterated:8b` even with thinking disabled — the model's tool-call output stops getting dispatched. `Default` is the reliable path until upstream resolves it. Trade-off: you lose the structured "View Result from edit_image" UI block; the tool result comes back as plain text in the assistant message instead. |
| Temperature | `0.5` (lower = more reliable tool-calling) |
| Top P | `0.9` |
| Context Length | leave default |
| Custom Parameters | `tool_choice: required` (forces the model to call a tool every turn) **and** `enable_thinking: false` (disables Qwen's thinking mode at the API level — the `/no_think` system-prompt directive isn't honored by abliterated Qwen builds, but this server-side flag is). Both required for reliable behaviour on `huihui_ai/qwen3-vl-abliterated:8b`. |
| Custom Parameters | `tool_choice: required` (forces the model to call a tool every turn) **and** `enable_thinking: false` (disables Qwen's thinking mode at the API level — the `/no_think` system-prompt directive isn't honored by abliterated Qwen builds, but this server-side flag is). `enable_thinking: false` is no longer strictly required with `Function Calling: Default` (the wrapper doesn't read model thinking output), but keeping it set saves the tokens Qwen would otherwise spend thinking before each dispatch — leave it on. |
Save. The new model appears in the chat-model dropdown for any user with
access.
@@ -200,12 +200,26 @@ the LLM never sees). Abliterated VL gets us both reliable tool
calling AND a cooperative dispatcher.
**Qwen 3.x quirk:** thinking mode is on by default and abliterated
builds ignore the system-prompt `/no_think` directive — the model
emits its tool call inside a thinking block that the parser treats
as final response text instead of a real tool invocation. The
shipped preset sets `enable_thinking: false` in `custom_params`,
which Ollama enforces server-side and the model can't ignore. Don't
remove it.
builds ignore the system-prompt `/no_think` directive. With
`Function Calling: Native` this matters — the model emits its tool
call inside a thinking block that the Native parser treats as final
response text instead of a real tool invocation, and OWUI swallows
the result. With `Function Calling: Default` (the current preset)
the OWUI wrapper doesn't care about the model's thinking output, so
the failure mode disappears even with thinking on. The shipped
preset still sets `enable_thinking: false` in `custom_params` to
save the tokens Qwen would otherwise spend on hidden thinking before
each dispatch.
**Open WebUI 0.9.6+ regression:** `Function Calling: Native` was the
working setting through OWUI 0.9.5 when paired with
`enable_thinking: false`, and committed history reflects that
(d8c8421). On 0.9.6+ Native produces empty assistant turns — the
tool-call output stops being dispatched, and (worse) the chat
finishes successfully so the failure looks like the model "decided
not to call the tool." If you're running ≤ 0.9.5 you can flip
Function Calling to `Native` to get the structured tool-result UI
block back; on 0.9.6+ stay on `Default`.
### Alternatives