Image Studio: revert function_calling to default — 0.9.6+ breaks Native
OWUI 0.9.6+ regression: Function Calling: Native on huihui_ai/qwen3-vl-abliterated:8b produces empty assistant turns even with enable_thinking=false in custom_params. The model's tool-call output stops being dispatched and the chat completion finishes successfully, so the failure presents as "the model decided not to call the tool" — no error, no tool block, just empty assistant content with follow-up chips. Diagnosed in a live debug session: confirmed Function Calling was Native in the running OWUI, enable_thinking was off, tool still didn't fire; flipping to Default fixed dispatch immediately. This supersedesd8c8421("lock in working config — Native + enable_thinking=false"), which was correct through OWUI 0.9.5 but no longer holds. Returns to the1ed2e72config (Default) for the same fundamental reason: Native does not reliably parse Qwen 3.x output on the current OWUI parser. Trade-off (unchanged from the1ed2e72era): no structured "View Result from edit_image" UI block — tool results render as plain text in the assistant message instead. Kept enable_thinking=false in custom_params. It's no longer strictly required (Default's wrapper doesn't read model thinking output), but it saves the tokens Qwen would otherwise spend on hidden thinking before each dispatch. Updated image_studio.md to match: Function Calling table row, Custom Parameters note, and Qwen-quirk explainer all rewritten; added a new "Open WebUI 0.9.6+ regression" paragraph documenting the empty-turn signature so the failure mode is recognisable without re-deriving it. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
698136c37e
commit
895725120a
2 files changed
+23
-9
No files matched your search
@@ -47,11 +47,11 @@ In the **Advanced Params** section:
|
||||
|
||||
| Field | Value |
|
||||
| ----- | ----- |
|
||||
| Function Calling | `Native` — works cleanly on `huihui_ai/qwen3-vl-abliterated:8b` once thinking is disabled (see Custom Parameters). Native gives you the structured "View Result from edit_image" blocks and "Thought for X seconds" tracing in the UI. |
|
||||
| Function Calling | `Default` — Open WebUI's prompt-injection wrapper. `Native` was the working setting on OWUI ≤ 0.9.5 (paired with `enable_thinking: false`), but on 0.9.6+ Native produces empty assistant turns on `huihui_ai/qwen3-vl-abliterated:8b` even with thinking disabled — the model's tool-call output stops getting dispatched. `Default` is the reliable path until upstream resolves it. Trade-off: you lose the structured "View Result from edit_image" UI block; the tool result comes back as plain text in the assistant message instead. |
|
||||
| Temperature | `0.5` (lower = more reliable tool-calling) |
|
||||
| Top P | `0.9` |
|
||||
| Context Length | leave default |
|
||||
| Custom Parameters | `tool_choice: required` (forces the model to call a tool every turn) **and** `enable_thinking: false` (disables Qwen's thinking mode at the API level — the `/no_think` system-prompt directive isn't honored by abliterated Qwen builds, but this server-side flag is). Both required for reliable behaviour on `huihui_ai/qwen3-vl-abliterated:8b`. |
|
||||
| Custom Parameters | `tool_choice: required` (forces the model to call a tool every turn) **and** `enable_thinking: false` (disables Qwen's thinking mode at the API level — the `/no_think` system-prompt directive isn't honored by abliterated Qwen builds, but this server-side flag is). `enable_thinking: false` is no longer strictly required with `Function Calling: Default` (the wrapper doesn't read model thinking output), but keeping it set saves the tokens Qwen would otherwise spend thinking before each dispatch — leave it on. |
|
||||
|
||||
Save. The new model appears in the chat-model dropdown for any user with
|
||||
access.
|
||||
@@ -200,12 +200,26 @@ the LLM never sees). Abliterated VL gets us both reliable tool
|
||||
calling AND a cooperative dispatcher.
|
||||
|
||||
**Qwen 3.x quirk:** thinking mode is on by default and abliterated
|
||||
builds ignore the system-prompt `/no_think` directive — the model
|
||||
emits its tool call inside a thinking block that the parser treats
|
||||
as final response text instead of a real tool invocation. The
|
||||
shipped preset sets `enable_thinking: false` in `custom_params`,
|
||||
which Ollama enforces server-side and the model can't ignore. Don't
|
||||
remove it.
|
||||
builds ignore the system-prompt `/no_think` directive. With
|
||||
`Function Calling: Native` this matters — the model emits its tool
|
||||
call inside a thinking block that the Native parser treats as final
|
||||
response text instead of a real tool invocation, and OWUI swallows
|
||||
the result. With `Function Calling: Default` (the current preset)
|
||||
the OWUI wrapper doesn't care about the model's thinking output, so
|
||||
the failure mode disappears even with thinking on. The shipped
|
||||
preset still sets `enable_thinking: false` in `custom_params` to
|
||||
save the tokens Qwen would otherwise spend on hidden thinking before
|
||||
each dispatch.
|
||||
|
||||
**Open WebUI 0.9.6+ regression:** `Function Calling: Native` was the
|
||||
working setting through OWUI 0.9.5 when paired with
|
||||
`enable_thinking: false`, and committed history reflects that
|
||||
(d8c8421). On 0.9.6+ Native produces empty assistant turns — the
|
||||
tool-call output stops being dispatched, and (worse) the chat
|
||||
finishes successfully so the failure looks like the model "decided
|
||||
not to call the tool." If you're running ≤ 0.9.5 you can flip
|
||||
Function Calling to `Native` to get the structured tool-result UI
|
||||
block back; on 0.9.6+ stay on `Default`.
|
||||
|
||||
### Alternatives
|
||||
|
||||
|
||||
Reference in new issue
Block a user