Image Studio: default base model → huihui_ai/qwen3-vl-abliterated:8b
User confirmed this model works end-to-end after the multi-base-model
search. Settled on it because Qwen 3 VL's fine-tune lineage isn't
damaged by abliteration the way Qwen 3.5's is, so it both calls tools
reliably AND won't refuse to dispatch on NSFW edit prompts.
Updated:
- image_studio.json base_model_id → huihui_ai/qwen3-vl-abliterated:8b
- init-models.sh: pulls the abliterated VL model in place of the
non-working standard qwen3.5:9b
- image_studio.md: setup table base-model row + vision-section
'why this and not the alternatives' explanation
function_calling stays default and tool_choice required. Operator
can flip to native + drop tool_choice once they've verified the new
base behaves with structured tool calls (which would also remove the
need for a separate Task Model for title generation).
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
ec6108888a
commit
f5a222fe6f
3 files changed
+25
-17
No files matched your search
@@ -55,10 +55,12 @@ pull() {
|
||||
# mirror-ollama-model.sh, upload to S3, then list them here.
|
||||
s3_pull "huihui_ai/qwen3.5-abliterated:9b" "qwen3.5-abliterated-9b.tgz"
|
||||
|
||||
# Standard non-abliterated Qwen 3.5 9B — 6.6 GB, vision + native tool
|
||||
# calling. Used as the Image Studio dispatcher (the abliterated 9B above
|
||||
# is fine for chat but mangles native tool-call formatting).
|
||||
pull "qwen3.5:9b"
|
||||
# huihui_ai/qwen3-vl-abliterated — Qwen 3 VL base abliteration (different
|
||||
# fine-tune lineage than Qwen 3.5, so its tool-call template stays intact).
|
||||
# Used as the Image Studio dispatcher: vision-capable, calls tools
|
||||
# reliably, and doesn't refuse to dispatch on NSFW edit prompts. Pulled
|
||||
# from registry; no S3 mirror entry yet.
|
||||
pull "huihui_ai/qwen3-vl-abliterated:8b"
|
||||
|
||||
# ─── Direct registry pulls ──────────────────────────────────────────────────
|
||||
for model in dolphin3:8b llama3.1:8b ministral-3:8b mistral-nemo:12b qwen3.6:latest; do
|
||||
|
||||
Reference in new issue
Block a user