Add text-targeted inpainting via GroundingDINO+SAM (mask_text param)
release / Build & Push Docker Image (push) Successful in 44s
release / Build & Push Docker Image (push) Successful in 44s
Five pieces:
1. Dockerfile installs storyicon/comfyui_segment_anything (GroundingDINO
+ SAM-HQ in one bundle) into custom_nodes and pip-installs its
requirements at build time. Model weights auto-download to the
comfyui-models volume on first inpaint (~3 GB one-time cost).
2. install-custom-node-deps.sh — entrypoint wrapper that pip-installs
requirements.txt for any custom_node present at startup. Lets users
add custom nodes via ComfyUI-Manager (or by git-cloning into the
volume) and have the deps picked up on the next restart, without
editing the Dockerfile.
3. smart_image_gen v0.6: edit_image gains a `mask_text` param. When
set, builds an inpainting workflow (LoadImage → GroundingDinoSAM
Segment → SetLatentNoiseMask → KSampler) so only the named region
is repainted. When unset, falls through to the existing img2img
path. Denoise default switches: 1.0 with mask_text (full repaint
within mask), 0.7 without.
4. Image Studio system prompt teaches the LLM the LOCAL vs GLOBAL
distinction — set mask_text whenever the user names a specific
object/region ('the ball', 'the dog', 'the sky'); leave it unset
only for whole-image style/lighting transformations.
5. Deployment README documents the new mode + the first-inpaint
weight-download caveat.
Image rebuild required — bump tag to pick up the Dockerfile change.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
1 parent
7c7897818e
commit
d935e24624
6 files changed
+189
-40
No files matched your search
@@ -65,8 +65,8 @@ You are an image-tool dispatcher. You do not respond in prose. Every
|
||||
user message MUST result in exactly one tool call.
|
||||
|
||||
ROUTING:
|
||||
- If the user attached an image → call edit_image(edit_instruction, style, denoise)
|
||||
- Otherwise → call generate_image(prompt, style)
|
||||
- If the user attached an image → call edit_image
|
||||
- Otherwise → call generate_image
|
||||
|
||||
Fire the tool on the FIRST message, with no preamble. Do not write a
|
||||
'plan', 'approach', 'steps', 'breakdown', or any explanation before
|
||||
@@ -84,9 +84,29 @@ STYLES (pick one):
|
||||
furry-il anthropomorphic, Illustrious base (default for any
|
||||
furry/anthro request)
|
||||
|
||||
For edit_image, pick style for the DESIRED OUTPUT, not the input
|
||||
image. Default denoise 0.7. Use 0.3–0.5 for subtle changes (recolor,
|
||||
style transfer) and 0.85–1.0 for radical reimaginings.
|
||||
edit_image has TWO MODES — pick based on whether the change is local
|
||||
or global:
|
||||
|
||||
- LOCAL ("change the ball to a basketball", "add a hat to the dog",
|
||||
"remove the bird", "recolor the car red") → set `mask_text` to a
|
||||
brief noun phrase naming the region ("the ball", "the dog", "the
|
||||
bird", "the car"). Only that region is repainted; rest stays
|
||||
pixel-perfect.
|
||||
- GLOBAL ("make this a sunset", "turn this into anime", "restyle as
|
||||
oil painting") → leave mask_text unset. The whole image is
|
||||
reimagined.
|
||||
|
||||
ALWAYS prefer LOCAL when the user names a specific object, person,
|
||||
or region. GLOBAL is only for whole-image style/lighting
|
||||
transformations.
|
||||
|
||||
Denoise:
|
||||
- LOCAL (mask_text set): default 1.0. Drop to 0.6–0.8 only for
|
||||
subtle local edits that should retain some original structure.
|
||||
- GLOBAL (no mask_text): default 0.7. Use 0.3–0.5 for subtle
|
||||
restyle, 0.85–1.0 for radical reimagining.
|
||||
|
||||
Pick style for the DESIRED OUTPUT, not the input image.
|
||||
|
||||
Write rich, descriptive prompts (subject, action, environment,
|
||||
lighting, mood, framing). Do NOT add quality tags like 'masterpiece',
|
||||
@@ -95,8 +115,8 @@ correct tags per style. Do NOT set sampler, CFG, steps, scheduler —
|
||||
the tool picks them.
|
||||
|
||||
AFTER the tool returns, write at most one short sentence noting your
|
||||
style choice and offering one iteration idea. The image is already
|
||||
shown to the user; do not describe it.
|
||||
style/mode choice and offering one iteration idea. The image is
|
||||
already shown to the user; do not describe it.
|
||||
```
|
||||
|
||||
The first line `/no_think` disables Qwen 3.x's reasoning phase. If
|
||||
|
||||
Reference in new issue
Block a user