comfy.hebolide.com

Unlock Anime-Style Image Generation with Multi-LoRA Fusion and Reference Image Guidance

CN
ComfyUI.org
2025-05-27 04:52:23

Unlock anime-style image generation with reference image guidance and multi-LoRA fusion. Discover how to combine Meta-Llama, Stable Diffusion, and LoRA Ensemble for stunning results.

VRAM
Medium VRAM (12–16GB)
Reading Time
4 min
View Required Models

Workflow Overview

Unlock anime-style image generation with reference image guidance and multi-LoRA fusion. Discover how to combine Meta-Llama, Stable Diffusion, and LoRA Ensemble for stunning results.

Content type: Workflow

Primary intent: Download

Required Models

  • Flux
  • Lora
  • Sd

Setup Notes

  • Install the required models before opening the workflow template.
  • Recommended hardware: Medium VRAM (12–16GB).

1. Workflow Overview

mbko5ohi2s370rssf2图片压缩28+.png

  • Purpose: Anime-style image generation with reference image guidance and multi-LoRA fusion.

  • Key Features:

    • Image Captioning: Joy_caption_two node extracts prompts from input image.

    • Multi-LoRA Stacking: 3 LoRAs (Dark Fantasy/Beauty CG/Ancient Style) at 0.7 strength.

    • Bilingual Support: Auto-translation via LibLibTranslate.

2. Core Models

Model Name

Function

Meta-Llama-3.1-8B

Image-to-text model for prompt generation (Joy_caption_two_load).

Stable Diffusion Flux

Base model (F.1-fp8 11G版_flux1-dev loaded by UNETLoader).

LoRA Ensemble

暗黑血统：狂战士_1.0 + F.1色孽CG唯美_V1 + F.1超清唯美风-古风篇_v1.0 (all at 0.7 strength).

3. Key Nodes

3.1 Image Input & Captioning

  • LoadImage: Loads reference image (e.g., 00059-4156590861.jpg).

  • Joy_caption_two:

    • Function: Generates English prompts via Meta-Llama.

    • Install: Requires comfyui_slk_joy_caption_two plugin (via ComfyUI Manager).

3.2 Prompt Processing

  • JoinStrings: Merges user keywords (e.g., miluo_cjsj, cloth) with auto-generated prompts.

  • LibLibTranslate: Optional English-to-Chinese translation.

3.3 Multi-LoRA Fusion

  • LoraLoaderModelOnly:

    • Chained Loading: 3 LoRAs applied sequentially (strength=0.7 via ReroutePrimitive).

    • Model Source: Place .safetensors files in models/loras.

3.4 Generation & Output

  • KSampler:

    • Settings: Euler sampler, 20 steps, CFG=3.5, random seed.

  • VAEDecode: Uses ae.sft VAE for latent decoding.

4. Workflow Structure

Group Name

Key Nodes

I/O Description

Global Control

LoadImage, PrimitiveNode

Input: Reference image, resolution (1200x1200), keywords.

LoRA Models

3x LoraLoaderModelOnly

Output: Fused model (strength=0.7).

Generation

KSampler → VAEDecode

Output: Final image (PreviewImage).

5. Inputs & Outputs

  • Inputs:

    • Reference image (JPEG/PNG).

    • Resolution: Set via EmptyLatentImage (default 1200x1200).

    • Keywords: e.g., miluo_cjsj, cloth (priority over auto-prompts).

  • Output:

    • Generated image (anime cyberpunk style, red-haired character).

6. Notes

  1. VRAM: Recommend 12GB+ GPU (multi-LoRA is resource-intensive).

  2. Dependencies:

    • Download Meta-Llama-3.1-8B and 3 LoRA models manually.

    • Place ae.sft VAE in models/vae.

  3. Troubleshooting:

    • If captioning fails, check model path in Joy_caption_two.

    • Adjust CFG (currently 3.5) if images are blurry.


FAQ

Related Workflows

Related by Model

Unlock Hyper-Realistic Skin Textures: A Step-by-Step Guide

Unlock hyper-realistic skin textures for fashion and portrait close-ups with this expert workflow, featuring Stable Diffusion, LoRA, and VAE models. Learn how to generate stunning 4K images with ease.

Create Stunning 4-Panel Anime Emoticons with AI: A Comprehensive Tutorial

Generate 4-panel anime-style emoticons with exaggerated expressions using AI! Learn how to integrate image understanding, style transfer, and facial control to create uniform emoticon images. Try it now!

"Unlocking Artistic Potential: A Deep Dive into the Flux.1 and Florence-2 Workflow"

Generate stunning oil painting-style images with Flux.1 & Florence-2. Learn how to harness AI for art creation & discover the power of image-to-text captioning. Dive into this workflow now!

Create Breathtaking Character Art: A Step-by-Step Guide to Nordic Elf Portraits

Unlock the power of AI art! Generate stunning Nordic elf-style portraits with this advanced workflow using Flux 3D, Stable Diffusion, and more. Learn how to create high-quality character art and profile pictures with ease.

Low VRAM Alternatives

Boost Your Image Generation Game with Stable Diffusion, JOY Caption Two, and LORA

Unlock AI-powered image generation with Stable Diffusion, JOY Caption Two, and FLUX. Discover how to reverse-engineer prompts from reference images and create stunning new visuals. Learn more and start creating now!

Unlock Dreamy Cloud Scenes: A Step-by-Step Workflow Guide

Generate Dreamy Cloud Scenes with AI: Discover a workflow that combines LoRA models and ControlNet technology to create surreal cloud scene images. Learn how to use this workflow and its core models to produce stunning visuals.

From Brushstrokes to Pixels: A Deep Dive into Stable Diffusion's Graffiti Capabilities

Generate stunning Eastern-style murals with our Stable Diffusion workflow, featuring automated Chinese-English prompt translation and Flux diffusion scheduling. Try now!

Create Breathtaking Visuals: "miluo丨Blue Sky & White Clouds" Social Media Post Workflow Revealed

🌊✨ Create stunning social media images with "miluo丨Blue Sky & White Clouds\_Social Media Post" workflow! 📸✨ Generate aesthetic portraits & scenes with clear skies, ideal for posters & online content. Try now! 👉

previous
Unlock Endless Portrait Possibilities: A Customizable Regeneration Workflow
next
Unlock the Power of One-Click Multi-Style Image Generation