XLabs-AI/flux-RealismLora

By XLabs-AI

šŸŽÆ Task: Text To Imageāš–ļø otheršŸ“¦ diffusers

Model Card

Lora Photorealism for Flux Model visual

This repository provides a checkpoint with trained LoRA photorealism for FLUX.1-dev model by Black Forest Labs

Example Picture 1

ComfyUI

See our github for comfy ui workflows. Example Picture 1

Training details

XLabs AI team is happy to publish fine-tuning Flux scripts, including:

  • LoRA šŸ”„
  • ControlNet šŸ”„

See our github for train script and train configs.

Training Dataset

Dataset has the following format for the training process:

ā”œā”€ā”€ images/
ā”‚    ā”œā”€ā”€ 1.png
ā”‚    ā”œā”€ā”€ 1.json
ā”‚    ā”œā”€ā”€ 2.png
ā”‚    ā”œā”€ā”€ 2.json
ā”‚    ā”œā”€ā”€ ...

A .json file contains "caption" field with a text prompt.

Inference

python3 demo_lora_inference.py \
    --checkpoint lora.safetensors \
    --prompt " handsome girl in a suit covered with bold tattoos and holding a pistol. Animatrix illustration style, fantasy style, natural photo cinematic"

Example Picture 1

License

lora.safetensors falls under the FLUX.1 [dev] Non-Commercial License

Architecture & Tags

diffusersloraStable Diffusionimage-generationFluxtext-to-imageenbase_model:black-forest-labs/FLUX.1-devbase_model:adapter:black-forest-labs/FLUX.1-devregion:us