Skip to content

Feature request: Multi-image edit / multi-control training support for FLUX.2 Klein and Qwen-Image-Edit #522

Description

@Xabsurd

Hi, first of all, thank you for maintaining diffusion-pipe.

This is currently my favorite trainer. I really like its stability, DeepSpeed support, dataset handling, and the way it supports larger models for long training runs.

I would like to ask whether multi-image edit training / multi-control training could be supported in the future, especially for models such as:

  • FLUX.2 Klein edit
  • Qwen-Image-Edit
  • other image-editing models that support multiple reference images

At the moment, the edit training workflow seems to support a paired dataset like:

[[directory]]
path = "/path/to/target"
control_path = "/path/to/control"

This works well for single-image editing, where each target image has one corresponding control/reference image.

However, for multi-image editing tasks, it would be very useful to support multiple reference images for one target image. For example:

target image: final edited result
control image 1: person reference
control image 2: clothing reference
control image 3: background / style reference
caption: "Use the person from image 1, the outfit from image 2, and the background from image 3."

A possible dataset format could be something like:

[[directory]]
path = "/path/to/target"
control_paths = [
  "/path/to/ref_person",
  "/path/to/ref_clothing",
  "/path/to/ref_background"
]

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions