Hi, first of all, thank you for maintaining diffusion-pipe.
This is currently my favorite trainer. I really like its stability, DeepSpeed support, dataset handling, and the way it supports larger models for long training runs.
I would like to ask whether multi-image edit training / multi-control training could be supported in the future, especially for models such as:
- FLUX.2 Klein edit
- Qwen-Image-Edit
- other image-editing models that support multiple reference images
At the moment, the edit training workflow seems to support a paired dataset like:
[[directory]]
path = "/path/to/target"
control_path = "/path/to/control"
This works well for single-image editing, where each target image has one corresponding control/reference image.
However, for multi-image editing tasks, it would be very useful to support multiple reference images for one target image. For example:
target image: final edited result
control image 1: person reference
control image 2: clothing reference
control image 3: background / style reference
caption: "Use the person from image 1, the outfit from image 2, and the background from image 3."
A possible dataset format could be something like:
[[directory]]
path = "/path/to/target"
control_paths = [
"/path/to/ref_person",
"/path/to/ref_clothing",
"/path/to/ref_background"
]
Hi, first of all, thank you for maintaining diffusion-pipe.
This is currently my favorite trainer. I really like its stability, DeepSpeed support, dataset handling, and the way it supports larger models for long training runs.
I would like to ask whether multi-image edit training / multi-control training could be supported in the future, especially for models such as:
At the moment, the edit training workflow seems to support a paired dataset like:
This works well for single-image editing, where each target image has one corresponding control/reference image.
However, for multi-image editing tasks, it would be very useful to support multiple reference images for one target image. For example:
target image: final edited result
control image 1: person reference
control image 2: clothing reference
control image 3: background / style reference
caption: "Use the person from image 1, the outfit from image 2, and the background from image 3."
A possible dataset format could be something like: