Skip to content

Better support of multi-modalities in input data transformations and augmentation #1

@tlorieul

Description

@tlorieul

It is currently not clear how to adapt the input data transformation and augmentation system to multi-modal data when the modalities can not be put together in a single tensor (e.g., when the patches are of different sizes, etc.).
This case happens quite often in practice and should be handled properly.

If there are some randomized transforms (typically with data augmentation), the modalities can not be processed totally separately otherwise different transforms will be applied to each of them.

To solve this, we might need to use functional transforms to handle the seed of the randomizers manually.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions