Skip to content

CUDA out of memory #4

@rkuo2000

Description

@rkuo2000

HW: GPU0 & GPU1

Error:
torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 114.00 MiB. GPU 0 has a total capacity of 15.58 GiB of which 45.25 MiB is free. Including non-PyTorch memory, this process has 15.51 GiB memory in use. Of the allocated memory 15.38 GiB is allocated by PyTorch, and 9.48 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation.

Q: How to make it run with two RTX-GPUs ?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions