Great work!
I followed the instructions in the documentation for inference, but I always encounter an out-of-memory issue.
My GPU is an RTX 3090 with 24GB of VRAM.
If the issue is related to VRAM, could you provide an option for multi-GPU inference?
Looking forward to your response.
Thank you very much.
Great work!
I followed the instructions in the documentation for inference, but I always encounter an out-of-memory issue.
My GPU is an RTX 3090 with 24GB of VRAM.
If the issue is related to VRAM, could you provide an option for multi-GPU inference?
Looking forward to your response.
Thank you very much.