It's not clear from the documentation how to split VRAM over multiple GPUs with exllama.
It's not clear from the documentation how to split VRAM over multiple GPUs with exllama.