Do I need GPU?

[damc]

If I want to use it with Wizcoder-15B 4-bit Quantised, do I need GPU?

The descriptions here (especially the available repositories) suggest that it requires GPU:

https://huggingface.co/TheBloke/WizardCoder-15B-1.0-GPTQ

[shoibloya]

Hi yes, you would require a GPU to run the current version. Anything >12GB should do the trick. Some people tried it on 3060 and it worked well for them. I use Runpod, let me know if you need help setting it up.

[Jipok]

Any plans to support ggml version?