As far as I understand there's currently only two paths of using this sw:
- A local model via "LM Studio" (closed source software - as far as I see)
- Cloud models via DigitalOcean (a propretiary provider)
This means, there's currently no way to run it based on Open Source solutions. Is there anything planned?
The Ollama ticket #2 seems stalled.
Note that many open source LLM solutions use OpenAI-compatible API as a de-facto standard (examples I'm aware of: Ollama, vLLM). Adding support for this API could be an easy way to enable various open-source backends.
As far as I understand there's currently only two paths of using this sw:
This means, there's currently no way to run it based on Open Source solutions. Is there anything planned?
The Ollama ticket #2 seems stalled.
Note that many open source LLM solutions use OpenAI-compatible API as a de-facto standard (examples I'm aware of: Ollama, vLLM). Adding support for this API could be an easy way to enable various open-source backends.