Pinned Loading

1. skyer_llm skyer_llm Public

   从0开始手搓、训练、上传到huggingface使用的的0.37B大语言模型

   Python 9 8

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 1

3. LMCache LMCache Public

   Forked from LMCache/LMCache

   Supercharge Your LLM with the Fastest KV Cache Layer

   Python

4. vllm-omni vllm-omni Public

   Forked from vllm-project/vllm-omni

   A framework for efficient model inference with omni-modality models

   Python