Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 31.1k 7.6k

2. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

   Python 14.3k 2.6k

3. NVIDIA/cutlass NVIDIA/cutlass Public

   CUDA Templates and Python DSLs for High-Performance Linear Algebra

   C++ 10.2k 2k

4. cudnn-frontend cudnn-frontend Public

   Forked from NVIDIA/cudnn-frontend

   cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

   Python