kvcache-ai

Mirrored from GitHub organization: kvcache-ai

Repositories
22
 Projects Packages
Filter
Sort
sglang_awq
Python 0 0
SGLang is a fast serving framework for large language models and vision language models.
Updated 2026-04-22 05:25:53 +00:00
evalscope
Python 0 0
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
Updated 2026-04-13 16:25:52 +00:00
DeepEP_fault_tolerance
Cuda 0 0
DeepEP: an efficient expert-parallel communication library that supports fault tolerance
Updated 2026-01-05 08:46:47 +00:00
gpustack
Python 0 0
GPU cluster manager for optimized AI model deployment
Updated 2025-12-07 01:57:40 +00:00
TrEnv-X
Go 0 0
Updated 2025-09-15 15:26:39 +00:00
sglang-npu
Python 0 0
SGLang is a fast serving framework for large language models and vision language models.
Updated 2025-08-12 08:21:02 +00:00
custom_flashinfer
Cuda 0 0
FlashInfer: Kernel Library for LLM Serving
Updated 2025-07-23 08:33:23 +00:00