Pinned Loading

1. EfficientContext/ContextPilot EfficientContext/ContextPilot Public

   Accelerating Long Context LLM Inference with Accuracy-Preserving Context Optimization in SGLang, vLLM, llama.cpp, RAG, and Agentic AI.

   Python 58 3

2. ServerlessLLM/ServerlessLLM ServerlessLLM/ServerlessLLM Public

   Serverless LLM Serving for Everyone.

   Python 662 66

3. ServerlessLLM/pylet ServerlessLLM/pylet Public

   Python 3

4. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 24.2k 4.7k

5. Auto-CAP/MoE-CAP Auto-CAP/MoE-CAP Public

   Benchmarking Cost, Accuracy and Performance for MoE systems

   Python 6 2

6. openmlsys/openmlsys-en openmlsys/openmlsys-en Public

   《Machine Learning Systems: Design and Implementation》- English Version

   TeX 37 9