Repositories list

• sgl-project.github.io

  Public
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.

  HTML

  •5•32•3•2•Updated Mar 27, 2025Mar 27, 2025

• sglang

  Public
  SGLang is a fast serving framework for large language models and vision language models.

  cudainferencepytorch+ 14transformermoellamavlmllmllm-servingllava+ 7

  Python

  •

  Apache License 2.0

  •1.4k•13k•432•192•Updated Mar 27, 2025Mar 27, 2025

• whl

  Public
  Kernel Library Wheel for SGLang

  cudacutlasssglang+ 2flashinfercu118

  HTML

  •

  MIT License

  •1•8•0•0•Updated Mar 25, 2025Mar 25, 2025

• flashinfer

  Public
  FlashInfer: Kernel Library for LLM Serving

  Cuda

  •

  Apache License 2.0

  •259•1•0•0•Updated Mar 22, 2025Mar 22, 2025

• sgl-attn

  Public
  Fast and memory-efficient exact attention

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •1.6k•2•0•0•Updated Mar 22, 2025Mar 22, 2025

• DeepEP

  Public
  DeepEP: an efficient expert-parallel communication library

  Cuda

  •

  MIT License

  •677•0•0•0•Updated Mar 22, 2025Mar 22, 2025

• sgl-learning-materials

  Public
  Materials for learning SGLang

  MIT License

  •23•357•0•0•Updated Mar 22, 2025Mar 22, 2025

• sgl-test-files

  Public
  The test files for SGLang.

  MIT License

  •1•0•0•0•Updated Mar 12, 2025Mar 12, 2025

• cutlass

  Public
  CUDA Templates for Linear Algebra Subroutines

  C++

  •

  Other

  •1.2k•0•0•0•Updated Feb 25, 2025Feb 25, 2025

• tensorrt-demo

  Public
  TensorRT LLM Benchmark Configuration

  Python

  •4•13•0•0•Updated Jul 26, 2024Jul 26, 2024