Skip to content
@vllm-project

vLLM

Pinned Loading

  1. vllm vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 59.3k 10.5k

  2. llm-compressor llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    Python 2k 243

  3. recipes recipes Public

    Common recipes to run vLLM

    146 48

Repositories

Showing 10 of 24 repositories
  • vllm-gaudi Public

    Community maintained hardware plugin for vLLM on Intel Gaudi

    vllm-project/vllm-gaudi’s past year of commit activity
    Python 11 45 1 42 Updated Oct 1, 2025
  • vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    vllm-project/vllm’s past year of commit activity
    Python 59,254 Apache-2.0 10,456 1,863 (30 issues need help) 1,157 Updated Oct 1, 2025
  • llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    vllm-project/llm-compressor’s past year of commit activity
    Python 2,026 Apache-2.0 243 60 (13 issues need help) 40 Updated Oct 1, 2025
  • vllm-project.github.io Public
    vllm-project/vllm-project.github.io’s past year of commit activity
    HTML 20 28 0 0 Updated Sep 30, 2025
  • ci-infra Public

    This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

    vllm-project/ci-infra’s past year of commit activity
    HCL 22 39 0 17 Updated Sep 30, 2025
  • guidellm Public

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    vllm-project/guidellm’s past year of commit activity
    Python 597 Apache-2.0 84 85 (5 issues need help) 32 Updated Sep 30, 2025
  • aibrix Public

    Cost-efficient and pluggable Infrastructure components for GenAI inference

    vllm-project/aibrix’s past year of commit activity
    Go 4,275 Apache-2.0 466 218 (19 issues need help) 21 Updated Sep 30, 2025
  • vllm-spyre Public

    Community maintained hardware plugin for vLLM on Spyre

    vllm-project/vllm-spyre’s past year of commit activity
    Python 35 Apache-2.0 24 6 19 Updated Sep 30, 2025
  • speculators Public

    A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

    vllm-project/speculators’s past year of commit activity
    Python 50 Apache-2.0 9 3 (2 issues need help) 15 Updated Sep 30, 2025
  • semantic-router Public

    Intelligent Mixture-of-Models Router for Efficient LLM Inference

    vllm-project/semantic-router’s past year of commit activity
    Go 1,562 Apache-2.0 168 69 (15 issues need help) 16 Updated Sep 30, 2025
View all repositories

Sponsors

  • @DeeveshBeegun
  • @kevATin
  • @yankay
  • @brickfrog
  • @GabrielBianconi
  • @imkero
  • @comet-ml
  • @thomas-hiddenpeak
  • @terrytangyuan
  • @dvlpjrs
  • @vincentkoc
  • @robertgshaw2-redhat
  • Private Sponsor