Popular repositories Loading

1. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

2. guidellm guidellm Public

   Forked from vllm-project/guidellm

   Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

   Python

3. ray ray Public

   Forked from ray-project/ray

   Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

5. aiter aiter Public

   Forked from ROCm/aiter

   AI Tensor Engine for ROCm

   Python