Pinned Loading

1. HolisticTraceAnalysis HolisticTraceAnalysis Public

   Forked from facebookresearch/HolisticTraceAnalysis

   A library to analyze PyTorch traces.

   Python

2. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

3. nccl nccl Public

   Forked from NVIDIA/nccl

   Optimized primitives for collective multi-GPU communication

   C++

4. pytorch pytorch Public

   Forked from pytorch/pytorch

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

6. vllm-omni vllm-omni Public

   Forked from vllm-project/vllm-omni

   A framework for efficient model inference with omni-modality models

   Python