Pinned Loading

1. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++

2. Awesome-LLM-Inference Awesome-LLM-Inference Public

   Forked from xlite-dev/Awesome-LLM-Inference

   📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

3. EAGLE EAGLE Public

   Forked from SafeAILab/EAGLE

   Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)

   Python

4. cuda_practices cuda_practices Public

   Cuda

5. how-to-optim-algorithm-in-cuda how-to-optim-algorithm-in-cuda Public

   Forked from BBuf/how-to-optim-algorithm-in-cuda

   how to optimize some algorithm in cuda.

   Cuda