MIT HAN Lab

All

58 repositories

qserve
Public
QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
Python
•
Apache License 2.0
•28•492•31•4•Updated Jan 25, 2025Jan 25, 2025
efficientvit
Public
Efficient vision foundation models for high-resolution generation and perception.
imagenet segmentation high-resolution vision-transformer efficientvit segment-anything deep-compression-autoencoder efficient-diffusion-model
Python
•
Apache License 2.0
•211•2.6k•101•0•Updated Jan 24, 2025Jan 24, 2025
VisCompare
Public
A WebUI for Side-by-Side Comparison of Media (Images/Videos) Across Multiple Folders
python ui video images webui diffusion-models streamlit generative-ai
Python
•
Apache License 2.0
•1•16•0•0•Updated Jan 24, 2025Jan 24, 2025
patch_conv
Public
Patch convolution to avoid large GPU memory usage of Conv2D
Python
•
MIT License
•6•82•2•1•Updated Jan 23, 2025Jan 23, 2025
nunchaku
Public
[ICLR2025] SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models
flux lora quantization iclr diffusion-models mlsys genai
Cuda
•
Apache License 2.0
•34•602•33•2•Updated Jan 23, 2025Jan 23, 2025
duo-attention
Public
DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
Python
•
MIT License
•26•418•7•2•Updated Jan 22, 2025Jan 22, 2025
vila-u
Public
[ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation
Python
•
MIT License
•4•211•9•0•Updated Jan 22, 2025Jan 22, 2025
fastcomposer
Public
[IJCV] FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention
Python
•
MIT License
•38•684•16•0•Updated Jan 10, 2025Jan 10, 2025
llm-awq
Public
[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
Python
•
MIT License
•226•2.7k•145•9•Updated Jan 10, 2025Jan 10, 2025
sparserefine
Public
[ECCV 2024] SparseRefine: Sparse Refinement for Efficient High-Resolution Semantic Segmentation
Python
•
MIT License
•1•7•0•0•Updated Jan 10, 2025Jan 10, 2025
deepcompressor
Public
Model Compression Toolbox for Large Language Models and Diffusion Models
Python
•
Apache License 2.0
•23•309•28•1•Updated Dec 23, 2024Dec 23, 2024
distrifuser
Public
[CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models
acceleration parallelism generative-model diffusion-models generative-ai
Python
•
MIT License
•28•649•8•1•Updated Dec 2, 2024Dec 2, 2024
tinyengine
Public
[NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning; [NeurIPS 2022] MCUNetV3: On-Device Training Under 256KB Memory
c microcontroller cpp pytorch codegenerator tinyml deep-learning quantization edge-computing neural-architecture-search
C
•
MIT License
•134•827•34•1•Updated Nov 27, 2024Nov 27, 2024
Quest
Public
[ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
Cuda
•24•235•2•0•Updated Nov 22, 2024Nov 22, 2024
torchquantum
Public
A PyTorch-based framework for Quantum Classical Simulation, Quantum Machine Learning, Quantum Neural Networks, Parameterized Quantum Circuits with support for easy deployments on real quantum computers.
machine-learning system deep-learning neural-network quantum pytorch quantum-computing quantum-machine-learning quantum-simulation ml-for-systems
Jupyter Notebook
•
MIT License
•211•1.4k•60•8•Updated Nov 19, 2024Nov 19, 2024
torchsparse
Public
[MICRO'23, MLSys'22] TorchSparse: Efficient Training and Inference Framework for Sparse Convolution on GPUs.
acceleration pytorch
Cuda
•
MIT License
•146•1.3k•29•2•Updated Nov 12, 2024Nov 12, 2024
tinychat-tutorial
Public
C++
•23•59•4•2•Updated Nov 5, 2024Nov 5, 2024
hart
Public
HART: Efficient Visual Generation with Hybrid Autoregressive Transformer
Python
•
MIT License
•19•409•11•2•Updated Oct 16, 2024Oct 16, 2024
Block-Sparse-Attention
Public
A sparse attention kernel supporting mix sparse patterns
C++
•
BSD 3-Clause "New" or "Revised" License
•2•97•5•0•Updated Oct 15, 2024Oct 15, 2024
data-efficient-gans
Public
[NeurIPS 2020] Differentiable Augmentation for Data-Efficient GAN Training
tensorflow generative-adversarial-network image-generation gans data-efficient neurips-2020 pytorch
Python
•
BSD 2-Clause "Simplified" License
•176•1.3k•28•0•Updated Sep 24, 2024Sep 24, 2024
proxylessnas
Public
[ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
acceleration automl specialization efficient-model on-device-ai hardware-aware
C++
•
MIT License
•286•1.4k•0•2•Updated Aug 30, 2024Aug 30, 2024
spatten
Public
[HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning
rtl attention hardware-acceleration spinalhdl llm-inference
Scala
•
MIT License
•8•81•1•0•Updated Aug 27, 2024Aug 27, 2024
bevfusion
Public archive
[ICRA'23] BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation
camera pytorch lidar object-detection sensor-fusion semantic-segmentation 3d-perception
Python
•
Apache License 2.0
•439•2.4k•0•0•Updated Jul 31, 2024Jul 31, 2024
hardware-aware-transformers
Public
[ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
natural-language-processing machine-translation transformer specialization efficient-model hardware-aware
Python
•
Other
•53•332•3•0•Updated Jul 14, 2024Jul 14, 2024
smoothquant
Public
[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
Python
•
MIT License
•158•1.3k•67•1•Updated Jul 12, 2024Jul 12, 2024
spvnas
Public archive
[ECCV 2020] Searching Efficient 3D Architectures with Sparse Point-Voxel Convolution
computer-vision deep-learning efficiency pytorch lidar architecture-search point-cloud 3d-deep-learning semantickitti
Python
•
MIT License
•110•589•0•0•Updated Jul 11, 2024Jul 11, 2024
lite-transformer
Public archive
[ICLR 2020] Lite Transformer with Long-Short Range Attention
nlp pytorch transformer
Python
•
Other
•81•602•0•0•Updated Jul 11, 2024Jul 11, 2024
temporal-shift-module
Public
[ICCV 2019] TSM: Temporal Shift Module for Efficient Video Understanding
acceleration low-latency video-understanding efficient-model temporal-modeling tsm nvidia-jetson-nano
Python
•
MIT License
•419•2.1k•94•6•Updated Jul 11, 2024Jul 11, 2024
streaming-llm
Public
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
Python
•
MIT License
•377•6.8k•44•2•Updated Jul 11, 2024Jul 11, 2024
TinyChatEngine
Public
TinyChatEngine: On-Device LLM Inference Library
c arm deep-learning cpp x86-64 quantization edge-computing cuda-programming on-device-ai large-language-models
C++
•
MIT License
•79•797•34•5•Updated Jul 4, 2024Jul 4, 2024