Making LLMs Smaller Without Breaking Them: A GLU-Aware Pruning Approach
•
1
Pere Martra
oopere
AI & ML interests
Author of the Book 'Large Language Models Projects: Apply and Implement Strategies for Large Language Models' published by Apress.
Recent Activity
updated
a model
24 minutes ago
oopere/pruned40-llama-3.2-1B_kd_lambada
upvoted
an
article
5 days ago
Making LLMs Smaller Without Breaking Them: A GLU-Aware Pruning Approach
updated
a collection
15 days ago
Llama 3.2 mlp pruned
Articles
Organizations
Collections
2
models
11
oopere/pruned40-llama-3.2-1B_kd_lambada
Text Generation
•
Updated
•
16
oopere/pruned10-llama-3.2-3B
Text Generation
•
Updated
•
17
oopere/pruned60-llama-3.2-3b
Text Generation
•
Updated
•
42
oopere/pruned20-llama-3.2-3b
Text Generation
•
Updated
•
27
oopere/pruned40-llama-3.2-3b
Text Generation
•
Updated
•
35
oopere/pruned60-llama-3.2-1B
Text Generation
•
Updated
•
26
oopere/pruned40-llama-3.2-1B
Text Generation
•
Updated
•
42
oopere/pruned20-llama-3.2-1B
Text Generation
•
Updated
•
50
oopere/pruned40-gemma-2-2b
Text Generation
•
Updated
•
16
oopere/martra-open-gemma-2b-it-dpo
Text Generation
•
Updated
•
23
•
1