Making LLMs Smaller Without Breaking Them: A GLU-Aware Pruning Approach
•
1
Pere Martra
oopere
AI & ML interests
Author of the Book 'Large Language Models Projects: Apply and Implement Strategies for Large Language Models' published by Apress.
Recent Activity
liked
a model
about 4 hours ago
mkurman/Qwen2.5-14B-DeepSeek-R1-1M
updated
a model
16 days ago
oopere/pruned_distilgpt2_kd_gem
updated
a model
16 days ago
oopere/pruned40-llama-3.2-1B_kd_lambada
Articles
Organizations
Collections
2
models
12
oopere/pruned_distilgpt2_kd_gem
Text Generation
•
Updated
•
9
oopere/pruned40-llama-3.2-1B_kd_lambada
Text Generation
•
Updated
•
24
oopere/pruned10-llama-3.2-3B
Text Generation
•
Updated
•
131
oopere/pruned60-llama-3.2-3b
Text Generation
•
Updated
•
135
oopere/pruned20-llama-3.2-3b
Text Generation
•
Updated
•
131
oopere/pruned40-llama-3.2-3b
Text Generation
•
Updated
•
132
oopere/pruned60-llama-3.2-1B
Text Generation
•
Updated
•
163
•
1
oopere/pruned40-llama-3.2-1B
Text Generation
•
Updated
•
203
oopere/pruned20-llama-3.2-1B
Text Generation
•
Updated
•
156
oopere/pruned40-gemma-2-2b
Text Generation
•
Updated
•
92