Pere Martra

oopere

AI & ML interests

Author of the Book 'Large Language Models Projects: Apply and Implement Strategies for Large Language Models' published by Apress.

Recent Activity

updated a model 3 days ago

oopere/pruned10-llama-3.2-3B

updated a collection 4 days ago

Llama 3.2 mlp pruned

updated a model 9 days ago

oopere/pruned20-llama-3.2-1B

View all activity

Articles

Making LLMs Smaller Without Breaking Them: A GLU-Aware Pruning Approach

Nov 24

• 1

Organizations

oopere's activity

upvoted an article 17 days ago

Article

Making LLMs Smaller Without Breaking Them: A GLU-Aware Pruning Approach

•

Nov 24

• 1

upvoted a paper about 2 months ago

Shortened LLaMA: A Simple Depth Pruning for Large Language Models

Paper • 2402.02834 • Published Feb 5 • 14

upvoted an article 5 months ago

Article

Preference Tuning LLMs with Direct Preference Optimization Methods

Jan 18

• 40

upvoted an article 6 months ago

Article

How NuminaMath Won the 1st AIMO Progress Prize

Jul 11

• 109

upvoted a collection 7 months ago

Preference Datasets for DPO

Collection

This collection contains a list of curated preference datasets for DPO fine-tuning for intent alignment of LLMs • 7 items • Updated 15 days ago • 34

upvoted an article 7 months ago

Article

🪆 Introduction to Matryoshka Embedding Models

Feb 23

• 62

upvoted an article 8 months ago

Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

May 24, 2023

• 102