Load 4bit models 4x faster
Collection
Native bitsandbytes 4bit pre quantized models
•
25 items
•
Updated
•
45
Sebastián PetrÃk
Plasmoxy
AI & ML interests
I make dum dum computer go smort smort.
LLMs, but more importantly SLMs 🥶
Organizations
None yet