Low-Rank Adapters Meet Neural Architecture Search for LLM Compression Paper • 2501.16372 • Published 13 days ago • 7
Mamba-Shedder Collection Compressed Mamba Models via Mamba-Shedder (Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models) • 7 items • Updated about 5 hours ago
SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models Paper • 2410.03750 • Published Oct 1, 2024 • 1
SQFT Collection SQFT Models (SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models) • 56 items • Updated Nov 14, 2024 • 1
Shears Collection Shears Models (Shears: Unstructured Sparsity with Neural Low-rank Adapter Search) • 14 items • Updated Nov 14, 2024 • 1