EoRA: Training-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation
Paper
•
2410.21271
•
Published
•
6
LIU Shih-yang
sliuau
AI & ML interests
None yet
Recent Activity
updated
a model
about 23 hours ago
sliuau/llama3.2-1b-4bit-group128
updated
a model
about 23 hours ago
sliuau/llama3.2-1b-4bit-group128-eora-rank128-arc
published
a model
about 23 hours ago
sliuau/llama3.2-1b-4bit-group128-eora-rank128-arc
Organizations
sliuau's activity
upvoted
a
paper
3 months ago
upvoted
an
article
6 months ago
Article
Building DoRA Support for Embedding Layers in PEFT
By
•
•
10
upvoted
a
paper
over 1 year ago