Transformer^2: Self-adaptive LLMs
Paper
•
2501.06252
•
Published
•
53
Papers
-
-
Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models
Paper • 2501.12370 • Published • 7 -
Self-Refine: Iterative Refinement with Self-Feedback
Paper • 2303.17651 • Published • 2 -
Probing-RAG: Self-Probing to Guide Language Models in Selective Document Retrieval
Paper • 2410.13339 • Published -
Gorilla: Large Language Model Connected with Massive APIs
Paper • 2305.15334 • Published • 5 -
PERL: Parameter Efficient Reinforcement Learning from Human Feedback
Paper • 2403.10704 • Published • 58 -
Towards Optimal Learning of Language Models
Paper • 2402.17759 • Published • 17 -
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Paper • 2403.03507 • Published • 184 -
MoAI: Mixture of All Intelligence for Large Language and Vision Models
Paper • 2403.07508 • Published • 75 -
Probing Out-of-Distribution Robustness of Language Models with Parameter-Efficient Transfer Learning
Paper • 2301.11660 • Published • 1 -
From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries
Paper • 2406.12824 • Published • 21 -
Scaling and evaluating sparse autoencoders
Paper • 2406.04093 • Published • 3