Hymba: A Hybrid-head Architecture for Small Language Models Paper • 2411.13676 • Published Nov 20 • 39
Star Attention: Efficient LLM Inference over Long Sequences Paper • 2411.17116 • Published about 1 month ago • 47
RULER: What's the Real Context Size of Your Long-Context Language Models? Paper • 2404.06654 • Published Apr 9 • 34