belyakoff PRO

belyakoff's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted an article 7 months ago

view article

Article

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

Jul 23, 2024

• 226

upvoted 3 papers 8 months ago

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Paper • 2405.21060 • Published May 31, 2024 • 64

Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models

Paper • 2405.20541 • Published May 30, 2024 • 22

Similarity is Not All You Need: Endowing Retrieval Augmented Generation with Multi Layered Thoughts

Paper • 2405.19893 • Published May 30, 2024 • 31

upvoted 5 papers 9 months ago

Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documents

Paper • 2310.19923 • Published Oct 30, 2023 • 14

Multi-Task Contrastive Learning for 8192-Token Bilingual Text Embeddings

Paper • 2402.17016 • Published Feb 26, 2024 • 5

Your Transformer is Secretly Linear

Paper • 2405.12250 • Published May 19, 2024 • 151

RLHF Workflow: From Reward Modeling to Online RLHF

Paper • 2405.07863 • Published May 13, 2024 • 67

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning

Paper • 2405.12130 • Published May 20, 2024 • 47

upvoted 3 articles 9 months ago

view article

Article

🕳️ Attention Sinks in LLMs for endless fluency

By •

Oct 9, 2023

• 7

view article

Article

makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch

By •

May 7, 2024

• 44

view article

Article

Inference for PROs

Sep 22, 2023

• 52

upvoted a paper 11 months ago

Soaring from 4K to 400K: Extending LLM's Context with Activation Beacon

Paper • 2401.03462 • Published Jan 7, 2024 • 27