2 21 76

neuralink

AI & ML interests

None yet

Recent Activity

liked a Space 8 days ago

sail/scaling-with-vocab-demo

liked a Space 8 days ago

lvwerra/harms-law

liked a model 15 days ago

tencent/Tencent-Hunyuan-Large

View all activity

Articles

A failed experiment: Infini-Attention, and why we should keep trying?

Aug 14

• 53

Organizations

neuralink's activity

liked 2 Spaces 8 days ago

Running

📊

tencent/Tencent-Hunyuan-Large

Text Generation • Updated Nov 24 • 190 • 533

upvoted a paper about 1 month ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 253

reacted to ArthurZ's post with 🔥 about 1 month ago

Post

2672

Native tensor parallel has landed in transformers!!! https://github.com/huggingface/transformers/pull/34184 thanks a lot to the torch team for their support!

Contributions are welcome to support more models! 🔥

liked a model 3 months ago

meta-llama/Llama-3.2-11B-Vision

Image-Text-to-Text • Updated Sep 27 • 80.5k • 414

updated 2 models 3 months ago

nanotron/temp_for_pr_review

Updated Sep 24

nanotron/fp8_for_nanotron

Updated Sep 21

upvoted a paper 4 months ago

Small-scale proxies for large-scale Transformer training instabilities

Paper • 2309.14322 • Published Sep 25, 2023 • 19

upvoted an article 4 months ago

Article

How NuminaMath Won the 1st AIMO Progress Prize

Jul 11

• 109

upvoted a paper 4 months ago

Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

Paper • 2201.02177 • Published Jan 6, 2022 • 2

upvoted an article 4 months ago

Article

A failed experiment: Infini-Attention, and why we should keep trying?

Aug 14

• 53

upvoted a paper 4 months ago

Grokfast: Accelerated Grokking by Amplifying Slow Gradients

Paper • 2405.20233 • Published May 30 • 6

upvoted a paper 5 months ago

Transformer Explainer: Interactive Learning of Text-Generative Models

Paper • 2408.04619 • Published Aug 8 • 155

updated a model 5 months ago

nanotron/llama3-8b-infini-attention

Updated Aug 5 • 3 • 3

New activity in huggingface/documentation-images 5 months ago

infini-attention

#352 opened 5 months ago by

neuralink

liked a model 5 months ago

nanotron/llama3-8b-infini-attention

Updated Aug 5 • 3 • 3

liked a dataset 5 months ago

huggingface/documentation-images

Viewer • Updated 2 days ago • 50 • 2.37M • 44

liked a dataset 6 months ago

nanotron/minipile_100_samples

Viewer • Updated Jul 10 • 100 • 39 • 1

updated a dataset 6 months ago

nanotron/minipile_100_samples

Viewer • Updated Jul 10 • 100 • 39 • 1

neuralink

AI & ML interests

Recent Activity

Articles

A failed experiment: Infini-Attention, and why we should keep trying?

Organizations

neuralink's activity

Scaling With Vocab Demo

Harm Space

tencent/Tencent-Hunyuan-Large

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

meta-llama/Llama-3.2-11B-Vision

nanotron/temp_for_pr_review

nanotron/fp8_for_nanotron

Small-scale proxies for large-scale Transformer training instabilities

How NuminaMath Won the 1st AIMO Progress Prize

Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

A failed experiment: Infini-Attention, and why we should keep trying?

Grokfast: Accelerated Grokking by Amplifying Slow Gradients

Transformer Explainer: Interactive Learning of Text-Generative Models

nanotron/llama3-8b-infini-attention

infini-attention

nanotron/llama3-8b-infini-attention

huggingface/documentation-images

nanotron/minipile_100_samples

nanotron/minipile_100_samples