19 27 57

Li Dong

unilm

AI & ML interests

Language Model Pre-Training

Recent Activity

liked a dataset 2 days ago

HuggingFaceTB/finemath

liked a model 7 days ago

microsoft/VidTok

liked a dataset 7 days ago

TIGER-Lab/OmniEdit-Filtered-1.2M

View all activity

Organizations

unilm's activity

upvoted a paper 9 days ago

Apollo: An Exploration of Video Understanding in Large Multimodal Models

Paper • 2412.10360 • Published 12 days ago • 131

upvoted a paper 13 days ago

Multimodal Latent Language Modeling with Next-Token Diffusion

Paper • 2412.08635 • Published 14 days ago • 41

upvoted a paper about 1 month ago

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Paper • 2411.04905 • Published Nov 7 • 111

upvoted a paper 2 months ago

Differential Transformer

Paper • 2410.05258 • Published Oct 7 • 168

upvoted 2 papers 3 months ago

Data Selection via Optimal Control for Language Models

Paper • 2410.07064 • Published Oct 9 • 8

Self-Boosting Large Language Models with Synthetic Preference Data

Paper • 2410.06961 • Published Oct 9 • 15

upvoted a paper 5 months ago

DataComp-LM: In search of the next generation of training sets for language models

Paper • 2406.11794 • Published Jun 17 • 50

upvoted 2 papers 6 months ago

Direct Preference Knowledge Distillation for Large Language Models

Paper • 2406.19774 • Published Jun 28 • 21

BEiT: BERT Pre-Training of Image Transformers

Paper • 2106.08254 • Published Jun 15, 2021 • 2

upvoted a paper 7 months ago

ALPINE: Unveiling the Planning Capability of Autoregressive Learning in Language Models

Paper • 2405.09220 • Published May 15 • 24

upvoted 2 papers 8 months ago

You Only Cache Once: Decoder-Decoder Architectures for Language Models

Paper • 2405.05254 • Published May 8 • 10

Multi-Head Mixture-of-Experts

Paper • 2404.15045 • Published Apr 23 • 59

upvoted 3 papers 10 months ago

upvoted 5 papers about 1 year ago

TEAL: Tokenize and Embed ALL for Multi-modal Large Language Models

Paper • 2311.04589 • Published Nov 8, 2023 • 18

Does GPT-4 Pass the Turing Test?

Paper • 2310.20216 • Published Oct 31, 2023 • 17

Text Rendering Strategies for Pixel Language Models

Paper • 2311.00522 • Published Nov 1, 2023 • 10

Idempotent Generative Network

Paper • 2311.01462 • Published Nov 2, 2023 • 24

Levels of AGI: Operationalizing Progress on the Path to AGI

Paper • 2311.02462 • Published Nov 4, 2023 • 34