Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization
Paper
•
2412.17739
•
Published
•
39
TsinghuaC3I
university
AI & ML interests
Large Language Models
Recent Activity
View all activity
TsinghuaC3I's activity
iseesaw
authored
a
paper
14 days ago
iseesaw
authored
a
paper
24 days ago
xuekai
authored
a
paper
24 days ago
iseesaw
authored
a
paper
about 1 month ago
iseesaw
authored
a
paper
3 months ago
iseesaw
updated
2
models
4 months ago
iseesaw
updated
a
Space
4 months ago
iseesaw
updated
a
dataset
5 months ago
iseesaw
authored
10
papers
6 months ago
Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation
Paper
•
2407.08940
•
Published
UltraMedical: Building Specialized Generalists in Biomedicine
Paper
•
2406.03949
•
Published
PaD: Program-aided Distillation Specializes Large Models in Reasoning
Paper
•
2305.13888
•
Published
CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Following
Paper
•
2403.03129
•
Published
Intuitive Fine-Tuning: Towards Unifying SFT and RLHF into a Single Process
Paper
•
2405.11870
•
Published
SMR: State Memory Replay for Long Sequence Modeling
Paper
•
2405.17534
•
Published
Online DPO: Online Direct Preference Optimization with Fast-Slow Chasing
Paper
•
2406.05534
•
Published
•
3
Towards Building Specialized Generalist AI with System 1 and System 2 Fusion
Paper
•
2407.08642
•
Published
•
9
Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding
Paper
•
2406.12295
•
Published
CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model
Paper
•
2310.15477
•
Published
iseesaw
updated
a
model
9 months ago