Distily Project

community

https://github.com/lapp0/distily

AI & ML interests

None defined yet.

Recent Activity

lapp0 updated a model 3 months ago

distily/distily_smollm_dataset_sweep

lapp0 updated a model 3 months ago

distily/distily_tinyBenchmarks

lapp0 updated a model 3 months ago

distily/distily_learning_params

View all activity

models 52

distily/distily_smollm_dataset_sweep

Updated Sep 30 • 188

distily/distily_tinyBenchmarks

Updated Sep 23 • 2

distily/distily_learning_params

Updated Sep 22 • 101

distily/distily_seq_len_batch_size

Updated Sep 17 • 40

distily/distily_distsmollm_max_length

Updated Sep 14 • 20

distily/distily_distsmollm_long

Updated Sep 14 • 30

distily/distily_additional_profiling

distily/distily_profile_smollm_tritoned

Updated Sep 12 • 13

distily/distily_profile_smollm

Updated Sep 12 • 37

distily/distily_verify_new_attns

Updated Sep 12 • 27

datasets 10

distily/filtered_redpajama_en

Viewer • Updated Sep 7 • 2.21M • 186

distily/filtered_redpajama_multilingual

Viewer • Updated Sep 7 • 2.86M • 357 • 1

distily/synth_gpt2_t1_seq_1M

Viewer • Updated Aug 27 • 1M • 86

distily/synth_gpt2_ted_seq_100

Viewer • Updated Aug 26 • 1k • 39

distily/synth_gpt2_t1_seq_100K

Updated Aug 26 • 33

distily/synth_gpt2_ted_seq_100K

Viewer • Updated Aug 26 • 100k • 35

distily/synth_test

Viewer • Updated Aug 26 • 1k • 34

distily/synth_tdecay_gpt2_seq_1K

Viewer • Updated Aug 26 • 1k • 46

distily/synthetic_gpt2_sequences_1K

Viewer • Updated Aug 26 • 1k • 40

distily/c4_multilingual_1M

Viewer • Updated Aug 19 • 1M • 200 • 1