radna/NEW-Fuse-Hendrycks-1

NEW-Fuse-Hendrycks-ALL

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 as a base.

Models Merged

The following models were included in the merge:

• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
• /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087

Configuration

The following YAML configuration was used to produce this model:

base_model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
dtype: bfloat16
merge_method: dare_ties
parameters:
  int8_mask: 1.0
  normalize: 0.0
slices:
- sources:
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.11996307782216076
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.04738155628582108
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.630622628320176
      weight: 0.0749446670489908
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.28963248825512466
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.25108440863575926
  - layer_range: [0, 1]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.017371823652341467
- sources:
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.27126356124651185
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7855658889142867
      weight: 0.1297712198528082
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.36005643654580743
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9479904659458279
      weight: 0.07369984982210859
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.0621239235754794
  - layer_range: [1, 2]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.6977781794873525
      weight: 0.15846685977955322
- sources:
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9573233526913786
      weight: 0.09261135762409589
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.03607860853858684
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.0944732030364557
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.532266358886291
      weight: 0.3882514623172591
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.1512498667861862
  - layer_range: [2, 3]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.5824801769298737
- sources:
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9609210958879669
      weight: 0.1670208791808094
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9672070931990391
      weight: 0.09972462043189906
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8546357708945174
      weight: 0.03472024047108281
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.14389546839824804
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9644544035083406
      weight: 0.10703398248828425
  - layer_range: [3, 4]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.17827113306339823
- sources:
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.020535170625590862
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.3334626811781694
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.012966348850640963
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.5624315114588478
      weight: 0.07595978100930162
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.3047287626175462
  - layer_range: [4, 5]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.09757054373557464
- sources:
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.05627833704833148
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7684883758289116
      weight: 0.3123745914260615
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9969507034518041
      weight: 0.30049857268486113
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9339505898644846
      weight: 0.34872769855747027
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.27102986806600216
  - layer_range: [5, 6]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9477990285505034
      weight: 0.19102456992498476
- sources:
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.20452632860911657
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.4068224144587569
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9915318862406283
      weight: 0.14884268586755048
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.13892563984935385
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9610621979570029
      weight: 0.2071531971188554
  - layer_range: [6, 7]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7895483607878099
      weight: 0.08873057871800233
- sources:
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9402020179390186
      weight: 0.09169674675487843
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9544683142131407
      weight: 0.13823897843123834
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.6949291102383517
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.1573963915240011
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.3725549034949035
  - layer_range: [7, 8]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.613224230720641
      weight: 0.036756447949093135
- sources:
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.10128786398813433
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.2246796862850422
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.22509431132048302
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.041545973693249305
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.180722957871993
  - layer_range: [8, 9]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.17481067915459034
- sources:
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.17778903255368725
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.3551200390684712
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.7845996178977138
      weight: 0.38057661912592333
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9384592717375175
      weight: 0.21305536576457895
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.04154204419938354
  - layer_range: [9, 10]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9378391947702386
      weight: 0.031262130403160615
- sources:
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.96995015151544
      weight: 0.20650763980928855
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.666242769972049
      weight: 0.18740398649872053
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.792359286188577
      weight: 0.09100091990185855
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.3731673941417406
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.009599061022644295
  - layer_range: [10, 11]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9434087376907763
      weight: 0.12093711308244147
- sources:
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.2653760065609218
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.06669212924344525
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.1901021447478036
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.935380919900036
      weight: 0.19702697278693876
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.7018736980260338
      weight: 0.27816109429688723
  - layer_range: [11, 12]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.20803712327454132
- sources:
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7209383391865684
      weight: 0.1495382644480692
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9620215202943474
      weight: 0.4505521613958302
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.08213875747106865
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.004454981028021804
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8717005795788083
      weight: 0.07617783845581608
  - layer_range: [12, 13]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8316579479972225
      weight: 0.24024498380796072
- sources:
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.2848067955988513
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.08127401011776426
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.14213966940605707
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9075451238379451
      weight: 0.004530222431639003
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.1691132280434027
  - layer_range: [13, 14]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.22735613903433766
- sources:
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.03382511453649901
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.033862415866205225
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9837064837228076
      weight: 0.13439542965830092
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7470877876368608
      weight: 0.14046735921927486
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9736412681561085
      weight: 0.23964192111683913
  - layer_range: [14, 15]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9343188651227675
      weight: 0.34814691200850634
- sources:
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8487608842250071
      weight: 0.29736704879112125
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9957343055213949
      weight: 0.1647277176141286
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.3652938069682289
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.25993840166998183
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.7372575424289282
      weight: 0.37552338099399285
  - layer_range: [15, 16]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.015025705191543504
- sources:
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.2713812255021002
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.8477652025972927
      weight: 0.24363834486222374
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.28952374198901554
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9587105664516122
      weight: 0.5771111433039036
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.7476177815004433
      weight: 0.18419804183061284
  - layer_range: [16, 17]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.024614982572039867
- sources:
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.918247085760667
      weight: 0.42250018095506064
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9250176262607067
      weight: 0.07421968509988747
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.08040909042501625
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.0809517891278097
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.6283647530291596
      weight: 0.19185493949377783
  - layer_range: [17, 18]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.5842225297864987
- sources:
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9115724394414161
      weight: 0.07958337507014165
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9619707530027093
      weight: 0.1231069780883754
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.6629864992104587
      weight: 0.1342247148213691
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.900633633794063
      weight: 0.23704821340249468
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9732190556181427
      weight: 0.10469964331695675
  - layer_range: [18, 19]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.037260007982184845
- sources:
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8393371241781491
      weight: 0.11093980903491771
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9879933981832087
      weight: 0.35564952851383613
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8973667638390063
      weight: 0.04904072809015497
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.26975339739607146
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.2246375943803809
  - layer_range: [19, 20]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9457706111802923
      weight: 0.20902856237668782
- sources:
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.02408152926333977
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.30884172876448435
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.790841460572458
      weight: 0.40646817268777824
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.5891160410643169
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.06396003192603328
  - layer_range: [20, 21]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7787994593198513
      weight: 0.08659946840051123
- sources:
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8041412830559049
      weight: 0.04610612015964907
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.21079782686468584
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9841272234648981
      weight: 0.3360072077605751
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8912843053786359
      weight: 0.22788145165231158
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.09171423325448189
  - layer_range: [21, 22]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.21558806648201267
- sources:
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9350608215461931
      weight: 0.04394802518076617
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7148527822937847
      weight: 0.2936842676756024
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.3692358768998849
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8746831407053698
      weight: 0.11337841398737503
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.3637105780893268
  - layer_range: [22, 23]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.026314488134699388
- sources:
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9888145431312195
      weight: 0.04846525304516855
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9671772583744846
      weight: 0.36688434582108326
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.29549934241870035
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.28467447016430714
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9666437476837288
      weight: 0.0767232685475033
  - layer_range: [23, 24]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.04125358445905597
- sources:
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8561637439306355
      weight: 0.018729468985089634
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.22714452405908808
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8193736424168576
      weight: 0.04085434764914023
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.27840172006287817
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.44115300320650225
  - layer_range: [24, 25]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.2212809220562779
- sources:
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8603134632263433
      weight: 0.06792382637450392
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9527730484304574
      weight: 0.018780715368617695
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.2706498525589505
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9200285809866487
      weight: 0.14809972621143816
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.5766938900366334
      weight: 0.05950022260688667
  - layer_range: [25, 26]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.3271194839513001
- sources:
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.16069384550165633
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9216370906754848
      weight: 0.1649749097789675
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.690201695328526
      weight: 0.2559574411207702
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9321728904621519
      weight: 0.13005319805399626
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.3371256704542286
  - layer_range: [26, 27]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.17222855416893368
- sources:
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9997995135527862
      weight: 0.4414765290475969
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.7344836381862038
      weight: 0.39059312521707007
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.004183264735264522
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7408995584048752
      weight: 0.005245600241509385
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9000263985643653
      weight: 0.22356219402237956
  - layer_range: [27, 28]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9670294692612575
      weight: 0.321990480672271
- sources:
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8041349462812826
      weight: 0.36038437207834173
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.29796177130680895
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8775759960825635
      weight: 0.12367567429294449
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9761708552984579
      weight: 0.1291122830645446
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.49460222567975515
  - layer_range: [28, 29]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.19967427881738906
- sources:
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.19749875456265661
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.07231549759146924
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9565134329400379
      weight: 0.31695355070095
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.4486933870356282
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9854833990739451
      weight: 0.33557192310071104
  - layer_range: [29, 30]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.0928818006102434
- sources:
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.259517419277669
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.013987312267894847
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9593696201238756
      weight: 0.2910544174295988
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9089117944497749
      weight: 0.5003767528054979
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.0985803468433929
  - layer_range: [30, 31]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.01574719213784659
- sources:
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8450560804084531
      weight: 0.1812447033900206
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.5751779746129534
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.028434726554208728
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.015826059286349586
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9641443852958098
      weight: 0.3495272765916514
  - layer_range: [31, 32]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8277243132212989
      weight: 0.07303950546134497
- sources:
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.38974734625866214
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9670207526192696
      weight: 0.0966752970762569
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.17264369008798636
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.007508414201651838
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.874675362813859
      weight: 0.3294523694621976
  - layer_range: [32, 33]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.3820911477820733
- sources:
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.09038568702273062
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.1837803394198338
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.7998139273092064
      weight: 0.222950503599523
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9065853366005356
      weight: 0.1438065167205687
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.18233733275381475
  - layer_range: [33, 34]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9228019733141901
      weight: 0.3217957727238131
- sources:
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.09560775215103387
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.8191905126798784
      weight: 0.081715273239466
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8307784243622585
      weight: 0.3226483527385701
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.07320572023150812
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.04381877701917114
  - layer_range: [34, 35]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.95886511201203
      weight: 0.29722379479095135
- sources:
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.22311514402444368
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9081388544564879
      weight: 0.061241086244031545
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.18742484548451857
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.6098848389438674
      weight: 0.23401268688785445
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8696847856856993
      weight: 0.22076824385998844
  - layer_range: [35, 36]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9021111031308617
      weight: 0.06087404805145283
- sources:
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9820519355372241
      weight: 0.02290605274852578
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.847411611840867
      weight: 0.4867572227650132
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8171116734442723
      weight: 0.1811724936854943
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9730428109977283
      weight: 0.0029312465905003693
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8573762486509711
      weight: 0.21992390369063103
  - layer_range: [36, 37]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8991245491497798
      weight: 0.1448132476781981
- sources:
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.5400184257812715
      weight: 0.04910614616229811
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.01672531028331714
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.3277043175064215
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.1324555977735541
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.04159965625803396
  - layer_range: [37, 38]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.14824792717357962
- sources:
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.0006558411467707803
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.06080707265920671
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.02466536515553365
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.20279460585747114
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.1705428221637281
  - layer_range: [38, 39]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7695321464851523
      weight: 0.14384667010196966
- sources:
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.039293324111214153
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.3763591024045718
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.05473299389786379
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.3592335140394146
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.1879580528264608
  - layer_range: [39, 40]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9000503810086394
      weight: 0.14904978562188412
- sources:
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.3891341005295934
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.11030984669175191
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8383882634336773
      weight: 0.45266537943377455
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7743880221528836
      weight: 0.6286803150838185
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.2657518898610105
  - layer_range: [40, 41]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.22972108641976086
- sources:
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9070083282805694
      weight: 0.10065748772828677
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.11863293440456366
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.1519576879174806
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7645689450544524
      weight: 0.07653550286721253
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.053387663849677594
  - layer_range: [41, 42]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9555206301879418
      weight: 0.06935650560805218
- sources:
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7876439427886548
      weight: 0.18129599636534832
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.127735585671413
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.09767607295138303
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.13653940232961986
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.7995172213621425
      weight: 0.1643911871356105
  - layer_range: [42, 43]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.03985412446656081
- sources:
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.25613214296350717
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9228418303423415
      weight: 0.10825515419413706
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.041123850075725554
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.46944072058272557
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.10656300263610832
  - layer_range: [43, 44]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8627901428485807
      weight: 0.3162396562495694
- sources:
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.17136330070549047
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.11621778194641794
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.386019650528526
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.1276070133584706
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.673736536794868
      weight: 0.2776186265942676
  - layer_range: [44, 45]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.037377662477697304
- sources:
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8938283041809304
      weight: 0.15330849326559048
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.30117937285860324
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9193583191417455
      weight: 0.18463756060229036
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7950019245616062
      weight: 0.05018518169218783
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.08416624724662367
  - layer_range: [45, 46]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.42824333542031523
- sources:
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.6419728521521847
      weight: 0.058923591998693764
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.18418698863183675
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.6383609900449888
      weight: 0.18692649897767516
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8257666756660246
      weight: 0.24865978130578922
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.2430632826298314
  - layer_range: [46, 47]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.15946359304589888
- sources:
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9850358989468628
      weight: 0.16549617053435298
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.2316327723309677
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.003668557794088062
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.07567124887601419
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8922329097696009
      weight: 0.4109306547305086
  - layer_range: [47, 48]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9258334819873983
      weight: 0.3221945341757668
- sources:
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.0074929866015851915
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.5298112840802061
      weight: 0.4122047886300101
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.17662193890871594
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8501448742579809
      weight: 0.14051748700954228
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.049267472466774764
  - layer_range: [48, 49]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7904418670861981
      weight: 0.06517102757276402
- sources:
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.939108117767209
      weight: 0.12471405931282978
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.04961435868867428
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.7189212397957078
      weight: 0.23974424975568612
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.3148207351616534
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.1783967879486733
  - layer_range: [49, 50]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9894658361613391
      weight: 0.06155617519839128
- sources:
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9147042396910539
      weight: 0.022385543863017165
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.21364216869379957
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9170118863363821
      weight: 0.1358023165347098
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9925640090650442
      weight: 0.3913135705461004
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.8429815216996517
      weight: 0.04074429207680766
  - layer_range: [50, 51]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8684634416709758
      weight: 0.10820107704784304
- sources:
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.0008742057283305238
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9960140054390298
      weight: 0.14757084417868302
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.6580804277221923
      weight: 0.307354495639547
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8750710289390042
      weight: 0.08071110039435267
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.02586849908418981
  - layer_range: [51, 52]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.10913160137623304
- sources:
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8269536444432968
      weight: 0.07240549626811382
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.09211709500152174
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.296266940677681
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.08773108900134731
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.3164627807187961
  - layer_range: [52, 53]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.11744087828116095
- sources:
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.25640407673060306
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9803627240853149
      weight: 0.12647464804315622
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.26675455297797984
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.7494538474251989
      weight: 0.13427068029270017
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.5283453809441712
      weight: 0.15192024552586122
  - layer_range: [53, 54]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.1578871135432478
- sources:
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.9086270611159595
      weight: 0.014631034388305791
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.3435288713760907
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.5582928595716452
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8877749465850304
      weight: 0.24102550508727122
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.015111189652636164
  - layer_range: [54, 55]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.02463269155516283
- sources:
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.11185792063912062
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.06985030278429086
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8623138612376684
      weight: 0.2191878710544926
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.18204358841934176
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.5414680156493809
      weight: 0.09448140873291651
  - layer_range: [55, 56]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.9454451740371365
      weight: 0.2587009695266934
- sources:
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7407734965318474
      weight: 0.09285787046519511
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.4776187502288039
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.3631959127477192
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8306708926702823
      weight: 0.018089366487763853
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9083574199752796
      weight: 0.00678165591124702
  - layer_range: [56, 57]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.4778498590976797
- sources:
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8585716309669508
      weight: 0.17670346044093133
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.2516894590949304
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9677759913169568
      weight: 0.3378220814381788
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.0557577280118265
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.971592197614282
      weight: 0.35657224304346324
  - layer_range: [57, 58]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.814026940289147
      weight: 0.3933634325847988
- sources:
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.957690964645616
      weight: 0.02192411996228863
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9197522306806806
      weight: 0.264047610797951
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.9403368073153048
      weight: 0.13544223092977276
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9141869278393099
      weight: 0.09370818750358964
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.17117037964846588
  - layer_range: [58, 59]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.7676694333149905
      weight: 0.1950245129987157
- sources:
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.7205472843119453
      weight: 0.04510729953489435
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.6339549829614574
      weight: 0.02430223335575995
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8583708603704616
      weight: 0.15514510708214604
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9560038852539801
      weight: 0.2521012810009931
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 1.0
      weight: 0.010642925952421195
  - layer_range: [59, 60]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.08357361895311156
- sources:
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.28644746620866857
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.3147562558770607
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.7985083201781376
      weight: 0.22521662066357953
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.8037580124407134
      weight: 0.4254292355810518
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9096370653415251
      weight: 0.21505442541214342
  - layer_range: [60, 61]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8955091170388109
      weight: 0.16649623614487266
- sources:
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.397170452370247
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 1.0
      weight: 0.14447242122343135
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8729699849190807
      weight: 0.1749052378543772
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.21505043996650458
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9205742218091685
      weight: 0.5366316050056862
  - layer_range: [61, 62]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.1282930679056895
- sources:
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 1.0
      weight: 0.27069708934775305
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.6308747752578504
      weight: 0.07120863223038318
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 0.8412199030537386
      weight: 0.19966180428582608
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 0.9359803089297394
      weight: 0.2950846533789031
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9771516501225564
      weight: 0.17586694279330423
  - layer_range: [62, 63]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 0.8737297732599923
      weight: 0.2463382985065069
- sources:
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
    parameters:
      density: 0.8073470431849605
      weight: 0.5320566070680327
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
    parameters:
      density: 0.9874143870374595
      weight: 0.35634965957297143
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
    parameters:
      density: 1.0
      weight: 0.48477502292440344
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
    parameters:
      density: 1.0
      weight: 0.08444626101554323
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
    parameters:
      density: 0.9380693225955433
      weight: 0.28599815080095314
  - layer_range: [63, 64]
    model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
    parameters:
      density: 1.0
      weight: 0.36981962509588995