NEW-Fuse-AIME-2
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the DARE TIES merge method using /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095 as a base.
Models Merged
The following models were included in the merge:
- /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
- /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
- /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
- /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
- /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
Configuration
The following YAML configuration was used to produce this model:
base_model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
dtype: bfloat16
merge_method: dare_ties
parameters:
int8_mask: 1.0
normalize: 0.0
slices:
- sources:
- layer_range: [0, 1]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.2782315873972385
- layer_range: [0, 1]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.19635741093400924
- layer_range: [0, 1]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.839041420919602
weight: 0.1393051419022209
- layer_range: [0, 1]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9049838949212962
weight: 0.007949192496240043
- layer_range: [0, 1]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.6368696615921805
weight: 0.03283807920340641
- layer_range: [0, 1]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.34339904488021705
- sources:
- layer_range: [1, 2]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8298629387880676
weight: 0.012178045683612151
- layer_range: [1, 2]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.2742647165349933
- layer_range: [1, 2]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.3118824904882318
- layer_range: [1, 2]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.20820237912448977
- layer_range: [1, 2]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.6882884993390114
weight: 0.32931098839032225
- layer_range: [1, 2]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7541644143115471
weight: 0.5283350552564068
- sources:
- layer_range: [2, 3]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.1475972757877593
- layer_range: [2, 3]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.36006129832521916
- layer_range: [2, 3]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.6383637368643884
weight: 0.2417455775856331
- layer_range: [2, 3]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9634617790683426
weight: 0.30988574000828395
- layer_range: [2, 3]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.2123327378847143
- layer_range: [2, 3]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9745011611918509
weight: 0.26417975152408857
- sources:
- layer_range: [3, 4]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.15769046109738702
- layer_range: [3, 4]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.1523214821495638
- layer_range: [3, 4]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.037213704935742886
- layer_range: [3, 4]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.7497177917163473
weight: 0.2861632132956589
- layer_range: [3, 4]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.7215595383344846
weight: 0.4606348758519766
- layer_range: [3, 4]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.0003362236275280678
- sources:
- layer_range: [4, 5]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.6910337109786082
weight: 0.24392684897607322
- layer_range: [4, 5]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9710965496454345
weight: 0.012635998710707627
- layer_range: [4, 5]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.4860547857824506
weight: 0.23402390666045142
- layer_range: [4, 5]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.7500944911682366
weight: 0.2572776682722997
- layer_range: [4, 5]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.08365043313088268
- layer_range: [4, 5]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9810133262115704
weight: 0.3613481642532599
- sources:
- layer_range: [5, 6]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.6741956384738605
weight: 0.37578743779124096
- layer_range: [5, 6]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9072174733548687
weight: 0.07625416776300153
- layer_range: [5, 6]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8744591420309692
weight: 0.408177109381669
- layer_range: [5, 6]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.2683692653545862
- layer_range: [5, 6]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.06686054697269289
- layer_range: [5, 6]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.8449084919956413
weight: 0.4488419163177444
- sources:
- layer_range: [6, 7]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.11629103922432293
- layer_range: [6, 7]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.09563282389416433
- layer_range: [6, 7]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9904373561782471
weight: 0.11994247597890378
- layer_range: [6, 7]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9299436120275166
weight: 0.22834226407956734
- layer_range: [6, 7]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.11512519202646376
- layer_range: [6, 7]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9445172175266126
weight: 0.21318549805793088
- sources:
- layer_range: [7, 8]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.18798747602597987
- layer_range: [7, 8]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7452937123126001
weight: 0.14746911601895424
- layer_range: [7, 8]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8204977104998925
weight: 0.19134291787306087
- layer_range: [7, 8]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9737073791320208
weight: 0.4983379958659422
- layer_range: [7, 8]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.867081025278063
weight: 0.05096153597806359
- layer_range: [7, 8]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.8793745878128797
weight: 0.23915742179684527
- sources:
- layer_range: [8, 9]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9908584743786936
weight: 0.2900964369859359
- layer_range: [8, 9]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.6770121314397981
- layer_range: [8, 9]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.7421772684770622
- layer_range: [8, 9]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.1288360821322317
- layer_range: [8, 9]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.19588203535256857
- layer_range: [8, 9]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9647488315759917
weight: 0.05954407329266449
- sources:
- layer_range: [9, 10]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.051952322557393654
- layer_range: [9, 10]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7705586830846688
weight: 0.5733745872563619
- layer_range: [9, 10]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.1970853442522889
- layer_range: [9, 10]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8717807909710711
weight: 0.0908833911515223
- layer_range: [9, 10]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.7908247294988782
weight: 0.1845905936365468
- layer_range: [9, 10]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.8746886550244568
weight: 0.12012453127168171
- sources:
- layer_range: [10, 11]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.5901488666433586
weight: 0.4132454940186627
- layer_range: [10, 11]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.6564276215102214
weight: 0.05482864296740633
- layer_range: [10, 11]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.5363622563055074
weight: 0.1806790978658725
- layer_range: [10, 11]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9962626071178531
weight: 0.0641105089408362
- layer_range: [10, 11]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.11302650096438938
- layer_range: [10, 11]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.935821018848516
weight: 0.4976548707302226
- sources:
- layer_range: [11, 12]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.19900912406353574
- layer_range: [11, 12]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.20695001682401898
- layer_range: [11, 12]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9178868704524388
weight: 0.485866085043937
- layer_range: [11, 12]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8777643958740872
weight: 0.3914734004939914
- layer_range: [11, 12]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.03205146584371449
- layer_range: [11, 12]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.18556656278840403
- sources:
- layer_range: [12, 13]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.20656175990330095
- layer_range: [12, 13]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7968900729582112
weight: 0.3317709752868623
- layer_range: [12, 13]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.27491910682117465
- layer_range: [12, 13]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9894580466554811
weight: 0.036643107048087105
- layer_range: [12, 13]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.28862007087718894
- layer_range: [12, 13]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7487264086943679
weight: 0.4032155957575983
- sources:
- layer_range: [13, 14]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.10288506772457816
- layer_range: [13, 14]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.25240385899016365
- layer_range: [13, 14]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.24112069713536738
- layer_range: [13, 14]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.17970681579851688
- layer_range: [13, 14]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9880840219872322
weight: 0.09375379195324154
- layer_range: [13, 14]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.5146485259568411
- sources:
- layer_range: [14, 15]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8246319334241813
weight: 0.37830969105567097
- layer_range: [14, 15]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.18310637878417466
- layer_range: [14, 15]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.1878731334364966
- layer_range: [14, 15]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9988962548231595
weight: 0.068783579040219
- layer_range: [14, 15]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.059252156826440756
- layer_range: [14, 15]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.06399965153945208
- sources:
- layer_range: [15, 16]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.7671711029056976
weight: 0.08279825270344171
- layer_range: [15, 16]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.4832191061533638
- layer_range: [15, 16]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.43397801143478104
- layer_range: [15, 16]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9301793901319233
weight: 0.060057556519650085
- layer_range: [15, 16]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.3291053018368783
- layer_range: [15, 16]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.09163179667175611
- sources:
- layer_range: [16, 17]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.585335562539892
weight: 0.23990667870923393
- layer_range: [16, 17]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9501246198992629
weight: 0.14501212433260446
- layer_range: [16, 17]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8142622747372522
weight: 0.17718360841131947
- layer_range: [16, 17]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9588318274545542
weight: 0.48150382002080344
- layer_range: [16, 17]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.126230462170154
- layer_range: [16, 17]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.4892312413786961
weight: 0.24269527765600346
- sources:
- layer_range: [17, 18]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9709385013773042
weight: 0.07104163819906398
- layer_range: [17, 18]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9907919866060557
weight: 0.0007542843250286091
- layer_range: [17, 18]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9460559808768376
weight: 0.2752973549458865
- layer_range: [17, 18]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9983533282926503
weight: 0.15966873618588628
- layer_range: [17, 18]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.6921736257955359
weight: 0.0015923913647673538
- layer_range: [17, 18]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.31390324400321623
- sources:
- layer_range: [18, 19]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.7207752757241536
weight: 0.20938924032120507
- layer_range: [18, 19]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.806331369611605
weight: 0.014409611142731926
- layer_range: [18, 19]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.36097342241865993
- layer_range: [18, 19]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.7531577043031259
weight: 0.09689525515688532
- layer_range: [18, 19]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.6318999013401043
- layer_range: [18, 19]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7670284456767872
weight: 0.08004223909034286
- sources:
- layer_range: [19, 20]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.15219459605986607
- layer_range: [19, 20]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7917787133894402
weight: 0.18033705157266788
- layer_range: [19, 20]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8590518812159822
weight: 0.24947137503137812
- layer_range: [19, 20]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.054118308616569924
- layer_range: [19, 20]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9244409534965156
weight: 0.04720723246789843
- layer_range: [19, 20]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.32589512367293716
- sources:
- layer_range: [20, 21]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8974635885630745
weight: 0.4724663033132477
- layer_range: [20, 21]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.11510664715241947
- layer_range: [20, 21]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9235295631691169
weight: 0.042695431127009076
- layer_range: [20, 21]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.11133339509681325
- layer_range: [20, 21]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.4454395094657316
- layer_range: [20, 21]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7815707892292135
weight: 0.3716666021599484
- sources:
- layer_range: [21, 22]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.20445075642606872
- layer_range: [21, 22]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.08520193692835092
- layer_range: [21, 22]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.7772131139869718
weight: 0.005731024920312133
- layer_range: [21, 22]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.6351582798252953
weight: 0.2567372966508105
- layer_range: [21, 22]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9992444948886876
weight: 0.0809572690618752
- layer_range: [21, 22]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.4178172190398364
- sources:
- layer_range: [22, 23]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9964683534245098
weight: 0.23152496012989637
- layer_range: [22, 23]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.019642782853222324
- layer_range: [22, 23]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.19345821213830322
- layer_range: [22, 23]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8259775627246622
weight: 0.1710965828934345
- layer_range: [22, 23]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9655374347532074
weight: 0.1304630777907399
- layer_range: [22, 23]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.45493316692535235
weight: 0.07600846212926438
- sources:
- layer_range: [23, 24]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.6721109403298298
weight: 0.2356891503907223
- layer_range: [23, 24]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.10387151135694028
- layer_range: [23, 24]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.7836152755374957
weight: 0.07899479075913782
- layer_range: [23, 24]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.7825729304855489
weight: 0.24000742240862422
- layer_range: [23, 24]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9821688259769421
weight: 0.2354263414935049
- layer_range: [23, 24]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.21874627666822238
- sources:
- layer_range: [24, 25]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9392645214321065
weight: 0.19031861752847407
- layer_range: [24, 25]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.16765974328240574
- layer_range: [24, 25]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9550931808653395
weight: 0.0393875764308524
- layer_range: [24, 25]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.98045839892385
weight: 0.5243868032740402
- layer_range: [24, 25]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9441593866734689
weight: 0.03683392304225987
- layer_range: [24, 25]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.8671662108560604
weight: 0.2053450649145078
- sources:
- layer_range: [25, 26]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.09710053670860862
- layer_range: [25, 26]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9523988152047644
weight: 0.11779751921107934
- layer_range: [25, 26]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.5430552965743557
- layer_range: [25, 26]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.25258751641790106
- layer_range: [25, 26]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.20005994269627547
- layer_range: [25, 26]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9541301284421821
weight: 0.34044100626643836
- sources:
- layer_range: [26, 27]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.28336897808636863
- layer_range: [26, 27]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7840965294605414
weight: 0.12993902081988035
- layer_range: [26, 27]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8777576583284323
weight: 0.35922131109052746
- layer_range: [26, 27]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8085516370560839
weight: 0.5589123218741695
- layer_range: [26, 27]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.2878091149491125
- layer_range: [26, 27]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.5738334493450006
- sources:
- layer_range: [27, 28]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.6925825193976535
weight: 0.21465740887083135
- layer_range: [27, 28]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7151740929979256
weight: 0.2411662207956331
- layer_range: [27, 28]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.0601582880630152
- layer_range: [27, 28]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.27109660295620275
- layer_range: [27, 28]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.67885599604793
weight: 0.5739501338116965
- layer_range: [27, 28]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.37288477352244037
- sources:
- layer_range: [28, 29]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.7117475160844768
weight: 0.026680088358767312
- layer_range: [28, 29]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.43206913052299967
- layer_range: [28, 29]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.6825346935306619
weight: 0.3848004265440627
- layer_range: [28, 29]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.1174486809204486
- layer_range: [28, 29]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.03446883068163623
- layer_range: [28, 29]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.17279716303611553
- sources:
- layer_range: [29, 30]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.6310034358888048
weight: 0.12510510698935506
- layer_range: [29, 30]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.12123624320328882
- layer_range: [29, 30]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.21813157440017286
- layer_range: [29, 30]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.7177540094279146
weight: 0.1353882392476031
- layer_range: [29, 30]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.1881689886549915
- layer_range: [29, 30]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7305809384923427
weight: 0.376818424193501
- sources:
- layer_range: [30, 31]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8993640320922442
weight: 0.10196945523086967
- layer_range: [30, 31]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.5034086235375271
- layer_range: [30, 31]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.6942204155040704
weight: 0.1338853027545463
- layer_range: [30, 31]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.5028174851551407
- layer_range: [30, 31]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8843818959138889
weight: 0.18100811409305972
- layer_range: [30, 31]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.16104353135766042
- sources:
- layer_range: [31, 32]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.7904228187317733
weight: 0.43698500576059274
- layer_range: [31, 32]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.5936095539512497
- layer_range: [31, 32]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.14769236332694313
- layer_range: [31, 32]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.32773931635626724
- layer_range: [31, 32]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.011977893279050605
- layer_range: [31, 32]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.951087230384274
weight: 0.13846355395798557
- sources:
- layer_range: [32, 33]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.5405192410937041
- layer_range: [32, 33]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.43111899126718234
- layer_range: [32, 33]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9551387881134268
weight: 0.22687281842086082
- layer_range: [32, 33]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.873842693623591
weight: 0.16884088867211666
- layer_range: [32, 33]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.28988835450802036
- layer_range: [32, 33]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9628483492164649
weight: 0.28613172963789724
- sources:
- layer_range: [33, 34]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9660432462038945
weight: 0.1794102626672678
- layer_range: [33, 34]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.5677260098192384
- layer_range: [33, 34]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8606352805654085
weight: 0.31532457675577374
- layer_range: [33, 34]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.02959242060013658
- layer_range: [33, 34]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.24939191288685683
- layer_range: [33, 34]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.3425950191564526
- sources:
- layer_range: [34, 35]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.6721312070848626
weight: 0.12024261675706371
- layer_range: [34, 35]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.019202127824589216
- layer_range: [34, 35]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.30326296676546083
- layer_range: [34, 35]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.16136044813224878
- layer_range: [34, 35]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8758256653555511
weight: 0.10297032302601486
- layer_range: [34, 35]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.10140112186794767
- sources:
- layer_range: [35, 36]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8213652326986552
weight: 0.025122172830659414
- layer_range: [35, 36]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.07105756794027786
- layer_range: [35, 36]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.18392576209300893
- layer_range: [35, 36]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.20689669056513565
- layer_range: [35, 36]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9855597569074632
weight: 0.014505769298279403
- layer_range: [35, 36]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.944905419404809
weight: 0.15640978099711594
- sources:
- layer_range: [36, 37]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9435305974227193
weight: 0.21865101700794948
- layer_range: [36, 37]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.3665913818417759
- layer_range: [36, 37]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.2326236606988492
- layer_range: [36, 37]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.31748463039847885
- layer_range: [36, 37]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.6510288624800707
weight: 0.2794996180603957
- layer_range: [36, 37]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7756816509977775
weight: 0.39386186811472035
- sources:
- layer_range: [37, 38]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8471466862455088
weight: 0.1054419594045002
- layer_range: [37, 38]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9616794829960454
weight: 0.043352142042583044
- layer_range: [37, 38]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.31957748249992324
- layer_range: [37, 38]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.02782699112527924
- layer_range: [37, 38]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8172565934314691
weight: 0.1277490198636007
- layer_range: [37, 38]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.8572198669303388
weight: 0.22670446700028396
- sources:
- layer_range: [38, 39]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.7108000073584617
weight: 0.14925746902562262
- layer_range: [38, 39]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7947544560681823
weight: 0.0711535777774904
- layer_range: [38, 39]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.0827474861731709
- layer_range: [38, 39]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.21147448956539472
- layer_range: [38, 39]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.22620021391358253
- layer_range: [38, 39]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9110748174290368
weight: 0.6500310835503815
- sources:
- layer_range: [39, 40]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.0020954267426730594
- layer_range: [39, 40]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7974646792001101
weight: 0.31506886844439824
- layer_range: [39, 40]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.15473405497359374
- layer_range: [39, 40]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8730840189168834
weight: 0.11377520350754662
- layer_range: [39, 40]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.22172514394701104
- layer_range: [39, 40]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.045832021359076935
- sources:
- layer_range: [40, 41]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.40617426548358937
- layer_range: [40, 41]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7293174204491722
weight: 0.18765270592674677
- layer_range: [40, 41]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.07782987965295007
- layer_range: [40, 41]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.5964778321159088
weight: 0.3882928650086385
- layer_range: [40, 41]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.2931422056675209
- layer_range: [40, 41]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9163024077820021
weight: 0.22943743711338963
- sources:
- layer_range: [41, 42]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9632090369890876
weight: 0.102078915644014
- layer_range: [41, 42]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.6623465226007259
weight: 0.15912099272885613
- layer_range: [41, 42]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.2555144977628281
- layer_range: [41, 42]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.22493138386177133
- layer_range: [41, 42]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.7965620645278113
weight: 0.3488203269613851
- layer_range: [41, 42]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.511154852086326
weight: 0.08526320902249696
- sources:
- layer_range: [42, 43]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.6366405856168433
- layer_range: [42, 43]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.30068502897912774
- layer_range: [42, 43]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9537313606839656
weight: 0.17094172082484585
- layer_range: [42, 43]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9584256353781965
weight: 0.10215932540697358
- layer_range: [42, 43]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9741621393637496
weight: 0.397153527257189
- layer_range: [42, 43]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.944947078669692
weight: 0.02182087356037161
- sources:
- layer_range: [43, 44]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.6589519722788534
weight: 0.24922615456400055
- layer_range: [43, 44]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7355957820471619
weight: 0.47067521934612006
- layer_range: [43, 44]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.17869005019437223
- layer_range: [43, 44]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.029740284638674896
- layer_range: [43, 44]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9066172053744459
weight: 0.4690665585114081
- layer_range: [43, 44]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.26857497847644474
- sources:
- layer_range: [44, 45]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.7322189781528857
weight: 0.04220887442606691
- layer_range: [44, 45]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.3927460815806082
- layer_range: [44, 45]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.1776425311464363
- layer_range: [44, 45]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9111422043244886
weight: 0.07019459222990815
- layer_range: [44, 45]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.8927447142902996
weight: 0.3203847503770507
- layer_range: [44, 45]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.3062471241146648
- sources:
- layer_range: [45, 46]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.018248569758602007
- layer_range: [45, 46]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.47581471574830314
- layer_range: [45, 46]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.1402055666753047
- layer_range: [45, 46]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.01690887852775419
- layer_range: [45, 46]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.18114560999104787
- layer_range: [45, 46]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.9328123915780923
weight: 0.06302157151314448
- sources:
- layer_range: [46, 47]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8273736951212698
weight: 0.14670372972572973
- layer_range: [46, 47]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.5117048774533038
- layer_range: [46, 47]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9859786039118714
weight: 0.013636747101578778
- layer_range: [46, 47]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.2014433972478546
- layer_range: [46, 47]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9937470311597871
weight: 0.01735028806980282
- layer_range: [46, 47]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7810778382468737
weight: 0.07828387109196101
- sources:
- layer_range: [47, 48]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.7883109207887593
weight: 0.02129674787906119
- layer_range: [47, 48]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.12692348389073616
- layer_range: [47, 48]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9682184167024662
weight: 0.03941603422714035
- layer_range: [47, 48]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.044210621164719355
- layer_range: [47, 48]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.14971915383704015
- layer_range: [47, 48]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.5972169931826233
weight: 0.05602522459520403
- sources:
- layer_range: [48, 49]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.028867226889573883
- layer_range: [48, 49]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.31826427696469695
- layer_range: [48, 49]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.062101442235530574
- layer_range: [48, 49]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8580212133028511
weight: 0.14925021642324868
- layer_range: [48, 49]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.2997249902505159
- layer_range: [48, 49]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.4567488915611886
- sources:
- layer_range: [49, 50]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.3887546798623643
weight: 0.22250851848434627
- layer_range: [49, 50]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.29918010727072736
- layer_range: [49, 50]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.0006963799120076053
- layer_range: [49, 50]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.5196794348046012
- layer_range: [49, 50]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.16886829950429177
- layer_range: [49, 50]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.21169831684759394
- sources:
- layer_range: [50, 51]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9263984426155888
weight: 0.46208117066898613
- layer_range: [50, 51]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.26513336920610525
- layer_range: [50, 51]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9842480696543732
weight: 0.2606511991191279
- layer_range: [50, 51]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8321555646679069
weight: 0.260037744419943
- layer_range: [50, 51]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.3362202749259709
- layer_range: [50, 51]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7799505656336573
weight: 0.2148809629948658
- sources:
- layer_range: [51, 52]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9456014782497077
weight: 0.2684329744931154
- layer_range: [51, 52]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9218159685802345
weight: 0.04447382443778326
- layer_range: [51, 52]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.12634547595280862
- layer_range: [51, 52]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.0345938092305072
- layer_range: [51, 52]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.17063364496157324
- layer_range: [51, 52]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.050232899418394705
- sources:
- layer_range: [52, 53]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.08075549628007361
- layer_range: [52, 53]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7558578759683025
weight: 0.22688105172640147
- layer_range: [52, 53]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9132175305169759
weight: 0.6284259023072631
- layer_range: [52, 53]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.16826756744339957
- layer_range: [52, 53]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.22804881825097434
- layer_range: [52, 53]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.984122045513045
weight: 0.27033565277425947
- sources:
- layer_range: [53, 54]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.9255767405080507
weight: 0.37663767730586784
- layer_range: [53, 54]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7234368969266856
weight: 0.1658160463398735
- layer_range: [53, 54]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.8532059590120992
weight: 0.43706964196670706
- layer_range: [53, 54]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.04771119856381902
- layer_range: [53, 54]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.5919569102221742
- layer_range: [53, 54]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.22963281435189492
- sources:
- layer_range: [54, 55]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.3475997473426404
- layer_range: [54, 55]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.8161329387790792
weight: 0.03648533113218805
- layer_range: [54, 55]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9028789366865357
weight: 0.3371401502028399
- layer_range: [54, 55]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.5021778754503483
- layer_range: [54, 55]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.6278797730584087
weight: 0.037325139532396634
- layer_range: [54, 55]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.3936120888548632
- sources:
- layer_range: [55, 56]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.7388750662277602
weight: 0.2151193971005742
- layer_range: [55, 56]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.5399766405483633
- layer_range: [55, 56]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.10442143666781545
- layer_range: [55, 56]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8263488485859503
weight: 0.06485929066641631
- layer_range: [55, 56]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.743026202579836
weight: 0.014638125069511204
- layer_range: [55, 56]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.8227894425909675
weight: 0.11892832059734368
- sources:
- layer_range: [56, 57]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.38393582684841193
- layer_range: [56, 57]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.24201730267713273
- layer_range: [56, 57]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.26007076742470825
- layer_range: [56, 57]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.08422385804581514
- layer_range: [56, 57]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.0036992660024722512
- layer_range: [56, 57]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7514939139207344
weight: 0.3451997072846399
- sources:
- layer_range: [57, 58]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.33871613921258287
- layer_range: [57, 58]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.048182597743439665
- layer_range: [57, 58]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.011651172527993914
- layer_range: [57, 58]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.8160849831431859
weight: 0.11424646832766437
- layer_range: [57, 58]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.3931983123342998
- layer_range: [57, 58]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7171727264220018
weight: 0.10929452652254812
- sources:
- layer_range: [58, 59]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.22497978384478687
- layer_range: [58, 59]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7768256950509063
weight: 0.10479639369472392
- layer_range: [58, 59]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.145637724965138
- layer_range: [58, 59]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.12241569680355846
- layer_range: [58, 59]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.883279950825221
weight: 0.5532199243057724
- layer_range: [58, 59]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.06739967651517345
- sources:
- layer_range: [59, 60]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.8844073333555544
weight: 0.1938231280257878
- layer_range: [59, 60]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.7891270799908772
weight: 0.16010268470615255
- layer_range: [59, 60]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.4343278594861103
- layer_range: [59, 60]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.389752137962742
- layer_range: [59, 60]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.9016217999214565
weight: 0.2505204090631463
- layer_range: [59, 60]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.1977767156949726
- sources:
- layer_range: [60, 61]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.2543523020344591
- layer_range: [60, 61]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9662968003254059
weight: 0.18615431697974158
- layer_range: [60, 61]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9113337809225843
weight: 0.07920949500135421
- layer_range: [60, 61]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.11878279057630278
- layer_range: [60, 61]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.7952742674123203
weight: 0.16118019976313275
- layer_range: [60, 61]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.031103198183016406
- sources:
- layer_range: [61, 62]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.05410447775552422
- layer_range: [61, 62]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.9104633681153931
weight: 0.30571810831172763
- layer_range: [61, 62]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.9154645628329681
weight: 0.27927303553096483
- layer_range: [61, 62]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.0761595032045365
- layer_range: [61, 62]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.869901125974021
weight: 0.22816111210614895
- layer_range: [61, 62]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.7806001258108655
weight: 0.09188340518847221
- sources:
- layer_range: [62, 63]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 1.0
weight: 0.09551963768037755
- layer_range: [62, 63]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 0.8646175386347293
weight: 0.24410971068987242
- layer_range: [62, 63]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 0.895326932093959
weight: 0.47378092599141397
- layer_range: [62, 63]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 1.0
weight: 0.18318460294204425
- layer_range: [62, 63]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 0.6660708817741321
weight: 0.18328269352991441
- layer_range: [62, 63]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 0.8814742970830101
weight: 0.5453905534189657
- sources:
- layer_range: [63, 64]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Qwen2.5-32B_2506482046
parameters:
density: 0.7504478590156137
weight: 0.36513314401521524
- layer_range: [63, 64]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/QwQ-32B-Preview_1809212316
parameters:
density: 1.0
weight: 0.3744076494258641
- layer_range: [63, 64]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/DeepSeek-R1-Distill-Qwen-32B_2219931087
parameters:
density: 1.0
weight: 0.026651943167621095
- layer_range: [63, 64]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview_2733309095
parameters:
density: 0.9059698105875248
weight: 0.1505532240067479
- layer_range: [63, 64]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/s1-32B_3285827842
parameters:
density: 1.0
weight: 0.04263662107328934
- layer_range: [63, 64]
model: /mnt/nvme5n1p1/Qwen-32B-merge/input_models/Bespoke-Stratos-32B_2324529121
parameters:
density: 1.0
weight: 0.3274436147282644
- Downloads last month
- 4
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.