This is a merge of ToastyPigeon's. I just uploaded the full weights :3

mistral-heal-test-v2

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the breadcrumbs merge method using unsloth/Mistral-Small-24B-Instruct-2501 as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

base_model: unsloth/Mistral-Small-24B-Instruct-2501
merge_method: breadcrumbs
parameters:
  density: 0.95
  gamma: 0.01
slices:
- sources:
  - layer_range: [0, 40]
    model: ToastyPigeon/new-ms-rp-test-v0-v2
    parameters:
      weight: 1.0
  - layer_range: [0, 40]
    model: unsloth/Mistral-Small-24B-Instruct-2501
Downloads last month
4
Safetensors
Model size
23.6B params
Tensor type
BF16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for SaisExperiments/mistral-heal-test-v2