metadata

base_model:
  - Hastagaras/Halu-8B-Llama3-v0.3
  - Blackroot/Llama-3-LongStory-LORA
  - Hastagaras/Halu-8B-Llama3-v0.3
  - Blackroot/Llama-3-8B-Abomination-LORA
  - Hastagaras/Halu-8B-Llama3-v0.3
library_name: transformers
tags:
  - mergekit
  - merge

model

I just tried saishf's merged model, and it's great. So I decided to try a similar merge method with Blackroot's LoRA that I had found earlier.

I don't know what to say about this model...

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using Hastagaras/Halu-8B-Llama3-v0.3 as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: Hastagaras/Halu-8B-Llama3-v0.3+Blackroot/Llama-3-LongStory-LORA
  - model: Hastagaras/Halu-8B-Llama3-v0.3+Blackroot/Llama-3-8B-Abomination-LORA
merge_method: model_stock
base_model: Hastagaras/Halu-8B-Llama3-v0.3
dtype: bfloat16