Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

L3.3-MS-Evayale-70B

Creator: SteelSkull

About Evayale-70B:

Name Legend:
L3.3 = Llama 3.3
MS = Model Stock
Evayale = mix of EVA-LLAMA-0.0 and EURYALE-v2.3
70B = its 70B
      

This model was created as I liked the storytelling of EVA but the prose and details of scenes from EURYALE, my goal is to merge the robust storytelling of both models while attempting to maintain the positives of both models.

My recommended Templates / System prompts: (List of Prompt-Gremlins)

LLam@ception <<< Template / System prompt [Made by @.konnect]

DWK-SP0.02 <<< System prompt [Made by @daimonwk]

Quants: (List of badasses) [will add once created]

GGUF Quant:

- bartowski: Combined-GGUF

- mradermacher: GGUF // Imat-GGUF

Config:

MODEL_NAME = "L3.3-MS-Evayale-70B"
base_model: unsloth/Llama-3.3-70B-Instruct
merge_method: model_stock
dtype: bfloat16
models:
  - model: EVA-UNIT-01/EVA-LLaMA-3.33-70B-v0.0
  - model: Sao10K/L3.3-70B-Euryale-v2.3

If you wish to support:

Downloads last month
13
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for waldie/L3.3-MS-Evayale-70B-2.25bpw-h6-exl2

Quantized
(4)
this model