QuantFactory
/

CausalLM-35b-beta-long-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

CausalLM 35b beta long

This is quantized version of CausalLM/35b-beta-long created using llama.cpp

TBA

Tokenizer is different from cohere - and chat template is ChatML - fully fine-tuned at 128K+

No loras, no quants, no tricks, 30M+ sft data.

Pressure Testing from: https://github.com/LeonEricsson/llmcontext

Downloads last month: 1,126

GGUF

Model size

35B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Examples

Text Generation

Unable to determine this model's library. Check the docs .

Model tree for QuantFactory/CausalLM-35b-beta-long-GGUF

Base model

CausalLM/35b-beta-long

Quantized

(9)

this model

Datasets used to train QuantFactory/CausalLM-35b-beta-long-GGUF