Starling-LM-10.7B-beta

This is Starling-LM-10.7B-beta, a depth-upscaled version of Nexusflow/Starling-LM-7B-beta.

This model is intended to be used as a drop-in upgrade from the original 7 billion parameter model.

GGUF quantizations (courtesy of bartowski)

See bartowski/Starling-LM-10.7B-beta-GGUF

ExLlamaV2 quantizations (courtesy of blockblockblock)

Downloads last month
20
Safetensors
Model size
10.7B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for ddh0/Starling-LM-10.7B-beta

Quantizations
1 model

Collection including ddh0/Starling-LM-10.7B-beta