royallab
/

TinyLlama-1.1B-ckpt-2.5T-exl2

Model card Files Files and versions Community

TinyLlama-1.1B-ckpt-2.5T-exl2

EXL2 quants of TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T intended for use in speculative decoding.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference API

Unable to determine this model's library. Check the docs .

Collection including royallab/TinyLlama-1.1B-ckpt-2.5T-exl2

Exl2

Models that we have quantized to exllamav2's quantization format • 22 items • Updated Feb 15 • 2