Convert from TinyLlama/TinyLlama-1.1B-Chat-v1.0 and 4 bits quantized.

Require onnxruntime>=0.17.0

Inference Examples

Inference API (serverless) does not yet support transformers.js models for this pipeline type.

Model tree for BricksDisplay/TinyLlama-1.1B-Chat-v1.0-q4

Base model

Quantized

(73)

this model

Collection including BricksDisplay/TinyLlama-1.1B-Chat-v1.0-q4