PyTorch
Safetensors

This is a ByteLlama 101M model pretrained on the Cosmopedia v2 portion of the SmolLM corpus for 2 epochs, followed by training on a subset of OSCAR for another epoch.

Downloads last month
240
Safetensors
Model size
106M params
Tensor type
BF16
·
Inference API
Unable to determine this model's library. Check the docs .

Model tree for mittagessen/bytellama_oscar

Finetuned
(2)
this model

Datasets used to train mittagessen/bytellama_oscar