Safetensors

This is a ByteLlama 101M model pretrained on the Cosmopedia v2 portion of the SmolLM corpus for 2 epochs, followed by training on a subset of OSCAR for another epoch.

Downloads last month
900
Safetensors
Model size
107M params
Tensor type
BF16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for mittagessen/bytellama_oscar

Finetuned
(2)
this model

Datasets used to train mittagessen/bytellama_oscar