Uploaded model

Evaluation

For a detailed comparison of model performance, check out the Leaderboard for Italian Language Models.

Here's a breakdown of the performance metrics:

Metric hellaswag_it acc_norm arc_it acc_norm m_mmlu_it 5-shot acc m_mmlu_pro_it Average
Accuracy Normalized 69.35 49.1 69.53 0.3913 62.66
Downloads last month
5,618
Safetensors
Model size
7.36B params
Tensor type
F32
·
FP16
·
U8
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train SeacomSrl/SeaPhi3-medium

Collection including SeacomSrl/SeaPhi3-medium