Sri-Vigneshwar-DJ
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -29,6 +29,33 @@ widget:
|
|
29 |
This model was converted to GGUF format from [`Sri-Vigneshwar-DJ/phi-4-GGUF`](https://huggingface.co/microsoft/phi-4) using llama.cpp
|
30 |
Refer to the [original model card](https://huggingface.co/microsoft/phi-4) for more details on the model.
|
31 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
32 |
## Use with llama.cpp
|
33 |
Install llama.cpp through brew (works on Mac and Linux) from []
|
34 |
|
|
|
29 |
This model was converted to GGUF format from [`Sri-Vigneshwar-DJ/phi-4-GGUF`](https://huggingface.co/microsoft/phi-4) using llama.cpp
|
30 |
Refer to the [original model card](https://huggingface.co/microsoft/phi-4) for more details on the model.
|
31 |
|
32 |
+
## Model Summary
|
33 |
+
|
34 |
+
| | |
|
35 |
+
|-------------------------|-------------------------------------------------------------------------------|
|
36 |
+
| **Developers** | Microsoft Research |
|
37 |
+
| **Description** | `phi-4` is a state-of-the-art open model built upon a blend of synthetic datasets, data from filtered public domain websites, and acquired academic books and Q&A datasets. The goal of this approach was to ensure that small capable models were trained with data focused on high quality and advanced reasoning.<br><br>`phi-4` underwent a rigorous enhancement and alignment process, incorporating both supervised fine-tuning and direct preference optimization to ensure precise instruction adherence and robust safety measures |
|
38 |
+
| **Architecture** | 14B parameters, dense decoder-only Transformer model |
|
39 |
+
| **Inputs** | Text, best suited for prompts in the chat format |
|
40 |
+
| **Context length** | 16K tokens |
|
41 |
+
| **GPUs** | 1920 H100-80G |
|
42 |
+
| **Training time** | 21 days |
|
43 |
+
| **Training data** | 9.8T tokens |
|
44 |
+
| **Outputs** | Generated text in response to input |
|
45 |
+
| **Dates** | October 2024 – November 2024 |
|
46 |
+
| **Status** | Static model trained on an offline dataset with cutoff dates of June 2024 and earlier for publicly available data |
|
47 |
+
| **Release date** | December 12, 2024 |
|
48 |
+
| **License** | MIT |
|
49 |
+
|
50 |
+
## Intended Use
|
51 |
+
|
52 |
+
| | |
|
53 |
+
|-------------------------------|-------------------------------------------------------------------------|
|
54 |
+
| **Primary Use Cases** | Our model is designed to accelerate research on language models, for use as a building block for generative AI powered features. It provides uses for general purpose AI systems and applications (primarily in English) which require:<br><br>1. Memory/compute constrained environments.<br>2. Latency bound scenarios.<br>3. Reasoning and logic. |
|
55 |
+
| **Out-of-Scope Use Cases** | Our models is not specifically designed or evaluated for all downstream purposes, thus:<br><br>1. Developers should consider common limitations of language models as they select use cases, and evaluate and mitigate for accuracy, safety, and fairness before using within a specific downstream use case, particularly for high-risk scenarios.<br>2. Developers should be aware of and adhere to applicable laws or regulations (including privacy, trade compliance laws, etc.) that are relevant to their use case, including the model’s focus on English.<br>3. Nothing contained in this Model Card should be interpreted as or deemed a restriction or modification to the license the model is released under. |
|
56 |
+
|
57 |
+
|
58 |
+
|
59 |
## Use with llama.cpp
|
60 |
Install llama.cpp through brew (works on Mac and Linux) from []
|
61 |
|