shimmyshimmer
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -28,6 +28,22 @@ We have a free Google Colab Tesla T4 notebook for Phi-4 here: https://colab.rese
|
|
28 |
# unsloth/phi-4-GGUF
|
29 |
We have converted Phi-4 to Llama's architecture for improved ease of use, better fine-tuning, and greater accuracy. Also contains our bugfixes.
|
30 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
31 |
## ✨ Finetune for Free
|
32 |
|
33 |
All notebooks are **beginner friendly**! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model.
|
|
|
28 |
# unsloth/phi-4-GGUF
|
29 |
We have converted Phi-4 to Llama's architecture for improved ease of use, better fine-tuning, and greater accuracy. Also contains our bugfixes.
|
30 |
|
31 |
+
To use Phi-4 in llama.cpp, do:
|
32 |
+
|
33 |
+
```./llama.cpp/llama-cli
|
34 |
+
--model unsloth/phi-4-GGUF/phi-4-Q2_K_L.gguf
|
35 |
+
--prompt '<|im_start|>user<|im_sep|>Provide all combinations of a 5 bit binary number.<|im_end|><|im_start|>assistant<|im_sep|>'
|
36 |
+
--threads 16
|
37 |
+
```
|
38 |
+
|
39 |
+
Which will produce:
|
40 |
+
|
41 |
+
```A 5-bit binary number consists of 5 positions, each of which can be either 0 or 1. Therefore, there are \(2^5 = 32\) possible combinations. Here they are, listed in ascending order:
|
42 |
+
1. 00000
|
43 |
+
2. 00001
|
44 |
+
3. 00010
|
45 |
+
```
|
46 |
+
|
47 |
## ✨ Finetune for Free
|
48 |
|
49 |
All notebooks are **beginner friendly**! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model.
|