shimmyshimmer commited on
Commit
3616de3
·
verified ·
1 Parent(s): 8fa251a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md CHANGED
@@ -28,6 +28,22 @@ We have a free Google Colab Tesla T4 notebook for Phi-4 here: https://colab.rese
28
  # unsloth/phi-4-GGUF
29
  We have converted Phi-4 to Llama's architecture for improved ease of use, better fine-tuning, and greater accuracy. Also contains our bugfixes.
30
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31
  ## ✨ Finetune for Free
32
 
33
  All notebooks are **beginner friendly**! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model.
 
28
  # unsloth/phi-4-GGUF
29
  We have converted Phi-4 to Llama's architecture for improved ease of use, better fine-tuning, and greater accuracy. Also contains our bugfixes.
30
 
31
+ To use Phi-4 in llama.cpp, do:
32
+
33
+ ```./llama.cpp/llama-cli
34
+ --model unsloth/phi-4-GGUF/phi-4-Q2_K_L.gguf
35
+ --prompt '<|im_start|>user<|im_sep|>Provide all combinations of a 5 bit binary number.<|im_end|><|im_start|>assistant<|im_sep|>'
36
+ --threads 16
37
+ ```
38
+
39
+ Which will produce:
40
+
41
+ ```A 5-bit binary number consists of 5 positions, each of which can be either 0 or 1. Therefore, there are \(2^5 = 32\) possible combinations. Here they are, listed in ascending order:
42
+ 1. 00000
43
+ 2. 00001
44
+ 3. 00010
45
+ ```
46
+
47
  ## ✨ Finetune for Free
48
 
49
  All notebooks are **beginner friendly**! Add your dataset, click "Run All", and you'll get a 2x faster finetuned model.