GGUF
Inference Endpoints
fabiofernandes commited on
Commit
dd4a2ef
·
verified ·
1 Parent(s): fafcee9

Update readme

Browse files
Files changed (1) hide show
  1. README.md +14 -3
README.md CHANGED
@@ -1,3 +1,14 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model:
4
+ - utter-project/EuroLLM-9B
5
+ ---
6
+ Just converted the original model https://huggingface.co/blog/eurollm-team/eurollm-9b to GGUF using llamacpp.
7
+
8
+ If you need more information about the original project: https://huggingface.co/utter-project
9
+
10
+ Just loaded the gguf model into lm-studio (https://lmstudio.ai/) and sent a prompt in portuguese:
11
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/647f596045baf21ad70a5810/gJieNBeTmuyrA76esScuG.png)
12
+
13
+ This is a not completely tested converted model, please use it carefully, for personal studyng and testing purposes.
14
+ Convert it by yourself with specific quantitization for production environments.