seandearnaley
commited on
Commit
•
d29f8b3
1
Parent(s):
c31452e
Update README.md
Browse files
README.md
CHANGED
@@ -9,6 +9,7 @@ tags:
|
|
9 |
- mistral
|
10 |
- trl
|
11 |
- sft
|
|
|
12 |
base_model: unsloth/Phi-3-mini-4k-instruct
|
13 |
---
|
14 |
|
@@ -18,6 +19,32 @@ base_model: unsloth/Phi-3-mini-4k-instruct
|
|
18 |
- **License:** apache-2.0
|
19 |
- **Finetuned from model :** unsloth/Phi-3-mini-4k-instruct
|
20 |
|
21 |
-
This
|
22 |
|
23 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
9 |
- mistral
|
10 |
- trl
|
11 |
- sft
|
12 |
+
- phi-3
|
13 |
base_model: unsloth/Phi-3-mini-4k-instruct
|
14 |
---
|
15 |
|
|
|
19 |
- **License:** apache-2.0
|
20 |
- **Finetuned from model :** unsloth/Phi-3-mini-4k-instruct
|
21 |
|
22 |
+
This phi-3 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
|
23 |
|
24 |
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
25 |
+
|
26 |
+
Developed to support [Elevating Sentiment Analysis @Medium](https://seandearnaley.medium.com/elevating-sentiment-analysis-ad02a316df1d).
|
27 |
+
|
28 |
+
example Ollama Modelfile:
|
29 |
+
|
30 |
+
```
|
31 |
+
FROM ./phi3-4k-sentiment-may-24-2024-2epoches-unsloth.Q4_K_M.gguf
|
32 |
+
SYSTEM """
|
33 |
+
You are an advanced AI assistant created to perform sentiment analysis on text. Your task is to carefully read the text and analyze the sentiment it expresses towards the potential future stock value of any company mentioned. Analyze the sentiment of this text and respond with the appropriate JSON:
|
34 |
+
"""
|
35 |
+
TEMPLATE """{{ if .System }}<|system|>
|
36 |
+
{{ .System }}<|end|>
|
37 |
+
{{ end }}{{ if .Prompt }}<|user|>
|
38 |
+
{{ .Prompt }}<|end|>
|
39 |
+
{{ end }}<|assistant|>
|
40 |
+
{{ .Response }}<|end|>"""
|
41 |
+
|
42 |
+
# PARAMETER stop <|end_of_text|> # Default for Llama3
|
43 |
+
# PARAMETER stop </s> # Default for Mistral
|
44 |
+
|
45 |
+
# A parameter that sets the temperature of the model, controlling how creative or conservative the model's responses will be
|
46 |
+
PARAMETER temperature 0.2
|
47 |
+
|
48 |
+
# Sets how far back for the model to look back to prevent repetition. (Default: 64, 0 = disabled, -1 = num_ctx)
|
49 |
+
PARAMETER repeat_last_n 256
|
50 |
+
```
|