Shekswess commited on
Commit
f4b5d97
1 Parent(s): 37859fe

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -5
README.md CHANGED
@@ -6,17 +6,31 @@ tags:
6
  - text-generation-inference
7
  - transformers
8
  - unsloth
9
- - gemma
10
  - trl
 
11
  base_model: unsloth/gemma-1.1-7b-it-bnb-4bit
 
 
12
  ---
13
 
14
- # Uploaded model
15
-
16
  - **Developed by:** Shekswess
17
  - **License:** apache-2.0
18
  - **Finetuned from model :** unsloth/gemma-1.1-7b-it-bnb-4bit
19
 
20
- This gemma model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
6
  - text-generation-inference
7
  - transformers
8
  - unsloth
9
+ - mistral
10
  - trl
11
+ - medical
12
  base_model: unsloth/gemma-1.1-7b-it-bnb-4bit
13
+ datasets:
14
+ - Shekswess/medical_gemma_instruct_dataset_short
15
  ---
16
 
 
 
17
  - **Developed by:** Shekswess
18
  - **License:** apache-2.0
19
  - **Finetuned from model :** unsloth/gemma-1.1-7b-it-bnb-4bit
20
 
21
+ To utilize the finetuning of the model, you need to use the gemma instruction prompt template for this medical version of the model :
22
+ ```
23
+ <start_of_turn>user Answer the question truthfully, you are a medical professional. This is the question: {question}<end_of_turn>
24
+ ```
25
+
26
+ Metrics:
27
+
28
+ - train_runtime: 4544.6901
29
+ - train_samples_per_second: 0.66
30
+ - train_steps_per_second: 0.083
31
+ - total_flos: 5.862681923842867e+16
32
+ - train_loss: 1.7245690104166667
33
+ - steps: 375
34
+ - epoch: 1.0
35
 
36
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6569f13004643352df96e40f/L22u9s2ShJRwg3AdYs-06.png)