|
--- |
|
language: |
|
- en |
|
license: apache-2.0 |
|
tags: |
|
- text-generation-inference |
|
- transformers |
|
- unsloth |
|
- mistral |
|
- trl |
|
- medical |
|
datasets: |
|
- Shekswess/medical_gemma_instruct_dataset_short |
|
base_model: unsloth/gemma-1.1-7b-it-bnb-4bit |
|
--- |
|
|
|
- **Developed by:** Shekswess |
|
- **License:** apache-2.0 |
|
- **Finetuned from model :** unsloth/gemma-1.1-7b-it-bnb-4bit |
|
|
|
To utilize the fine-tuning of the model, you need to use the gemma instruction prompt template for this medical version of the model : |
|
``` |
|
<start_of_turn>user Answer the question truthfully, you are a medical professional. This is the question: {question}<end_of_turn> |
|
``` |
|
|
|
Metrics: |
|
|
|
- train_runtime: 2470.9842 |
|
- train_samples_per_second: 0.809 |
|
- train_steps_per_second: 0.101 |
|
- total_flos: 3.168381674611507e+16 |
|
- train_loss: 1.843041015625 |
|
- steps: 250 |
|
- epoch: 1.0 |
|
|
|
 |
|
|
|
|
