Shekswess's picture
Upload model trained with Unsloth
719b573 verified
|
raw
history blame
943 Bytes
metadata
language:
  - en
license: apache-2.0
tags:
  - text-generation-inference
  - transformers
  - unsloth
  - mistral
  - trl
  - medical
datasets:
  - Shekswess/medical_gemma_instruct_dataset_short
base_model: unsloth/gemma-1.1-7b-it-bnb-4bit
  • Developed by: Shekswess
  • License: apache-2.0
  • Finetuned from model : unsloth/gemma-1.1-7b-it-bnb-4bit

To utilize the finetuning of the model, you need to use the gemma instruction prompt template for this medical version of the model :

<start_of_turn>user Answer the question truthfully, you are a medical professional. This is the question: {question}<end_of_turn>

Metrics:

  • train_runtime: 4544.6901
  • train_samples_per_second: 0.66
  • train_steps_per_second: 0.083
  • total_flos: 5.862681923842867e+16
  • train_loss: 1.7245690104166667
  • steps: 375
  • epoch: 1.0

image/png