NickyNicky/gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2-GGUF

Quantized GGUF model files for gemma-1.1-2b-it_oasst_format_chatML_unsloth_V1_function_calling_V2 from NickyNicky

Name	Quant method	Size
gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.fp16.gguf	fp16	5.02 GB
gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q2_k.gguf	q2_k	1.16 GB
gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q3_k_m.gguf	q3_k_m	1.38 GB
gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q4_k_m.gguf	q4_k_m	1.63 GB
gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q5_k_m.gguf	q5_k_m	1.84 GB
gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q6_k.gguf	q6_k	2.06 GB
gemma-1.1-2b-it_oasst_format_chatml_unsloth_v1_function_calling_v2.q8_0.gguf	q8_0	2.67 GB

Original Model Card:

Metrics.

interrupted execution no TrainOutput

Take dataset.

hiyouga/glaive-function-calling-v2-sharegpt

Dataset format gemma fine tune.

NickyNicky/function-calling_chatml_gemma_v1

colab examples and Gradio.

https://colab.research.google.com/drive/1an2D2C3VNs32UV9kWlXEPJjio0uJN6nW?usp=sharing