README.md

metadata

license: llama2
base_model: meta-llama/CodeLlama-7b-Python-hf
model_name: CodeLlama-7b-Python GGUF
model_type: llama
language:
  - code
tags:
  - LLM
  - llama2
  - llama-2
  - CodeLlama
  - CodeLlama-Python
  - CodeLlama-7B-Python
  - lama.cpp
  - Python
  - 7B

Model Card: Meta CodeLlama-7b-Python gguf

Origin Meta model CodeLlama-7b-Python, code llama large language model coding, codellama converted into gguf format with llama.cpp

Licen: "Llama 2 is licensed under the LLAMA 2 Community License, Copyright © Meta Platforms, Inc. All Rights Reserved."

Policy

Run model

./main -m ggml-model-f32-00001-of-00010.gguf -p "def fibonacci("

Convert to gguf

python3 convert.py ../codellama/CodeLlama-7b-Python

Split Model

Original Meta CodeLlama-7b-Python model converted with python3 convert.py to gguf and CodeLlama-7b-Python/ggml-model-f32.gguf and splitted with gguf-split to smaller size chunks up to split-max-tensors 32.

python3 convert.py ../codellama/CodeLlama-7b-Python
./gguf-split --split --split-max-tensors 32 ./models/CodeLlama-7b-Python/ggml-model-f32.gguf ./models/CodeLlama-7b-Python/ggml-model-f32

Merge-back model use

./gguf-split --merge ggml-model-f32-00001-of-00010.gguf ggml-model-f32.gguf