phi-4-GGUF / README.md
apepkuss79's picture
Update README.md
44c9c10 verified
|
raw
history blame
668 Bytes
metadata
base_model: microsoft/phi-4
license: mit
license_link: https://huggingface.co./microsoft/phi-4/resolve/main/LICENSE
language:
  - en
pipeline_tag: text-generation
library_name: transformers
model_creator: Microsoft
model_name: phi-4
quantized_by: Second State Inc.

Phi-4-GGUF

Original Model

microsoft/phi-4

Run with Gaianet

Prompt template:

prompt template: phi-4-chat

Context size:

chat_ctx_size: 16000

Run with GaiaNet:

Quantized with llama.cpp b4450