Upload folder using huggingface_hub (#1)

- 9ced8e4bc850e44c7c1d25e93169bca1d89975dfd0083b2eca2fb2660c777910 (69afabb7f8ca6e50e42ea6f5d1f24f83a080ff04)
- 966a0e331e1516e5d704ee0959ae47caf310c44b929b00cb67206a6d61e42415 (9d71ff865907753f66d4868f7e17c55972833d95)
- 06d8833a08fb3087e0f5738c2617a2501846b3b9e4b32f0a9df4fe32e3b45c5b (a410a151711028b685af9d914acf1183885b2af0)
- 212d982fc4f3a1bcf6557e91427638f23d19426854d25c63645f0725d6aa6602 (654d0fe7f3ba3ef3462fbdbd1093cc00b6b48b87)
- 281faa52feaf12da05a335d477d90fe80131ca0c997c023ed7d2e5f0135d6b4c (f97b4c25b10afd7a05aac05a78f3b0e0bf0b64fc)
- 031d43e36ce546219db605576588bb4f3e889a4b9d843b4bb37732cd64649ca0 (73cc11709498fd158ca7800b5540f1b0d5354450)
- db6112a867f09ca9bf9d4b611cb4028bc6eb1b129f21822669e67a2a0e6b70bc (de8875df3c7dacbb986af22bc71d69942e21dec1)
- d206186dc8c1e58af9eb0c07846e03d5d9d7fc434b0652a834e380e82724d512 (ff47f587198a90ac5dc891e47e5a79549122ad88)
- 8fa476d4027b986bcc2b859d697d2e726815307ef65f52e64e3598b949abf34d (d0cccab12db0b9497764e8abc9154429215bd24a)
- 57b6c7ab1039309fc838aa54cc8e7d5d6fe1e4cea3dfda9a0717d4217c88e8e2 (6e1412e866abf66ef5adfe7fd660ca690b7e16d4)
- fd416c460b26b6fae03d5036ff12110e5f3ff4cf45d763156ddb8e7a62e3fc79 (201e70cb6e8f3131dc1ade13e9e09af695c61be3)
- acb92eeb0585e4da28a3c5a42ae9f00af21b89edee7208ec76a94fc364ef6062 (003bc25ba3cebc80ac6d118e3a463f0d7580cbf1)

.gitattributes

@@ -33,3 +33,14 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+phi-4.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+phi-4.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+phi-4.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+phi-4.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+phi-4.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+phi-4.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+phi-4.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+phi-4.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+phi-4.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+phi-4.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+phi-4.fp16.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,45 @@
+---
+base_model: microsoft/phi-4
+inference: false
+model_creator: microsoft
+model_name: phi-4-GGUF
+pipeline_tag: text-generation
+quantized_by: MaziyarPanahi
+tags:
+- quantized
+- 2-bit
+- 3-bit
+- 4-bit
+- 5-bit
+- 6-bit
+- 8-bit
+- GGUF
+- text-generation
+---
+# [MaziyarPanahi/phi-4-GGUF](https://huggingface.co/MaziyarPanahi/phi-4-GGUF)
+- Model creator: [microsoft](https://huggingface.co/microsoft)
+- Original model: [microsoft/phi-4](https://huggingface.co/microsoft/phi-4)
+
+## Description
+[MaziyarPanahi/phi-4-GGUF](https://huggingface.co/MaziyarPanahi/phi-4-GGUF) contains GGUF format model files for [microsoft/phi-4](https://huggingface.co/microsoft/phi-4).
+
+### About GGUF
+
+GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
+
+Here is an incomplete list of clients and libraries that are known to support GGUF:
+
+* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
+* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
+* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
+* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
+* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
+* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
+* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
+* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
+* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
+* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
+
+## Special thanks
+
+🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.

phi-4.Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9998f160b5c284fea5fa72d738e7dba26423e9c757f14f053d04ba95f99bb00f
+size 5547348064

phi-4.Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:82df0b207787dd8026cc7eb748b9957510004c17ddda34ea6160db787039cb4e
+size 7930155104

phi-4.Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:644e8a3ec26c6332594b9ad3abe9ce3fb8796369d7c446df74c4aeaf8600fa14
+size 7363268704

phi-4.Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0a8f2706c03b770a2c10b1252597d36e23899b56502a5520bc46eaf4554c9812
+size 6504747104

phi-4.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c7b128cc57818df7c60adce25269f16116a03cc92dea7fcd51afcaa9be4df7cf
+size 9053114464

phi-4.Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:255a681a084503a036b9a2eb9d5f6a05f2b46599fb63f93827ef919fc2f9476d
+size 8440762464

phi-4.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9fe1f88b15678966f419d36ba49b795f12c01c8abfcc492508c947611df37340
+size 10604187744

phi-4.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:65852c320b2b66271ac291b9233f7704ff3b0fb4b9b68e8f51b2fa0c7afea1eb
+size 10151579744

phi-4.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:88b29ce7151a0dc5de7e5c627837051fc1738824db5a27d661b9c5e90d5e2a36
+size 12030251104

phi-4.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc570c83e8529f8880cfb600bb6ffc9d24996d32c0c808b8ccc92daf08ebb909
+size 15580500064

phi-4.fp16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eefbdf36370dcac18aa8d15bace19e30be3a6e221e5448b57f7fa27ea197f2eb
+size 29323399264