Under 10B GGUFs Non-linear Quantized to try on 4GiB VRAM. Leaderboard https://huggingface.co./spaces/open-llm-leaderboard/open_llm_leaderboard
Henry Kroll III
hellork
·
AI & ML interests
Small, open-source LLMs for mobile with < 4Gb graphics, text generation, image manipulation recognition, 3D model generation, language preservation and translation, and business use cases.
Organizations
Collections
1
models
29
hellork/finance-chat-IQ4_NL-GGUF
Text Generation
•
Updated
•
12
hellork/medicine-chat-IQ4_NL-GGUF
Text Generation
•
Updated
•
17
hellork/law-chat-IQ4_NL-GGUF
Text Generation
•
Updated
•
31
hellork/calme-2.1-qwen2-7b-Q4_K_M-GGUF
Text Generation
•
Updated
•
5
hellork/RYS-gemma-2-2b-it-Q4_K_M-GGUF
Updated
•
9
hellork/internlm2_5-7b-chat-Q4_K_M-GGUF
Text Generation
•
Updated
•
19
hellork/Qwen2-7B-Instruct-IQ4_NL-GGUF
Text Generation
•
Updated
•
6
hellork/internlm2-chat-7b-sft-IQ4_NL-GGUF
Text Generation
•
Updated
•
3
hellork/Chocolatine-3B-Instruct-DPO-Revised-IQ4_NL-GGUF
Text Generation
•
Updated
•
5
hellork/Phi-3-mini-4k-instruct-IQ4_NL-GGUF
Text Generation
•
Updated
•
18
datasets
None public yet