Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

36,658

Full-text search

Active filters: bitsandbytes

unsloth/codegemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 255 • 1

somosnlp/LLM_SQL_BaseDatosEspanol_Mistral

Text Generation • Updated Apr 25, 2024 • 42 • 11

PrunaAI/Universal-NER-UniNER-7B-all-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 7 • 1

GGmorello/FLAMES

Text Generation • Updated Jun 11, 2024 • 11 • 1

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated Jan 7 • 81.2k • 197

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 51.1k • 132

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 2.07k • 46

haes95/lm3-8-bnb-4bit-v1.0

Text Generation • Updated Apr 21, 2024 • 10 • 1

DevsDoCode/LLama-3-8b-Uncensored-4bit

Text Generation • Updated Apr 25, 2024 • 31 • 21

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 620 • 42

RichardErkhov/meta-llama_-_Meta-Llama-3-8B-Instruct-4bits

Text Generation • Updated May 2, 2024 • 4 • 1

islam23/llama3-8b-RAG_News_Finance

Text Generation • Updated May 14, 2024 • 5 • 2

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29, 2024 • 294 • 26

bongodongo/phi-3-mini-4k-instruct-q4

Text Generation • Updated Apr 28, 2024 • 39 • 1

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 13.3k • 29

unsloth/Yi-1.5-6B-bnb-4bit

Text Generation • Updated May 13, 2024 • 24 • 3

Lokesh477/healthcare_llm

Text Generation • Updated May 14, 2024 • 88 • 1

bineric/NorskGPT-Llama-3-70b-adapter

Text Generation • Updated May 21, 2024 • 12 • 6

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated Feb 27 • 55.6k • 71

unsloth/mistral-7b-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 24.8k • 16

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 67.7k • 24

unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.92k • 5

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24, 2024 • 527 • 28

lllyasviel/omost-llama-3-8b-4bits

Text Generation • Updated May 29, 2024 • 14.8k • 19

weifar/FTAudit-llama3-8b-v1

Text Generation • Updated Sep 16, 2024 • 10 • 2

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1, 2024 • 322 • 30

SeacomSrl/SeaPhi3-medium

Text Generation • Updated Jul 15, 2024 • 5.28k • 4

unsloth/Qwen2-0.5B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.69k • 5

unsloth/Qwen2-1.5B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.91k • 2

unsloth/Qwen2-7B-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.35k • 4