Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

36,649

Full-text search

Active filters: bitsandbytes

unsloth/QwQ-32B-unsloth-bnb-4bit

Text Generation • Updated 27 days ago • 29.6k • 39

unsloth/gemma-3-27b-it-bnb-4bit

Image-Text-to-Text • Updated 21 days ago • 46.9k • 15

unsloth/gemma-3-4b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 21 days ago • 130k • 9

unsloth/gemma-3-27b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 21 days ago • 22.8k • 8

unsloth/Qwen2.5-Coder-32B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 1.29k • 5

onekq-ai/QwQ-32B-bnb-4bit

Text Generation • Updated 28 days ago • 439 • 2

unsloth/gemma-3-1b-it-bnb-4bit

Text Generation • Updated 21 days ago • 744k • 6

unsloth/c4ai-command-a-03-2025-unsloth-bnb-4bit

Text Generation • Updated 20 days ago • 426 • 3

infinitestack/tinyllama-sugarcane

Updated 10 days ago • 6 • 3

unsloth/Qwen2.5-VL-32B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 7 days ago • 2.98k • 6

unsloth/orpheus-3b-0.1-ft-unsloth-bnb-4bit

Text-to-Speech • Updated 9 days ago • 12.4k • 2

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 154 • 28

asas-ai/jais_13B_8bit

Text Generation • Updated Oct 25, 2023 • 206 • 9

viai957/CodeLlama_34b-SQL

Text Generation • Updated May 4, 2024 • 92 • 1

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 17k • 10

KnutJaegersberg/nllb-moe-54b-4bit

Translation • Updated Dec 16, 2023 • 22 • 5

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 29.1k • 26

unsloth/codellama-34b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 822 • 4

unsloth/llama-2-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.94k • 5

unsloth/zephyr-sft-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.13k • 5

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 7.26k • 11

herisan/Mistral-7b-bnb-4bit_mental_health_counseling_conversations

Text Generation • Updated Jan 13, 2024 • 62 • 2

rahuldshetty/tinyllama-python

Text Generation • Updated Jan 19, 2024 • 14 • 2

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 19.5k • 32

unsloth/mistral-7b-instruct-v0.1-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 701 • 4

AISimplyExplained/Vakil-7B

Text Generation • Updated Jan 23, 2024 • 1.39k • 3

alnrg2arg/blockchainlabs_7B_merged_test2_4_prune_sft_4bit_DPO_orca

Text Generation • Updated Jan 26, 2024 • 11 • 2

unsloth/llama-2-7b-chat-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 9.52k • 3

unsloth/codellama-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.72k • 7

unsloth/codellama-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 249 • 2