Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

99,322

Full-text search

Active filters: conversational

mlx-community/Qwen2-VL-7B-4bit

Image-Text-to-Text • Updated Sep 28 • 60 • 2

mlx-community/Qwen2-VL-7B-bf16

Image-Text-to-Text • Updated Sep 28 • 38 • 1

mradermacher/Llama-3.2-3B-Instruct-uncensored-i1-GGUF

Updated Sep 28 • 2.28k • 6

darkc0de/Llama-3.2-3B-Instruct-abliterated-Q8_0-GGUF

Updated Sep 28 • 85 • 4

mlx-community/Qwen2-VL-2B-4bit

Image-Text-to-Text • Updated Sep 28 • 80 • 4

mlx-community/Llama-3.1-8B-Instruct

Text Generation • Updated Sep 28 • 72 • 3

bunnycore/Llama-3.2-3B-Mix

Text Generation • Updated Sep 28 • 113 • 1

Lewdiculous/Violet_Twilight-v0.2-GGUF-IQ-Imatrix

Updated Nov 13 • 1.43k • 12

nbeerbower/Llama3.1-Allades-8B

Text Generation • Updated Oct 12 • 62 • 2

Cheatmeal/Lt-Llama-2-7b-instruct-hf-Q4_K_M-GGUF

Updated Sep 28 • 9 • 1

RichardErkhov/leafspark_-_Pixtral-12B-2409-hf-text-only-gguf

Updated Sep 28 • 1.96k • 2

lemon07r/Gemma-2-Ataraxy-v2-9B

Text Generation • Updated Sep 30 • 113 • 13

grapevine-AI/EZO-Qwen2.5-72B-Instruct-GGUF

Updated Sep 29 • 101 • 5

mradermacher/T.E-8.1-i1-GGUF

Updated Sep 29 • 79 • 2

SEOKDONG/llama3.1_korean_v1.1_sft_by_aidx

Text Generation • Updated Nov 7 • 54 • 1

Nohobby/Karasik-22B-v0.2

Text Generation • Updated Sep 30 • 23 • 5

lamm-mit/Cephalo-Llama-3.2-11B-Vision-Instruct-128k

Image-Text-to-Text • Updated Sep 30 • 69 • 7

bartowski/Replete-LLM-V2.5-Qwen-72b-GGUF

Text Generation • Updated Oct 7 • 1.07k • 8

bartowski/Replete-LLM-V2.5-Qwen-32b-GGUF

Text Generation • Updated Oct 25 • 4.33k • 22

bartowski/Replete-LLM-V2.5-Qwen-7b-GGUF

Text Generation • Updated Oct 7 • 664 • 11

vasaicrow/Llama-3.2-1B-Instruct-Finance-RAG

Text Generation • Updated Sep 29 • 134 • 1

mlx-community/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2

Text Generation • Updated 17 days ago • 45 • 2

huihui-ai/Qwen2.5-32B-Instruct-abliterated

Text Generation • Updated 29 days ago • 3.18k • 11

cydxg/Qwen2-VL-2B-Instruct-OpenVINO-INT4

Image-Text-to-Text • Updated Oct 28 • 29 • 2

Lewdiculous/T.E-8.1-GGUF-IQ-Imatrix-Request

Updated Sep 29 • 108 • 4

QuantFactory/Llama-3.2-3B-Instruct-uncensored-GGUF

Updated Sep 29 • 1.31k • 5

bartowski/CalmeRys-78B-Orpo-v0.1-GGUF

Text Generation • Updated Sep 30 • 1.55k • 4

qilowoq/Vikhr-Nemo-12B-Instruct-R-21-09-24-4Bit-GPTQ

Text Generation • Updated Sep 29 • 1.72k • 3

bartowski/Llama-3.1-8B-Stheno-v3.4-GGUF

Text Generation • Updated Sep 30 • 741 • 4

nbeerbower/Lyra4-Gutenberg2-12B

Text Generation • Updated Oct 3 • 134 • 9