Edit Models filters

Inference status

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,076

Full-text search

Active filters: 8-bit

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated 9 days ago • 7.71k • 13

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated 3 days ago • 135 • 5

LoneStriker/Mistral-Small-Instruct-2409-8.0bpw-h8-exl2

Updated 5 days ago • 97 • 4

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • Updated 3 days ago • 201 • 3

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • Updated 3 days ago • 247 • 3

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated 3 days ago • 428 • 3

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 913 • 43

Qwen/Qwen2.5-3B-Instruct-GPTQ-Int8

Text Generation • Updated 3 days ago • 29 • 2

MaziyarPanahi/Mistral-Small-Instruct-2409-GGUF

Text Generation • Updated 5 days ago • 150 • 2

MikeRoz/TheDrummer_Cydonia-22B-v1-8.0bpw-h8-exl2

Updated 4 days ago • 18 • 2

DewEfresh/pixtral-12b-8bit

Updated 4 days ago • 403 • 2

ParasiticRogue/Instant-RP-Noodles-12B-v1.4-exl2-8.0

Text Generation • Updated 10 days ago • 37 • 2

Doctor-Shotgun/limarpv3-yi-llama-34b-lora

Text Generation • Updated Jan 8 • 9 • 10

faisalahmedsifat/bloom-3b-convo-bangla-english-instruction-existing

Text Generation • Updated Nov 15, 2023 • 8 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-bnb-8bit

Text Generation • Updated Apr 2 • 14 • 2

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 1.31k • 115

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 2.34k • 162

astronomer/Llama-3-8B-Instruct-GPTQ-8-Bit

Text Generation • Updated Apr 22 • 10.4k • 25

study-hjt/Qwen1.5-32B-Chat-GPTQ-Int8

Text Generation • Updated Apr 26 • 14 • 1

kishorea/Llama3_medqa

Text Generation • Updated Apr 29 • 2.39k • 1

Kameshr/LLAMA-3-Quantized

Text Generation • Updated May 3 • 311 • 8

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 63.5k • 58

lllyasviel/omost-phi-3-mini-128k-8bits

Text Generation • Updated May 29 • 179 • 6

Qwen/Qwen2-72B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21 • 9.73k • 14

Qwen/Qwen2-1.5B-Instruct-GPTQ-Int8

Text Generation • Updated Aug 21 • 1.24k • 3

zgce/Yi-1.5-34B-Chat-GPTQ-Int8

Text Generation • Updated Jun 11 • 196 • 1

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Jul 1 • 578 • 17

neuralmagic/Meta-Llama-3-8B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 578 • 1

neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 241 • 2

AI-MO/NuminaMath-7B-TIR-GPTQ

Text Generation • Updated Jul 9 • 252 • 4