Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,619

Full-text search

Active filters: instruct

Triangle104/Mistral-Small-Instruct-2409-abliterated-Q6_K-GGUF

Text Generation • Updated Nov 24, 2024 • 2

Triangle104/Mistral-Small-Instruct-2409-abliterated-Q8_0-GGUF

Text Generation • Updated Nov 24, 2024 • 6

artificialguybr/LLAMA3.2-1B-Synthia-II-Redmond-gguf

Updated Nov 25, 2024 • 60 • 1

mav23/SOLAR-0-70b-16bit-GGUF

Text Generation • Updated Nov 25, 2024 • 18 • 1

mradermacher/Hermes-2-Pro-Mixtral-4x7B-i1-GGUF

Updated Nov 25, 2024 • 33

QuantFactory/BgGPT-Gemma-2-9B-IT-v1.0-GGUF

Text Generation • Updated Nov 25, 2024 • 129 • 1

mradermacher/RQwen-v0.1-GGUF

Updated Nov 25, 2024 • 38 • 2

mradermacher/OpenHermes-Mixtral-8x7B-GGUF

Updated Nov 26, 2024 • 21

mradermacher/OpenHermes-Mixtral-8x7B-i1-GGUF

Updated Nov 27, 2024 • 58 • 1

bartowski/Open-Insurance-LLM-Llama3-8B-GGUF

Text Generation • Updated Nov 26, 2024 • 141

QuantFactory/BgGPT-Gemma-2-2.6B-IT-v1.0-GGUF

Text Generation • Updated Nov 27, 2024 • 161 • 2

tensorblock/Meta-Llama-3.1-8B-openhermes-2.5-GGUF

Updated Nov 29, 2024 • 9

ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v1

Text Generation • Updated 26 days ago • 305 • 51

tensorblock/Llama3-OpenBioLLM-8B-GGUF

Updated Nov 29, 2024 • 14

Fluxter/OpenHermes-2.5-Mistral-7B-Q8_0-GGUF

Updated Nov 29, 2024 • 8 • 1

QuantFactory/Open-Insurance-LLM-Llama3-8B-GGUF

Text Generation • Updated Dec 2, 2024 • 237 • 2

tensorblock/BgGPT-Gemma-2-2.6B-IT-v1.0-GGUF

Text Generation • Updated Dec 3, 2024 • 18

mradermacher/SmolLM2-Math-IIO-1.7B-Instruct-GGUF

Updated Dec 4, 2024 • 17

tensorblock/Llama3-70B-ShiningValiant2-GGUF

Text Generation • Updated Dec 6, 2024 • 23

zheyushen/Llama-3_1-8B-Instruct-orca-ORPO-F32-GGUF

Updated Dec 6, 2024 • 13

tensorblock/Llama3-70B-Fireplace-GGUF

Text Generation • Updated Dec 7, 2024 • 46

zheyushen/Llama-3_1-8B-Instruct-orca-ORPO-Q8_0-GGUF

Updated Dec 7, 2024

mradermacher/Genstruct-10.7B-GGUF

Updated Dec 8, 2024 • 4

Lucy-in-the-Sky/pygmalion-2-13b-Q2_K-GGUF

Text Generation • Updated Dec 8, 2024 • 4

Lucy-in-the-Sky/pygmalion-2-13b-Q8_0-GGUF

Text Generation • Updated Dec 8, 2024 • 36

mradermacher/Genstruct-10.7B-i1-GGUF

Updated Dec 8, 2024 • 14

mradermacher/Llama3-OpenBioLLM-70B-i1-GGUF

Updated Dec 12, 2024 • 437

mlx-community/Hermes-3-Llama-3.2-3B-4bit

Text Generation • Updated Dec 11, 2024 • 283

mlx-community/Hermes-3-Llama-3.2-3B-8bit

Text Generation • Updated Dec 11, 2024 • 56

mlx-community/Hermes-3-Llama-3.2-3B-bf16

Text Generation • Updated Dec 11, 2024 • 39