Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,136

Full-text search

Active filters: chat

internlm/internlm2_5-1_8b-chat-gguf

Text Generation • Updated Jul 29 • 244 • 9

lordjia/Llama-3.1-Cantonese-8B-Instruct

Text Generation • Updated Aug 3 • 516 • 5

anthracite-org/magnum-v2-12b

Text Generation • Updated Sep 14 • 887 • 81

NousResearch/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 23 • 363k • 109

NousResearch/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 23 • 1.18k • 36

anthracite-org/magnum-v2-12b-gguf

Text Generation • Updated Aug 22 • 11.6k • 33

NousResearch/Hermes-3-Llama-3.1-70B-FP8

Updated Sep 8 • 1.03k • 12

bartowski/magnum-12b-v2-GGUF

Text Generation • Updated Aug 6 • 1.98k • 12

MaziyarPanahi/calme-2.4-rys-78b

Text Generation • Updated Sep 11 • 138 • 44

mradermacher/calme-2.3-legalkit-8b-GGUF

Updated Sep 8 • 97 • 1

mradermacher/calme-2.3-legalkit-8b-i1-GGUF

Updated Sep 8 • 110 • 1

Qwen/Qwen2-Math-72B-Instruct

Text Generation • Updated Sep 13 • 604 • 87

Qwen/Qwen2-Math-7B-Instruct

Text Generation • Updated Aug 12 • 874 • 40

Qwen/Qwen2-Math-72B

Text Generation • Updated Aug 8 • 101 • 28

anthracite-org/magnum-v2.5-12b-kto

Text Generation • Updated Aug 22 • 5.07k • 44

mradermacher/calme-2.4-rys-78b-GGUF

Updated Sep 16 • 51 • 6

NousResearch/Hermes-3-Llama-3.1-405B-FP8

Updated Sep 9 • 2.52k • 27

NousResearch/Hermes-3-Llama-3.1-405B

Text Generation • Updated Oct 8 • 4.53k • 183

QuantFactory/calme-2.3-legalkit-8b-GGUF

Text Generation • Updated Aug 13 • 162 • 3

abacusai/Dracarys-72B-Instruct

Text Generation • Updated Sep 27 • 2.69k • 20

anthracite-org/magnum-v2.5-12b-kto-gguf

Text Generation • Updated Aug 22 • 2.26k • 41

hellork/calme-2.1-qwen2-7b-Q4_K_M-GGUF

Text Generation • Updated Sep 17 • 1

bartowski/Hermes-3-Llama-3.1-70B-GGUF

Text Generation • Updated Aug 20 • 1.83k • 8

QuantFactory/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 25 • 322 • 2

mlx-community/Hermes-3-Llama-3.1-70B-4bit

Updated Aug 16 • 27 • 2

mlx-community/Hermes-3-Llama-3.1-70B-8bit

Updated Aug 16 • 18 • 2

anthracite-org/magnum-v2-123b

Text Generation • Updated Sep 12 • 374 • 57

bartowski/Hermes-3-Llama-3.1-405B-GGUF

Text Generation • Updated Sep 27 • 1.69k • 11

ghost-x/ghost-8b-beta-1608

Text Generation • Updated Aug 23 • 7.72k • 29

ghost-x/ghost-8b-beta-1608-gguf

Text Generation • Updated Aug 26 • 272 • 6