Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,406

Full-text search

Active filters: chat

lordjia/Qwen2-Cantonese-7B-Instruct

Text Generation • Updated Aug 13, 2024 • 128 • 3

lordjia/Llama-3-Cantonese-8B-Instruct

Text Generation • Updated Aug 13, 2024 • 273 • 5

catbash/Mistral-7B-v0.1-flashback-v2-instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 17, 2024 • 15 • 2

turboderp/turbcat-instruct-72b

Text Generation • Updated Jul 19, 2024 • 30 • 26

shareAI/llama3.1-8b-instruct-dpo-zh

Question Answering • Updated Jul 27, 2024 • 83 • 18

NousResearch/Hermes-3-Llama-3.1-70B

Text Generation • Updated Sep 8, 2024 • 4.93k • 102

lordjia/Llama-3.1-Cantonese-8B-Instruct

Text Generation • Updated Aug 3, 2024 • 98 • 5

anthracite-org/magnum-v2-12b

Text Generation • Updated Sep 14, 2024 • 845 • 82

NousResearch/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 23, 2024 • 379k • 113

NousResearch/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 23, 2024 • 1.04k • 37

anthracite-org/magnum-v2-12b-gguf

Text Generation • Updated Aug 22, 2024 • 2.85k • 33

NousResearch/Hermes-3-Llama-3.1-70B-FP8

Updated Sep 8, 2024 • 3.87k • 13

MaziyarPanahi/calme-2.4-rys-78b

Text Generation • Updated Sep 11, 2024 • 159 • 46

Qwen/Qwen2-Math-7B-Instruct

Text Generation • Updated Aug 12, 2024 • 524 • 41

anthracite-org/magnum-v2.5-12b-kto

Text Generation • Updated Aug 22, 2024 • 4.98k • 45

mPLUG/mPLUG-Owl3-7B-240728

Image-Text-to-Text • Updated Sep 29, 2024 • 226 • 35

NousResearch/Hermes-3-Llama-3.1-405B-FP8

Updated Sep 9, 2024 • 848 • 28

abacusai/Dracarys-72B-Instruct

Text Generation • Updated Sep 27, 2024 • 2.46k • 20

anthracite-org/magnum-v2.5-12b-kto-gguf

Text Generation • Updated Aug 22, 2024 • 4.07k • 41

Rybens/Hermes-3-Llama-3.1-8B-Q3_K_S-GGUF

Updated Aug 15, 2024 • 3 • 1

YorkieOH10/Hermes-3-Llama-3.1-8B-Q8_0-GGUF

Updated Aug 15, 2024 • 1 • 1

bartowski/Hermes-3-Llama-3.1-8B-GGUF

Text Generation • Updated Aug 16, 2024 • 738 • 7

LoneStriker/Hermes-3-Llama-3.1-8B-3.0bpw-h6-exl2

Updated Aug 15, 2024 • 5 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-4.0bpw-h6-exl2

Updated Aug 15, 2024 • 7 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-5.0bpw-h6-exl2

Updated Aug 15, 2024 • 5 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-6.0bpw-h6-exl2

Updated Aug 15, 2024 • 8 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-GGUF

Updated Aug 15, 2024 • 32 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-8.0bpw-h8-exl2

Updated Aug 15, 2024 • 8 • 1

bartowski/Hermes-3-Llama-3.1-70B-GGUF

Text Generation • Updated Aug 20, 2024 • 641 • 9

bartowski/Hermes-3-Llama-3.1-8B-exl2

Text Generation • Updated Aug 15, 2024 • 7 • 1