Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Misc with no match

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

78

Full-text search

Active filters: 7-bit

Dracones/Merged-RP-Stew-V2-34B_exl2_7.0bpw

Text Generation • Updated Apr 11 • 12

Dracones/c4ai-command-r-v01_exl2_7.0bpw

Text Generation • Updated Apr 12 • 10

Dracones/c4ai-command-r-v01_exl2_7.0bpw-rpcal

Text Generation • Updated Apr 12 • 13

Dracones/miqu-1-70b-sf_exl2_7.0bpw

Text Generation • Updated Apr 11 • 12

Dracones/c4ai-command-r-plus_exl2_7.0bpw

Text Generation • Updated Apr 13 • 8

Dracones/mixtral-8x22b-instruct-oh_exl2_7.0bpw

Text Generation • Updated Apr 14 • 8

bdambrosio/dbrx-instruct-7.0bpw-h8-exl2

Text Generation • Updated Apr 15 • 6

Dracones/WizardLM-2-8x22B_exl2_7.0bpw

Text Generation • Updated Apr 16 • 9

Dracones/CodeQwen1.5-7B-Chat_exl2_7.0bpw

Text Generation • Updated Apr 16 • 10

Dracones/CodeQwen1.5-7B_exl2_7.0bpw

Text Generation • Updated Apr 16 • 10

Dracones/Llama-3-Lumimaid-70B-v0.1_exl2_7.0bpw

Text Generation • Updated May 4 • 10

FuturisticVibes/Coomand-R-35B-v1-7.0bpw-h8-exl2

Text Generation • Updated May 12 • 7

FuturisticVibes/L3-Arcania-4x8b-7.0bpw-h8-exl2

Text Generation • Updated May 14 • 6

SicariusSicariiStuff/CalderaAI_Foredoomed-9B_EXL-7.0

Text Generation • Updated May 18 • 14 • 1

BigHuggyD/jukofyork_miquplus-midnight-70b_exl2_7.0bpw

Text Generation • Updated Jun 6 • 10

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_7.0bpw_h8

Text Generation • Updated Jun 19 • 13

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_7.0bpw

Text Generation • Updated Jun 23 • 9

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_7.0bpw

Text Generation • Updated Jun 23 • 11

BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_7.0bpw_h8

Text Generation • Updated Jun 25 • 8

BigHuggyD/alpindale_magnum-72b-v1_exl2_7.0bpw_h8

Text Generation • Updated Jun 26 • 6

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_7.0bpw_h8

Text Generation • Updated Jun 28 • 5

bigstorm/Hermes-2-Theta-Llama-3-70B-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 5

bigstorm/Qwen2-72B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 15

bigstorm/firefunction-v2-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 11

bigstorm/Llama-3-Groq-70B-Tool-Use-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 8

DrNicefellow/Mistral-Nemo-Instruct-2407-exl2-7bpw-h8

Text Generation • Updated Jul 18 • 7

bigstorm/Meta-Llama-3.1-70B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 24 • 8

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_7.0bpw_h8

Text Generation • Updated Aug 14 • 12

BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_7.0bpw_h8

Text Generation • Updated Jul 30 • 4

SicariusSicariiStuff/2B_or_not_2B-EXL2-7.0bpw

Updated Aug 11 • 2