Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

19,768

Full-text search

Active filters: 4-bit

aladaf/zephyr-7b-beta_standard_v0.1_gptq

Text Generation • Updated Dec 12, 2023 • 19

TheBloke/supermario-v2-GPTQ

Text Generation • Updated Dec 12, 2023 • 22 • 1

TheBloke/supermario-v2-AWQ

Text Generation • Updated Dec 12, 2023 • 18 • 1

TheBloke/Pallas-0.3-GPTQ

Text Generation • Updated Dec 12, 2023 • 21 • 1

TheBloke/Pallas-0.3-AWQ

Text Generation • Updated Dec 12, 2023 • 21 • 1

TheBloke/Synthia-MoE-v3-Mixtral-8x7B-GPTQ

Text Generation • Updated Dec 12, 2023 • 19 • 10

HydraIndicLM/mistral-MoQlora-hindi-expert

Updated Dec 12, 2023 • 2 • 1

TheBloke/Terminis-7B-AWQ

Text Generation • Updated Dec 12, 2023 • 22 • 1

TheBloke/pee-AWQ

Text Generation • Updated Dec 12, 2023 • 23

TheBloke/SeraphMarcoroni-7B-AWQ

Text Generation • Updated Dec 12, 2023 • 23

TheBloke/Marcoroni-neural-chat-7B-v1-AWQ

Text Generation • Updated Dec 12, 2023 • 20 • 1

TheBloke/Pallas-0.4-GPTQ

Text Generation • Updated Dec 12, 2023 • 20 • 1

TheBloke/Pallas-0.4-AWQ

Text Generation • Updated Dec 12, 2023 • 23 • 1

TheBloke/mixtralnt-4x7b-test-GPTQ

Text Generation • Updated Dec 12, 2023 • 39 • 5

IndicRAGware/mistral-hindi-qlora-RAG-7b

Text Generation • Updated Dec 12, 2023 • 13

TheBloke/OpenZephyrChat-AWQ

Text Generation • Updated Dec 13, 2023 • 23 • 2

adamo1139/Yi-34B-200K-AEZAKMI-v2-LoRA

Text Generation • Updated May 27 • 10 • 1

openaccess-ai-collective/SlimOrca-DPO-Mixtral-8x7B

Text Generation • Updated Dec 13, 2023 • 12 • 3

TheBloke/Terminis-7B-GPTQ

Text Generation • Updated Dec 12, 2023 • 26 • 2

ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • Updated Dec 12, 2023 • 357 • 15

TheBloke/pee-GPTQ

Text Generation • Updated Dec 12, 2023 • 23

TheBloke/SeraphMarcoroni-7B-GPTQ

Text Generation • Updated Dec 12, 2023 • 20

TheBloke/Marcoroni-neural-chat-7B-v1-GPTQ

Text Generation • Updated Dec 13, 2023 • 19 • 2

TheBloke/Code-33B-GPTQ

Text Generation • Updated Dec 13, 2023 • 20 • 2

TheBloke/Code-33B-AWQ

Text Generation • Updated Dec 13, 2023 • 19 • 3

TheBloke/OpenZephyrChat-GPTQ

Text Generation • Updated Dec 13, 2023 • 31 • 1

naive-puzzle/Mixtral-8x7B-v0.1-gptq-4bit

Text Generation • Updated Dec 13, 2023 • 24

naive-puzzle/Mixtral-8x7B-v0.1-gptq-4bit-pth

Text Generation • Updated Dec 13, 2023 • 17

athirdpath/Zeta-17b_LORA

Updated Dec 13, 2023 • 10

nicher92/gpt-sw3-40b-4bit-gptq

Text Generation • Updated Dec 13, 2023 • 21