Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

14,901

Full-text search

Active filters: bitsandbytes

adediu25/implicit-llama2-all

Text Generation • Updated Apr 17 • 25

samehfarouk/quantized_Mistral7B_v2_int8

Text Generation • Updated Apr 17 • 9

yyx123/Yi-6B-ruozhiba2

Updated May 6 • 53 • 1

yyx123/Yi-6B-zhihu2

Updated Apr 18 • 2

adediu25/subtle-llama2-all

Text Generation • Updated Apr 17 • 27

samehfarouk/Mistral-7B-Instruct-v0.2_int8

Text Generation • Updated Apr 17 • 11

prince-canuma/Mixtral-8x22B-Instruct-v0.1-4bit

Text Generation • Updated Apr 17 • 11

bogdanfloris/Mistral-7B-v0.1-4bit

Text Generation • Updated Apr 17 • 16

batprem/typhoon-med

Text Generation • Updated Apr 20 • 10

mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit

Text Generation • Updated Jul 1 • 57 • 11

wintercoming6/Mixtral-7B-AIPI-finetune

Text Generation • Updated Apr 17 • 14

wintercoming6/Mixtral-7B-AIPI-finetune-with-8bit-quantization

Text Generation • Updated Apr 17 • 14

thanhnew2001/bank

Text Generation • Updated Apr 18 • 13

thanhnew2001/merged

Text Generation • Updated Apr 17 • 18

perceptorLLM/idefics2-8b-4bit-fp16

Image-Text-to-Text • Updated Apr 17 • 15

perceptorLLM/idefics2-8b-4bit-bf16

Image-Text-to-Text • Updated Apr 17 • 11

prince-canuma/mixtral-8x22b-instruct-oh-4bit

Text Generation • Updated Apr 18 • 14

thanhnew2001/bank2

Text Generation • Updated Apr 18 • 14

thanhnew2001/bank3

Text Generation • Updated Apr 18 • 16

appvoid/instruct-palmer-pico

Text Generation • Updated Apr 18 • 15

thanhnew2001/bank4

Text Generation • Updated Apr 18 • 13

sosoai/hansoldeco-Mixtral-8x22B-Instruct-v1

Text Generation • Updated Apr 21 • 11

appvoid/instruct-palmer-003-beta-4

Text Generation • Updated Apr 18 • 16

gildead/mistral-aes-966

Text Generation • Updated Apr 18 • 11

gildead/mistral-aes-414

Text Generation • Updated Apr 18 • 13

thanhnew2001/bank5

Text Generation • Updated Apr 18 • 15

abdullahfurquan/merged_final

Text Generation • Updated Apr 18 • 16

areegtarek/llmcxr_mimic-4bit

Text Generation • Updated Apr 18 • 14

areegtarek/llmcxr_mimic-8bit

Text Generation • Updated Apr 18 • 13

areegtarek/llmcxr_mimic-8bit-v1

Text Generation • Updated Apr 18 • 15