---

T5, Clip, and ae are still not provided in the original model

FLUX.1-Fill-dev-GGUF

Original Model

black-forest-labs/FLUX.1-Fill-dev

Run with LlamaEdge-StableDiffusion

• Version: coming soon

Quantized GGUF Models

Name	Quant method	Bits	Size	Use case
ae.safetensors	f32	32	335 MB
flux1-fill-dev-Q2_K.gguf	Q2_K	2	4.16 GB
flux1-fill-dev-Q3_K.gguf	Q2_K	2	5.36 GB
flux1-fill-dev-Q4_0.gguf	Q4_0	4	6.93 GB
flux1-fill-dev-Q4_1.gguf	Q4_1	4	7.67 GB
flux1-fill-dev-Q4_K.gguf	Q4_K	4	6.93 GB
flux1-fill-dev-Q5_0.gguf	Q5_0	5	8.41 GB
flux1-fill-dev-Q5_1.gguf	Q5_1	5	9.15 GB
flux1-fill-dev-Q8_0.gguf	Q8_0	8	12.8 GB
flux1-fill-dev.safetensors	f16	16	23.8 GB

Quantized with stable-diffusion.cpp master-c3eeb669.