shuttleai

/

shuttle-3-AWQ-Int4

like 2

Follow

ShuttleAI 151

this is our llm, not a image model

it looks quiet big, are there GGUF version that can be run on 4070 under ollama or lmstudio with comfyui?

There is a smaller version that’s 14B. There’s also community made ggufs https://huggingface.co./mradermacher/shuttle-3-GGUF

any that can be used with ollama?

Yeah, it should work fine with ollama