Falcon3-1B-Instruct-GGUF

Original Model

tiiuae/Falcon3-1B-Instruct

Run with Gaianet

Prompt template:

prompt template: falcon3

Context size:

chat_ctx_size: 8000

Run with GaiaNet:

Quantized with llama.cpp b4381

Downloads last month
287
GGUF
Model size
1.67B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for gaianet/Falcon3-1B-Instruct-GGUF

Quantized
(25)
this model