Testing model.

Config:

base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
gate_mode: hidden
dtype: bfloat16
experts:
  - source_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
    positive_prompts: [""]
  - source_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
    positive_prompts: [""]

Downloads last month: 2,042

Safetensors

Model size

1.86B params

Tensor type

BF16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.

Model tree for AIChenKai/TinyLlama-1.1B-Chat-v1.0-x2-MoE

Merges

1 model

Quantizations

1 model