YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co./docs/hub/model-cards#model-card-metadata)

DeepSeek-V3-NextN

NextN layer for DeepSeek-V3 (https://huggingface.co./deepseek-ai/DeepSeek-V3) model. Used for speculative decoding in SGLang (https://github.com/sgl-project/sglang).

Usage

python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-V3 --speculative-algo EAGLE --speculative-draft lmsys/DeepSeek-V3-NextN --speculative-num-steps 2 --speculat
ive-eagle-topk 4 --speculative-num-draft-tokens 4 --trust-remote --tp 8

Downloads last month: 436

Safetensors

Model size

11.6B params

Tensor type

F32

BF16

F8_E4M3

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.