Hugging Face's logo

lmzheng
/
grok-1

mixtral
Model card Files Community
1

You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

A version of https://huggingface.co./xai-org/grok-1 that is compatible with the latest SGLang.

The tokenizer is from https://huggingface.co./Xenova/grok-1-tokenizer

# Load real weights
python3 -m sglang.launch_server --model lmzheng/grok-1 --tp 8 --quantization fp8

# Load dummy weights
python3 -m sglang.launch_server --model lmzheng/grok-1 --tp 8 --quantization fp8 --load-format dummy

# Test accuracy on gsm-8k (sanity check), it should be around 0.85
python3 -m sglang.test.few_shot_gsm8k --num-questions 200
Downloads last month
777
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.