yuhuili
/

EAGLE-LLaMA3-Instruct-8B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

EAGLE-LLaMA3-Instruct-8B / README.md

lmzheng's picture

Create README.md

7686947 verified about 1 month ago

|

215 Bytes

This model is copied from https://huggingface.co./yuhuili/EAGLE-LLaMA3-Instruct-8B with the following modifications to make it compatible with SGLang:

Modify the architecture in config.json to LlamaForCausalLMEagle