This model is copied from https://huggingface.co./yuhuili/EAGLE-llama2-chat-70B with the following modifications to make it compatible with SGLang:
- Modify the architecture in config.json to LlamaForCausalLMEagle
This model is copied from https://huggingface.co./yuhuili/EAGLE-llama2-chat-70B with the following modifications to make it compatible with SGLang: