This model is copied from https://huggingface.co./yuhuili/EAGLE-LLaMA3-Instruct-8B with the following modifications to make it compatible with SGLang: | |
- Modify the architecture in config.json to LlamaForCausalLMEagle |
This model is copied from https://huggingface.co./yuhuili/EAGLE-LLaMA3-Instruct-8B with the following modifications to make it compatible with SGLang: | |
- Modify the architecture in config.json to LlamaForCausalLMEagle |