yuhuili
/

EAGLE-LLaMA3-Instruct-8B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Create README.md

#4

by lmzheng - opened Dec 31, 2024

base: refs/heads/main

←

from: refs/pr/4

Discussion Files changed

Files changed (1) hide show

README.md +2 -0

README.md ADDED Viewed

	@@ -0,0 +1,2 @@


1	+ This model is copied from https://huggingface.co/yuhuili/EAGLE-LLaMA3-Instruct-8B with the following modifications to make it compatible with SGLang:
2	+ - Modify the architecture in config.json to LlamaForCausalLMEagle