Qwen2.5-7B-embed-base

This is a base model derived from Qwen2.5-7B with the language modeling head removed. It's intended to be used as a base for embedding tasks and further fine-tuning.

Model Details

• Base model: Qwen2.5-7B
• The 'lm_head' layer has been removed
• Maintains the original model's norm layers
• Suitable for embedding tasks and custom head additions