Creative Writing Models
Collection
Trained using the "Mutiplicative-LoRA" method on the `down_proj` matrices only.
•
5 items
•
Updated
•
1
An experimental model, fine-tuned using the "multiplicative-LoRA" method on c4ai-command-r-v01.
This model is nearly identical to creative-writer-v0.1-alfa-35b except the pre-softmax logits were scaled by 1.1 during training to increased single-token Entropy, and it was trained using the new v0.2 dataset which is around 15% larger and also more carefully curated to remove any weird formatting.
Please refer to creative-writer-v0.1-alfa-35b for full details on how to use this model.
- Downloads last month
- 31
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.