Dark Forests
Collection
Models for mature, intriguing storytelling and RP/ERP.
•
9 items
•
Updated
•
1
DarkForest 20B v2.0
Model Details
- To create this model two step procedure was used. First a new 20B model was created using microsoft/Orca-2-13b and KoboldAI/LLaMA2-13B-Erebus-v3 , deatils of the merge in darkforest_v2_step1.yml
- then jebcarter/psyonic-cetacean-20B
- and TeeZee/BigMaid-20B-v1.0 was used to produce the final model, merge config in darkforest_v2_step2.yml
- The resulting model has approximately 20 billion parameters.
Warning: This model can produce NSFW content!
Results
- main difference to v1.0 - model has much better sense of humor.
- produces SFW nad NSFW content without issues, switches context seamlessly.
- good at following instructions.
- good at tracking multiple characters in one scene.
- very creative, scenarios produced are mature and complicated, model doesn't shy from writing about PTSD, mental issues or complicated relationships.
- NSFW output is more creative and suprising than typical limaRP output.
- definitely for mature audiences, not only because of vivid NSFW content but also because of overall maturity of stories it produces.
- This is NOT Harry Potter level storytelling.
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel:
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 61.19 |
| AI2 Reasoning Challenge (25-Shot) | 63.74 |
| HellaSwag (10-Shot) | 86.32 |
| MMLU (5-Shot) | 59.79 |
| TruthfulQA (0-shot) | 56.14 |
| Winogrande (5-shot) | 77.90 |
| GSM8k (5-shot) | 23.28 |
- Downloads last month
- 234
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for TeeZee/DarkForest-20B-v2.0
Collection including TeeZee/DarkForest-20B-v2.0
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard63.740
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard86.320
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard59.790
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard56.140
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard77.900
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard23.280