leo-pekelis-gradient
commited on
Commit
•
4132628
1
Parent(s):
9687487
Update README.md
Browse files
README.md
CHANGED
@@ -57,6 +57,22 @@ Exl2 is available on Bullerwins's huggingface account. Check it out here:
|
|
57 |
| # GPUs | 8 | 32 |
|
58 |
| GPU Type | NVIDIA L40S | NVIDIA L40S|
|
59 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
60 |
## The Gradient AI Team
|
61 |
|
62 |
https://gradient.ai/
|
@@ -75,6 +91,7 @@ Drop an email to [[email protected]](mailto:[email protected])
|
|
75 |
|
76 |
[3] https://github.com/jzhang38/EasyContext
|
77 |
|
|
|
78 |
|
79 |
----
|
80 |
|
|
|
57 |
| # GPUs | 8 | 32 |
|
58 |
| GPU Type | NVIDIA L40S | NVIDIA L40S|
|
59 |
|
60 |
+
**Evaluation Details:**
|
61 |
+
|
62 |
+
```
|
63 |
+
EVAL_MAX_CONTEXT_LENGTH=320200
|
64 |
+
EVAL_MIN_CONTEXT_LENGTH=100
|
65 |
+
EVAL_CONTEXT_INTERVAL=16000
|
66 |
+
EVAL_DEPTH_INTERVAL=0.2
|
67 |
+
EVAL_NUM_SAMPLES=2
|
68 |
+
EVAL_RND_NUMBER_DIGITS=8
|
69 |
+
|
70 |
+
HAYSTACK:
|
71 |
+
EVAL_GENERATOR_TOKENS=925000
|
72 |
+
```
|
73 |
+
|
74 |
+
Haystack is "haystack 3", further detailed in this [blog post](https://gradient.ai/blog/the-haystack-matters-for-niah-evals).
|
75 |
+
|
76 |
## The Gradient AI Team
|
77 |
|
78 |
https://gradient.ai/
|
|
|
91 |
|
92 |
[3] https://github.com/jzhang38/EasyContext
|
93 |
|
94 |
+
[4] Ning Ding, Yulin Chen, Bokai Xu, Yujia Qin, Zhi Zheng, Shengding Hu, Zhiyuan Liu, Maosong Sun, and Bowen Zhou. Enhancing chat language models by scaling high-quality instructional conversations. arXiv preprint arXiv:2305.14233, 2023.
|
95 |
|
96 |
----
|
97 |
|