leo-pekelis-gradient commited on
Commit
4132628
1 Parent(s): 9687487

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -57,6 +57,22 @@ Exl2 is available on Bullerwins's huggingface account. Check it out here:
57
  | # GPUs | 8 | 32 |
58
  | GPU Type | NVIDIA L40S | NVIDIA L40S|
59
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
60
  ## The Gradient AI Team
61
 
62
  https://gradient.ai/
@@ -75,6 +91,7 @@ Drop an email to [[email protected]](mailto:[email protected])
75
 
76
  [3] https://github.com/jzhang38/EasyContext
77
 
 
78
 
79
  ----
80
 
 
57
  | # GPUs | 8 | 32 |
58
  | GPU Type | NVIDIA L40S | NVIDIA L40S|
59
 
60
+ **Evaluation Details:**
61
+
62
+ ```
63
+ EVAL_MAX_CONTEXT_LENGTH=320200
64
+ EVAL_MIN_CONTEXT_LENGTH=100
65
+ EVAL_CONTEXT_INTERVAL=16000
66
+ EVAL_DEPTH_INTERVAL=0.2
67
+ EVAL_NUM_SAMPLES=2
68
+ EVAL_RND_NUMBER_DIGITS=8
69
+
70
+ HAYSTACK:
71
+ EVAL_GENERATOR_TOKENS=925000
72
+ ```
73
+
74
+ Haystack is "haystack 3", further detailed in this [blog post](https://gradient.ai/blog/the-haystack-matters-for-niah-evals).
75
+
76
  ## The Gradient AI Team
77
 
78
  https://gradient.ai/
 
91
 
92
  [3] https://github.com/jzhang38/EasyContext
93
 
94
+ [4] Ning Ding, Yulin Chen, Bokai Xu, Yujia Qin, Zhi Zheng, Shengding Hu, Zhiyuan Liu, Maosong Sun, and Bowen Zhou. Enhancing chat language models by scaling high-quality instructional conversations. arXiv preprint arXiv:2305.14233, 2023.
95
 
96
  ----
97