HuggingFaceGECLM
/

mix_tok_v1

Model card Files Files and versions Community

teven commited on Apr 13, 2023

Commit

f9084d8

•

1 Parent(s): f45ec5f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -3,7 +3,7 @@ language:
 - en
 ---
-V1 of an English/code tokenizer. Equal mix between:
 On the NL side:
 - Books
 - C4

 - en
 ---
+V1 of an English/code tokenizer. Byte-level BPE, 64k vocab. Equal mix between:
 On the NL side:
 - Books
 - C4