blueapple8259
commited on
Commit
โข
1e9afa7
1
Parent(s):
d632ac1
Update README.md
Browse files
README.md
CHANGED
@@ -9,3 +9,15 @@ language:
|
|
9 |
[TinyKo-v5-b](https://huggingface.co/blueapple8259/TinyKo-v5-b)๋ชจ๋ธ์ [kullm-v2](https://huggingface.co/datasets/nlpai-lab/kullm-v2)๋ฐ์ดํฐ์
์ผ๋ก ํ์ธํ๋ํ ๋ชจ๋ธ์
๋๋ค.
|
10 |
|
11 |
์ฃผ์: ์ฑ๋ฅ์ด ๋งค์ฐ ๋จ์ด์ง๋ฉฐ ํ ๋ฃจ์๋ค์ด์
์ด ๋งค์ฐ ์ฌํฉ๋๋ค.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
9 |
[TinyKo-v5-b](https://huggingface.co/blueapple8259/TinyKo-v5-b)๋ชจ๋ธ์ [kullm-v2](https://huggingface.co/datasets/nlpai-lab/kullm-v2)๋ฐ์ดํฐ์
์ผ๋ก ํ์ธํ๋ํ ๋ชจ๋ธ์
๋๋ค.
|
10 |
|
11 |
์ฃผ์: ์ฑ๋ฅ์ด ๋งค์ฐ ๋จ์ด์ง๋ฉฐ ํ ๋ฃจ์๋ค์ด์
์ด ๋งค์ฐ ์ฌํฉ๋๋ค.
|
12 |
+
|
13 |
+
## ๋ชจ๋ธ ์ ๋ณด
|
14 |
+
|
15 |
+
model type: llama
|
16 |
+
|
17 |
+
hidden size: 6
|
18 |
+
|
19 |
+
hidden size: 127
|
20 |
+
|
21 |
+
num attention heads: 16
|
22 |
+
|
23 |
+
num key value heads: 4
|