cleanup
Browse files- .gitignore +1 -0
- .idea/.gitignore +0 -10
- readme.md → README.md +5 -2
.gitignore
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
.idea
|
.idea/.gitignore
DELETED
@@ -1,10 +0,0 @@
|
|
1 |
-
# Default ignored files
|
2 |
-
/shelf/
|
3 |
-
/workspace.xml
|
4 |
-
# Editor-based HTTP Client requests
|
5 |
-
/httpRequests/
|
6 |
-
# Datasource local storage ignored files
|
7 |
-
/dataSources/
|
8 |
-
/dataSources.local.xml
|
9 |
-
|
10 |
-
.idea
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
readme.md → README.md
RENAMED
@@ -1,6 +1,7 @@
|
|
1 |
# Material SciBERT (TPU)
|
2 |
|
3 |
Goal: Improving language understanding in materials science
|
|
|
4 |
**Work in progress**
|
5 |
|
6 |
## Related work
|
@@ -18,7 +19,6 @@ Goal: Improving language understanding in materials science
|
|
18 |
- MatBERT (CEDER): BERT, from scratch, 2M documents on materials science (~60M paragraphs) https://github.com/lbnlp/MatBERT
|
19 |
- BatteryBERT (Cole): BERT, mixed from scratch and with predefined weights https://github.com/ShuHuang/batterybert/
|
20 |
|
21 |
-
|
22 |
### Results
|
23 |
|
24 |
Results obtained via 10-fold cross-validation, using DeLFT (https://github.com/kermitt2/delft)
|
@@ -43,9 +43,12 @@ Results obtained via 10-fold cross-validation, using DeLFT (https://github.com/k
|
|
43 |
| MatBERT (Ceder) | 85.08% | 89.93% | 87.44% |
|
44 |
| BatteryScibert-cased | 85.02% | 89.30% | 87.11% |
|
45 |
| BatteryScibert-cased | 81.09% | 84.14% | 82.59% |
|
46 |
-
|
47 |
|
48 |
## References
|
49 |
|
50 |
This work was supported by Google, through the researchers program https://cloud.google.com/edu/researchers
|
51 |
|
|
|
|
|
|
|
|
1 |
# Material SciBERT (TPU)
|
2 |
|
3 |
Goal: Improving language understanding in materials science
|
4 |
+
|
5 |
**Work in progress**
|
6 |
|
7 |
## Related work
|
|
|
19 |
- MatBERT (CEDER): BERT, from scratch, 2M documents on materials science (~60M paragraphs) https://github.com/lbnlp/MatBERT
|
20 |
- BatteryBERT (Cole): BERT, mixed from scratch and with predefined weights https://github.com/ShuHuang/batterybert/
|
21 |
|
|
|
22 |
### Results
|
23 |
|
24 |
Results obtained via 10-fold cross-validation, using DeLFT (https://github.com/kermitt2/delft)
|
|
|
43 |
| MatBERT (Ceder) | 85.08% | 89.93% | 87.44% |
|
44 |
| BatteryScibert-cased | 85.02% | 89.30% | 87.11% |
|
45 |
| BatteryScibert-cased | 81.09% | 84.14% | 82.59% |
|
46 |
+
|
47 |
|
48 |
## References
|
49 |
|
50 |
This work was supported by Google, through the researchers program https://cloud.google.com/edu/researchers
|
51 |
|
52 |
+
## Acknowledgements
|
53 |
+
|
54 |
+
TBA
|