Update README.md
Browse files
README.md
CHANGED
|
@@ -27,6 +27,8 @@ Finetuning was done using [MedNER](https://github.com/UPOD-datascience/MedNER.nl
|
|
| 27 |
We limited the training to the following languages: English, Dutch, French, German, Spanish, Italian, Danish, Swedish and Portuguese,
|
| 28 |
which are relatively close, in a linguistic sense, allowing for a languages to benefit from cross-over information.
|
| 29 |
|
|
|
|
|
|
|
| 30 |
```bash
|
| 31 |
#!/usr/bin/env bash
|
| 32 |
set -euo pipefail
|
|
|
|
| 27 |
We limited the training to the following languages: English, Dutch, French, German, Spanish, Italian, Danish, Swedish and Portuguese,
|
| 28 |
which are relatively close, in a linguistic sense, allowing for a languages to benefit from cross-over information.
|
| 29 |
|
| 30 |
+
The model was train in a multiclass-sense, using a cross-entropy loss. We replaced the standard 768-weight linear layer
|
| 31 |
+
by 3x768 dense layers with 10\% dropout and ReLu activations.
|
| 32 |
```bash
|
| 33 |
#!/usr/bin/env bash
|
| 34 |
set -euo pipefail
|