Hugging Face's logo

travis-simon
/
ModernBERT-regulation-classifier

Text Classification
Transformers
TensorBoard
Safetensors
modernbert
Generated from Trainer
text-embeddings-inference
Model card Files
xet
 Metrics Community
travis-simon commited on
Commit
bb98b54
·
verified ·
1 Parent(s): d510ea9

End of training

Browse files
Files changed (5) hide show
  1. README.md +12 -12
  2. model.safetensors +1 -1
  3. runs/Feb26_07-38-05_1439f1df9b0c/events.out.tfevents.1740555493.1439f1df9b0c.447.0 +3 -0
  4. tokenizer.json +16 -2
  5. training_args.bin +1 -1
README.md CHANGED
@@ -18,8 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.6666
22
- - F1: 0.8588
23
 
24
  ## Model description
25
 
@@ -50,16 +50,16 @@ The following hyperparameters were used during training:
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | F1 |
52
  |:-------------:|:-----:|:----:|:---------------:|:------:|
53
- | No log | 1.0 | 11 | 0.3492 | 0.8764 |
54
- | No log | 2.0 | 22 | 0.4819 | 0.8406 |
55
- | No log | 3.0 | 33 | 0.7660 | 0.8213 |
56
- | No log | 4.0 | 44 | 0.6211 | 0.8764 |
57
- | No log | 5.0 | 55 | 0.5195 | 0.8764 |
58
- | No log | 6.0 | 66 | 0.5720 | 0.8764 |
59
- | No log | 7.0 | 77 | 0.6331 | 0.8588 |
60
- | No log | 8.0 | 88 | 0.6564 | 0.8588 |
61
- | No log | 9.0 | 99 | 0.6627 | 0.8588 |
62
- | 0.0619 | 10.0 | 110 | 0.6666 | 0.8588 |
63
 
64
 
65
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.3537
22
+ - F1: 0.9000
23
 
24
  ## Model description
25
 
 
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | F1 |
52
  |:-------------:|:-----:|:----:|:---------------:|:------:|
53
+ | No log | 1.0 | 15 | 0.5482 | 0.7467 |
54
+ | No log | 2.0 | 30 | 0.4953 | 0.7600 |
55
+ | No log | 3.0 | 45 | 0.7658 | 0.7068 |
56
+ | No log | 4.0 | 60 | 0.2946 | 0.8628 |
57
+ | No log | 5.0 | 75 | 0.3272 | 0.8878 |
58
+ | No log | 6.0 | 90 | 0.6832 | 0.8348 |
59
+ | 0.2242 | 7.0 | 105 | 0.4030 | 0.8740 |
60
+ | 0.2242 | 8.0 | 120 | 0.3450 | 0.8997 |
61
+ | 0.2242 | 9.0 | 135 | 0.3476 | 0.9126 |
62
+ | 0.2242 | 10.0 | 150 | 0.3537 | 0.9000 |
63
 
64
 
65
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1936ea65960a9052bac60f72dc515c27885339ea2b17436ed3fdb33797e5a5c0
3
  size 598439784
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e7048e1483b0fc90269afb947fcb1bc86c85c238a64a9a7357df6d900b77627
3
  size 598439784
runs/Feb26_07-38-05_1439f1df9b0c/events.out.tfevents.1740555493.1439f1df9b0c.447.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76899815ed9cb634056bc3b3aa904f0058a23c9cee078520f4c2271e60c126aa
3
+ size 9531
tokenizer.json CHANGED
@@ -1,7 +1,21 @@
1
  {
2
  "version": "1.0",
3
- "truncation": null,
4
- "padding": null,
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  "added_tokens": [
6
  {
7
  "id": 0,
 
1
  {
2
  "version": "1.0",
3
+ "truncation": {
4
+ "direction": "Right",
5
+ "max_length": 1024,
6
+ "strategy": "LongestFirst",
7
+ "stride": 0
8
+ },
9
+ "padding": {
10
+ "strategy": {
11
+ "Fixed": 1024
12
+ },
13
+ "direction": "Right",
14
+ "pad_to_multiple_of": null,
15
+ "pad_id": 50283,
16
+ "pad_type_id": 0,
17
+ "pad_token": "[PAD]"
18
+ },
19
  "added_tokens": [
20
  {
21
  "id": 0,
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dbc7259635abcf0bba59c96b37108fd43eee90b730fb67ef72817062e7ead65f
3
  size 5432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:644b890d805bb15322d99222e55de6b1bf2ff6e72809a2db256fa0600ad02511
3
  size 5432