Model save

README.md

@@ -20,10 +20,10 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [jhu-clsp/mmBERT-small](https://huggingface.co/jhu-clsp/mmBERT-small) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: nan
-- F1: 0.0
-- Precision: 0.0
-- Recall: 0.0
+- Loss: 0.4605
+- F1: 81.8318
+- Precision: 81.8361
+- Recall: 81.8321
 
 ## Model description
 
@@ -43,14 +43,14 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 5e-05
-- train_batch_size: 64
-- eval_batch_size: 64
+- train_batch_size: 512
+- eval_batch_size: 512
 - seed: 0
 - distributed_type: multi-GPU
 - num_devices: 2
-- gradient_accumulation_steps: 8
-- total_train_batch_size: 1024
-- total_eval_batch_size: 128
+- gradient_accumulation_steps: 2
+- total_train_batch_size: 2048
+- total_eval_batch_size: 1024
 - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_ratio: 0.01
@@ -58,13 +58,13 @@ The following hyperparameters were used during training:
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | F1  | Precision | Recall |
-|:-------------:|:-----:|:----:|:---------------:|:---:|:---------:|:------:|
-| 3407638.4     | 1.0   | 10   | nan             | 0.0 | 0.0       | 0.0    |
-| 0.0           | 2.0   | 20   | nan             | 0.0 | 0.0       | 0.0    |
-| 0.0           | 3.0   | 30   | nan             | 0.0 | 0.0       | 0.0    |
-| 0.0           | 4.0   | 40   | nan             | 0.0 | 0.0       | 0.0    |
-| 0.0           | 5.0   | 50   | nan             | 0.0 | 0.0       | 0.0    |
+| Training Loss | Epoch | Step | Validation Loss | F1      | Precision | Recall  |
+|:-------------:|:-----:|:----:|:---------------:|:-------:|:---------:|:-------:|
+| 1.8064        | 1.0   | 1537 | 0.4447          | 80.9603 | 80.9710   | 81.0960 |
+| 1.6408        | 2.0   | 3074 | 0.4309          | 81.7277 | 81.8109   | 81.6765 |
+| 1.4703        | 3.0   | 4611 | 0.4252          | 82.1472 | 82.1151   | 82.1871 |
+| 1.3121        | 4.0   | 6148 | 0.4393          | 82.0532 | 82.0873   | 82.0275 |
+| 1.1733        | 5.0   | 7685 | 0.4605          | 81.8318 | 81.8361   | 81.8321 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e362ec095b69e519f61bcdfe1f9db7392b6a0d31141e289685625c34423710dd
+oid sha256:97da6e07086e607edd10c3221c41f1dd983682ce4aeea5c70c4c849558e150b5
 size 281299686