-
Notifications
You must be signed in to change notification settings - Fork 0
/
_svmdl_old477.out
731 lines (716 loc) · 43.5 KB
/
_svmdl_old477.out
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
Interactive jobs timeout is 24hrs
==========================================
SLURM_JOB_ID = 477
SLURM_NODELIST = virya3
==========================================
ERROR: Unable to locate a modulefile for 'anaconda/3.2023.03'
Tue Mar 19 17:09:31 2024
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 545.23.08 Driver Version: 545.23.08 CUDA Version: 12.3 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA A100-SXM4-40GB Off | 00000000:81:00.0 Off | On |
| N/A 31C P0 49W / 400W | 15781MiB / 40960MiB | N/A Default |
| | | Enabled |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| MIG devices: |
+------------------+--------------------------------+-----------+-----------------------+
| GPU GI CI MIG | Memory-Usage | Vol| Shared |
| ID ID Dev | BAR1-Usage | SM Unc| CE ENC DEC OFA JPG |
| | | ECC| |
|==================+================================+===========+=======================|
| 0 2 0 0 | 37MiB / 19968MiB | 42 0 | 3 0 2 0 0 |
| | 0MiB / 32767MiB | | |
+------------------+--------------------------------+-----------+-----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| No running processes found |
+---------------------------------------------------------------------------------------+
Some weights of EsmForSequenceClassification were not initialized from the model checkpoint at facebook/esm1b_t33_650M_UR50S and are newly initialized: ['classifier.out_proj.bias', 'classifier.dense.weight', 'classifier.dense.bias', 'classifier.out_proj.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
wandb: Currently logged in as: hamed-ghazikhani (bioinformatics-group). Use `wandb login --relogin` to force relogin
wandb: wandb version 0.16.4 is available! To upgrade, please run:
wandb: $ pip install wandb --upgrade
wandb: Tracking run with wandb version 0.16.1
wandb: Run data is saved locally in /home/h_ghazik/toot_bert_cnn_c/wandb/run-20240319_170959-7lja2kvx
wandb: Run `wandb offline` to turn off syncing.
wandb: Syncing run visionary-silence-414
wandb: ⭐️ View project at https://wandb.ai/bioinformatics-group/huggingface
wandb: 🚀 View run at https://wandb.ai/bioinformatics-group/huggingface/runs/7lja2kvx
Task: IC-MP
Model: ESM-1b
--------------------------------------------------
0%| | 0/285 [00:00<?, ?it/s] 0%| | 1/285 [00:07<37:46, 7.98s/it] 1%| | 2/285 [00:14<34:31, 7.32s/it] 1%| | 3/285 [00:22<34:56, 7.43s/it] 1%|▏ | 4/285 [00:29<34:25, 7.35s/it] 2%|▏ | 5/285 [00:37<35:24, 7.59s/it] 2%|▏ | 6/285 [00:44<34:22, 7.39s/it] 2%|▏ | 7/285 [00:52<34:19, 7.41s/it] 3%|▎ | 8/285 [00:59<34:25, 7.46s/it] 3%|▎ | 9/285 [01:07<34:19, 7.46s/it] 4%|▎ | 10/285 [01:14<34:30, 7.53s/it] 4%|▍ | 11/285 [01:22<34:16, 7.51s/it] 4%|▍ | 12/285 [01:29<34:06, 7.49s/it] 5%|▍ | 13/285 [01:37<34:05, 7.52s/it] 5%|▍ | 14/285 [01:44<34:01, 7.53s/it] 5%|▌ | 15/285 [01:52<33:51, 7.53s/it] 6%|▌ | 16/285 [02:00<34:06, 7.61s/it] 6%|▌ | 17/285 [02:07<33:41, 7.54s/it] 6%|▋ | 18/285 [02:15<33:36, 7.55s/it] 7%|▋ | 19/285 [02:23<33:55, 7.65s/it] 7%|▋ | 20/285 [02:30<33:50, 7.66s/it] 7%|▋ | 21/285 [02:38<33:54, 7.71s/it] 8%|▊ | 22/285 [02:46<34:21, 7.84s/it] 8%|▊ | 23/285 [02:54<33:41, 7.72s/it] 8%|▊ | 24/285 [03:01<33:16, 7.65s/it] 9%|▉ | 25/285 [03:08<32:32, 7.51s/it] 9%|▉ | 26/285 [03:16<32:23, 7.51s/it] 9%|▉ | 27/285 [03:23<31:47, 7.39s/it] 10%|▉ | 28/285 [03:31<31:57, 7.46s/it] 10%|█ | 29/285 [03:38<31:33, 7.39s/it] 11%|█ | 30/285 [03:45<31:07, 7.32s/it] 11%|█ | 31/285 [03:52<31:04, 7.34s/it] 11%|█ | 32/285 [04:00<31:45, 7.53s/it] 12%|█▏ | 33/285 [04:08<31:49, 7.58s/it] 12%|█▏ | 34/285 [04:15<31:13, 7.47s/it] 12%|█▏ | 35/285 [04:22<30:13, 7.26s/it] 13%|█▎ | 36/285 [04:30<31:06, 7.50s/it] 13%|█▎ | 37/285 [04:38<32:12, 7.79s/it] 13%|█▎ | 38/285 [04:47<32:28, 7.89s/it] 14%|█▎ | 39/285 [04:54<32:11, 7.85s/it] 14%|█▍ | 40/285 [05:01<30:42, 7.52s/it] 14%|█▍ | 41/285 [05:09<30:54, 7.60s/it] 15%|█▍ | 42/285 [05:16<30:10, 7.45s/it] 15%|█▌ | 43/285 [05:24<30:08, 7.47s/it] 15%|█▌ | 44/285 [05:31<30:04, 7.49s/it] 16%|█▌ | 45/285 [05:38<29:50, 7.46s/it] 16%|█▌ | 46/285 [05:46<29:31, 7.41s/it] 16%|█▋ | 47/285 [05:53<29:03, 7.33s/it] 17%|█▋ | 48/285 [06:00<28:35, 7.24s/it] 17%|█▋ | 49/285 [06:08<29:15, 7.44s/it] 18%|█▊ | 50/285 [06:15<28:52, 7.37s/it] 18%|█▊ | 51/285 [06:23<29:18, 7.52s/it] 18%|█▊ | 52/285 [06:31<29:23, 7.57s/it] 19%|█▊ | 53/285 [06:38<29:08, 7.54s/it] 19%|█▉ | 54/285 [06:46<29:01, 7.54s/it] 19%|█▉ | 55/285 [06:54<29:26, 7.68s/it] 20%|█▉ | 56/285 [07:01<29:14, 7.66s/it] 20%|██ | 57/285 [07:09<28:48, 7.58s/it] 20%|██ | 58/285 [07:16<29:02, 7.68s/it] 21%|██ | 59/285 [07:25<29:22, 7.80s/it] 21%|██ | 60/285 [07:32<28:19, 7.55s/it] 21%|██▏ | 61/285 [07:39<28:07, 7.54s/it] 22%|██▏ | 62/285 [07:47<28:21, 7.63s/it] 22%|██▏ | 63/285 [07:55<28:52, 7.80s/it] 22%|██▏ | 64/285 [08:03<28:27, 7.73s/it] 23%|██▎ | 65/285 [08:10<27:51, 7.60s/it] 23%|██▎ | 66/285 [08:17<26:58, 7.39s/it] 24%|██▎ | 67/285 [08:24<26:51, 7.39s/it] 24%|██▍ | 68/285 [08:32<26:37, 7.36s/it] 24%|██▍ | 69/285 [08:39<26:15, 7.29s/it] 25%|██▍ | 70/285 [08:46<26:21, 7.36s/it] 25%|██▍ | 71/285 [08:54<26:36, 7.46s/it] 25%|██▌ | 72/285 [09:01<25:50, 7.28s/it] 26%|██▌ | 73/285 [09:09<26:16, 7.43s/it] 26%|██▌ | 74/285 [09:17<26:57, 7.66s/it] 26%|██▋ | 75/285 [09:24<26:03, 7.44s/it] 27%|██▋ | 76/285 [09:31<25:58, 7.46s/it] 27%|██▋ | 77/285 [09:38<25:05, 7.24s/it] 27%|██▋ | 78/285 [09:45<25:02, 7.26s/it] 28%|██▊ | 79/285 [09:53<25:23, 7.39s/it] 28%|██▊ | 80/285 [10:00<24:43, 7.24s/it] 28%|██▊ | 81/285 [10:08<25:08, 7.40s/it] 29%|██▉ | 82/285 [10:15<25:29, 7.54s/it] 29%|██▉ | 83/285 [10:23<25:01, 7.44s/it] 29%|██▉ | 84/285 [10:30<24:43, 7.38s/it] 30%|██▉ | 85/285 [10:37<24:47, 7.44s/it] 30%|███ | 86/285 [10:45<24:29, 7.38s/it] 31%|███ | 87/285 [10:53<25:01, 7.58s/it] 31%|███ | 88/285 [11:01<25:19, 7.71s/it] 31%|███ | 89/285 [11:08<25:14, 7.73s/it] 32%|███▏ | 90/285 [11:16<25:13, 7.76s/it] 32%|███▏ | 91/285 [11:24<24:38, 7.62s/it] 32%|███▏ | 92/285 [11:31<23:48, 7.40s/it] 33%|███▎ | 93/285 [11:38<24:07, 7.54s/it] 33%|███▎ | 94/285 [11:46<24:14, 7.61s/it] 33%|███▎ | 95/285 [11:54<23:58, 7.57s/it] 34%|███▎ | 96/285 [12:01<23:47, 7.55s/it] 34%|███▍ | 97/285 [12:09<23:30, 7.50s/it] 34%|███▍ | 98/285 [12:16<23:03, 7.40s/it] 35%|███▍ | 99/285 [12:23<22:34, 7.28s/it] 35%|███▌ | 100/285 [12:31<23:18, 7.56s/it] 35%|███▌ | 101/285 [12:39<23:45, 7.74s/it] 36%|███▌ | 102/285 [12:46<23:10, 7.60s/it] 36%|███▌ | 103/285 [12:54<23:04, 7.61s/it] 36%|███▋ | 104/285 [13:02<22:56, 7.60s/it] 37%|███▋ | 105/285 [13:10<23:23, 7.79s/it] 37%|███▋ | 106/285 [13:17<22:27, 7.53s/it] 38%|███▊ | 107/285 [13:24<22:15, 7.50s/it] 38%|███▊ | 108/285 [13:31<21:53, 7.42s/it] 38%|███▊ | 109/285 [13:38<20:57, 7.15s/it] 39%|███▊ | 110/285 [13:46<21:23, 7.33s/it] 39%|███▉ | 111/285 [13:53<21:35, 7.45s/it] 39%|███▉ | 112/285 [14:01<21:31, 7.46s/it] 40%|███▉ | 113/285 [14:09<21:40, 7.56s/it] 40%|████ | 114/285 [14:16<21:46, 7.64s/it] 40%|████ | 115/285 [14:24<21:11, 7.48s/it] 41%|████ | 116/285 [14:31<21:05, 7.49s/it] 41%|████ | 117/285 [14:39<20:57, 7.48s/it] 41%|████▏ | 118/285 [14:46<20:36, 7.40s/it] 42%|████▏ | 119/285 [14:53<20:43, 7.49s/it] 42%|████▏ | 120/285 [15:01<20:57, 7.62s/it] 42%|████▏ | 121/285 [15:09<20:49, 7.62s/it] 43%|████▎ | 122/285 [15:17<21:12, 7.81s/it] 43%|████▎ | 123/285 [15:25<20:53, 7.74s/it] 44%|████▎ | 124/285 [15:33<20:49, 7.76s/it] 44%|████▍ | 125/285 [15:41<20:49, 7.81s/it] 44%|████▍ | 126/285 [15:48<20:14, 7.64s/it] 45%|████▍ | 127/285 [15:56<20:10, 7.66s/it] 45%|████▍ | 128/285 [16:04<20:42, 7.91s/it] 45%|████▌ | 129/285 [16:11<19:54, 7.66s/it] 46%|████▌ | 130/285 [16:19<20:08, 7.80s/it] 46%|████▌ | 131/285 [16:27<19:43, 7.68s/it] 46%|████▋ | 132/285 [16:34<19:34, 7.68s/it] 47%|████▋ | 133/285 [16:42<19:10, 7.57s/it] 47%|████▋ | 134/285 [16:50<19:23, 7.71s/it] 47%|████▋ | 135/285 [16:57<18:47, 7.52s/it] 48%|████▊ | 136/285 [17:04<18:19, 7.38s/it] 48%|████▊ | 137/285 [17:11<18:24, 7.47s/it] 48%|████▊ | 138/285 [17:18<17:58, 7.34s/it] 49%|████▉ | 139/285 [17:26<17:41, 7.27s/it] 49%|████▉ | 140/285 [17:33<17:56, 7.43s/it] 49%|████▉ | 141/285 [17:41<17:50, 7.43s/it] 50%|████▉ | 142/285 [17:48<17:42, 7.43s/it] 50%|█████ | 143/285 [17:56<17:33, 7.42s/it] 51%|█████ | 144/285 [18:03<17:29, 7.45s/it] 51%|█████ | 145/285 [18:11<17:50, 7.65s/it] 51%|█████ | 146/285 [18:19<17:31, 7.57s/it] 52%|█████▏ | 147/285 [18:26<17:31, 7.62s/it] 52%|█████▏ | 148/285 [18:34<17:28, 7.66s/it] 52%|█████▏ | 149/285 [18:42<17:33, 7.75s/it] 53%|█████▎ | 150/285 [18:50<17:27, 7.76s/it] 53%|█████▎ | 151/285 [18:57<16:54, 7.57s/it] 53%|█████▎ | 152/285 [19:04<16:44, 7.55s/it] 54%|█████▎ | 153/285 [19:12<16:49, 7.65s/it] 54%|█████▍ | 154/285 [19:20<16:36, 7.60s/it] 54%|█████▍ | 155/285 [19:28<16:41, 7.71s/it] 55%|█████▍ | 156/285 [19:35<16:15, 7.56s/it] 55%|█████▌ | 157/285 [19:43<16:20, 7.66s/it] 55%|█████▌ | 158/285 [19:51<16:10, 7.64s/it] 56%|█████▌ | 159/285 [19:57<15:33, 7.41s/it] 56%|█████▌ | 160/285 [20:05<15:35, 7.49s/it] 56%|█████▋ | 161/285 [20:13<15:54, 7.70s/it] 57%|█████▋ | 162/285 [20:21<15:36, 7.61s/it] 57%|█████▋ | 163/285 [20:28<15:33, 7.65s/it] 58%|█████▊ | 164/285 [20:36<15:10, 7.53s/it] 58%|█████▊ | 165/285 [20:43<14:49, 7.41s/it] 58%|█████▊ | 166/285 [20:50<14:34, 7.35s/it] 59%|█████▊ | 167/285 [20:57<14:24, 7.33s/it] 59%|█████▉ | 168/285 [21:04<14:09, 7.26s/it] 59%|█████▉ | 169/285 [21:11<13:55, 7.21s/it] 60%|█████▉ | 170/285 [21:19<13:51, 7.23s/it] 60%|██████ | 171/285 [21:26<13:40, 7.20s/it] 60%|██████ | 172/285 [21:33<13:31, 7.18s/it] 61%|██████ | 173/285 [21:41<13:41, 7.34s/it] 61%|██████ | 174/285 [21:48<13:42, 7.41s/it] 61%|██████▏ | 175/285 [21:56<13:34, 7.40s/it] 62%|██████▏ | 176/285 [22:03<13:36, 7.49s/it] 62%|██████▏ | 177/285 [22:11<13:41, 7.61s/it] 62%|██████▏ | 178/285 [22:18<13:08, 7.37s/it] 63%|██████▎ | 179/285 [22:26<13:17, 7.53s/it] 63%|██████▎ | 180/285 [22:33<12:58, 7.42s/it] 64%|██████▎ | 181/285 [22:41<12:59, 7.49s/it] 64%|██████▍ | 182/285 [22:48<12:56, 7.54s/it] 64%|██████▍ | 183/285 [22:56<12:45, 7.50s/it] 65%|██████▍ | 184/285 [23:03<12:39, 7.52s/it] 65%|██████▍ | 185/285 [23:11<12:24, 7.45s/it] 65%|██████▌ | 186/285 [23:19<12:34, 7.62s/it] 66%|██████▌ | 187/285 [23:26<12:19, 7.55s/it] 66%|██████▌ | 188/285 [23:33<12:05, 7.48s/it] 66%|██████▋ | 189/285 [23:41<11:58, 7.48s/it] 67%|██████▋ | 190/285 [23:48<11:46, 7.44s/it] 67%|██████▋ | 191/285 [23:56<11:54, 7.61s/it] 67%|██████▋ | 192/285 [24:04<11:43, 7.57s/it] 68%|██████▊ | 193/285 [24:11<11:31, 7.51s/it] 68%|██████▊ | 194/285 [24:18<11:13, 7.41s/it] 68%|██████▊ | 195/285 [24:26<11:25, 7.61s/it] 69%|██████▉ | 196/285 [24:33<10:55, 7.37s/it] 69%|██████▉ | 197/285 [24:41<11:12, 7.64s/it] 69%|██████▉ | 198/285 [24:49<10:59, 7.58s/it] 70%|██████▉ | 199/285 [24:56<10:36, 7.41s/it] 70%|███████ | 200/285 [25:04<10:48, 7.63s/it] 70%|███████ | 200/285 [25:04<10:48, 7.63s/it] 71%|███████ | 201/285 [25:12<10:45, 7.68s/it] 71%|███████ | 202/285 [25:20<10:50, 7.83s/it] 71%|███████ | 203/285 [25:27<10:16, 7.52s/it] 72%|███████▏ | 204/285 [25:35<10:19, 7.64s/it] 72%|███████▏ | 205/285 [25:42<10:08, 7.61s/it] 72%|███████▏ | 206/285 [25:49<09:47, 7.43s/it] 73%|███████▎ | 207/285 [25:57<09:53, 7.61s/it] 73%|███████▎ | 208/285 [26:04<09:31, 7.42s/it] 73%|███████▎ | 209/285 [26:11<09:16, 7.33s/it] 74%|███████▎ | 210/285 [26:19<09:09, 7.32s/it] 74%|███████▍ | 211/285 [26:25<08:48, 7.14s/it] 74%|███████▍ | 212/285 [26:34<09:02, 7.44s/it] 75%|███████▍ | 213/285 [26:41<09:05, 7.58s/it] 75%|███████▌ | 214/285 [26:49<08:50, 7.47s/it] 75%|███████▌ | 215/285 [26:56<08:39, 7.42s/it] 76%|███████▌ | 216/285 [27:04<08:53, 7.73s/it] 76%|███████▌ | 217/285 [27:12<08:51, 7.82s/it] 76%|███████▋ | 218/285 [27:20<08:32, 7.65s/it] 77%|███████▋ | 219/285 [27:27<08:25, 7.65s/it] 77%|███████▋ | 220/285 [27:34<08:05, 7.47s/it] 78%|███████▊ | 221/285 [27:42<07:58, 7.48s/it] 78%|███████▊ | 222/285 [27:49<07:41, 7.33s/it] 78%|███████▊ | 223/285 [27:57<07:42, 7.46s/it] 79%|███████▊ | 224/285 [28:04<07:35, 7.47s/it] 79%|███████▉ | 225/285 [28:12<07:43, 7.73s/it] 79%|███████▉ | 226/285 [28:20<07:25, 7.55s/it] 80%|███████▉ | 227/285 [28:27<07:13, 7.47s/it] 80%|████████ | 228/285 [28:34<06:58, 7.35s/it] 80%|████████ | 229/285 [28:42<06:55, 7.43s/it] 81%|████████ | 230/285 [28:50<07:01, 7.66s/it] 81%|████████ | 231/285 [28:58<07:07, 7.92s/it] 81%|████████▏ | 232/285 [29:06<06:52, 7.79s/it] 82%|████████▏ | 233/285 [29:14<06:46, 7.82s/it] 82%|████████▏ | 234/285 [29:21<06:36, 7.77s/it] 82%|████████▏ | 235/285 [29:29<06:22, 7.65s/it] 83%|████████▎ | 236/285 [29:36<06:13, 7.62s/it] 83%|████████▎ | 237/285 [29:43<05:52, 7.35s/it] 84%|████████▎ | 238/285 [29:50<05:43, 7.31s/it] 84%|████████▍ | 239/285 [29:58<05:44, 7.48s/it] 84%|████████▍ | 240/285 [30:06<05:38, 7.52s/it] 85%|████████▍ | 241/285 [30:13<05:33, 7.58s/it] 85%|████████▍ | 242/285 [30:21<05:27, 7.61s/it] 85%|████████▌ | 243/285 [30:29<05:17, 7.56s/it] 86%|████████▌ | 244/285 [30:36<05:12, 7.62s/it] 86%|████████▌ | 245/285 [30:44<05:02, 7.57s/it] 86%|████████▋ | 246/285 [30:51<04:50, 7.46s/it] 87%|████████▋ | 247/285 [30:59<04:51, 7.68s/it] 87%|████████▋ | 248/285 [31:07<04:43, 7.67s/it] 87%|████████▋ | 249/285 [31:14<04:36, 7.69s/it] 88%|████████▊ | 250/285 [31:21<04:21, 7.47s/it] 88%|████████▊ | 251/285 [31:29<04:13, 7.44s/it] 88%|████████▊ | 252/285 [31:36<04:03, 7.38s/it] 89%|████████▉ | 253/285 [31:43<03:56, 7.39s/it] 89%|████████▉ | 254/285 [31:50<03:43, 7.21s/it] 89%|████████▉ | 255/285 [31:57<03:36, 7.20s/it] 90%|████████▉ | 256/285 [32:05<03:33, 7.35s/it] 90%|█████████ | 257/285 [32:13<03:29, 7.46s/it] 91%|█████████ | 258/285 [32:21<03:24, 7.58s/it] 91%|█████████ | 259/285 [32:28<03:16, 7.56s/it] 91%|█████████ | 260/285 [32:36<03:09, 7.59s/it] 92%|█████████▏| 261/285 [32:44<03:03, 7.65s/it] 92%|█████████▏| 262/285 [32:51<02:52, 7.50s/it] 92%|█████████▏| 263/285 [32:59<02:50, 7.75s/it] 93%|█████████▎| 264/285 [33:06<02:40, 7.62s/it] 93%|█████████▎| 265/285 [33:14<02:29, 7.45s/it] 93%|█████████▎| 266/285 [33:21<02:21, 7.45s/it] 94%|█████████▎| 267/285 [33:28<02:13, 7.39s/it] 94%|█████████▍| 268/285 [33:36<02:09, 7.61s/it] 94%|█████████▍| 269/285 [33:44<02:00, 7.53s/it] 95%|█████████▍| 270/285 [33:51<01:53, 7.56s/it] 95%|█████████▌| 271/285 [33:59<01:45, 7.50s/it] 95%|█████████▌| 272/285 [34:06<01:37, 7.50s/it] 96%|█████████▌| 273/285 [34:13<01:28, 7.34s/it] 96%|█████████▌| 274/285 [34:21<01:21, 7.37s/it] 96%|█████████▋| 275/285 [34:28<01:13, 7.36s/it] 97%|█████████▋| 276/285 [34:35<01:05, 7.33s/it] 97%|█████████▋| 277/285 [34:42<00:58, 7.31s/it] 98%|█████████▊| 278/285 [34:51<00:52, 7.54s/it] 98%|█████████▊| 279/285 [34:58<00:45, 7.57s/it] 98%|█████████▊| 280/285 [35:06<00:37, 7.56s/it] 99%|█████████▊| 281/285 [35:13<00:29, 7.49s/it] 99%|█████████▉| 282/285 [35:20<00:22, 7.36s/it] 99%|█████████▉| 283/285 [35:27<00:14, 7.13s/it]100%|█████████▉| 284/285 [35:34<00:07, 7.21s/it]100%|██████████| 285/285 [35:42<00:00, 7.51s/it] 100%|██████████| 285/285 [35:42<00:00, 7.51s/it]100%|██████████| 285/285 [35:42<00:00, 7.52s/it]
Some weights of EsmForSequenceClassification were not initialized from the model checkpoint at facebook/esm1b_t33_650M_UR50S and are newly initialized: ['classifier.out_proj.bias', 'classifier.dense.weight', 'classifier.dense.bias', 'classifier.out_proj.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
{'loss': 0.2077, 'learning_rate': 1e-05, 'epoch': 3.5}
{'train_runtime': 2150.1983, 'train_samples_per_second': 8.497, 'train_steps_per_second': 0.133, 'train_loss': 0.15006921667801706, 'epoch': 4.99}
Task: IT-MP
Model: ESM-1b
--------------------------------------------------
0%| | 0/285 [00:00<?, ?it/s] 0%| | 1/285 [00:07<35:33, 7.51s/it] 1%| | 2/285 [00:14<34:29, 7.31s/it] 1%| | 3/285 [00:22<35:02, 7.46s/it] 1%|▏ | 4/285 [00:28<33:13, 7.09s/it] 2%|▏ | 5/285 [00:36<33:33, 7.19s/it] 2%|▏ | 6/285 [00:43<33:32, 7.21s/it] 2%|▏ | 7/285 [00:50<33:41, 7.27s/it] 3%|▎ | 8/285 [00:57<33:18, 7.21s/it] 3%|▎ | 9/285 [01:05<33:19, 7.25s/it] 4%|▎ | 10/285 [01:12<33:09, 7.23s/it] 4%|▍ | 11/285 [01:20<33:28, 7.33s/it] 4%|▍ | 12/285 [01:27<33:58, 7.47s/it] 5%|▍ | 13/285 [01:35<33:55, 7.48s/it] 5%|▍ | 14/285 [01:42<33:49, 7.49s/it] 5%|▌ | 15/285 [01:50<33:46, 7.50s/it] 6%|▌ | 16/285 [01:57<33:44, 7.53s/it] 6%|▌ | 17/285 [02:04<32:53, 7.36s/it] 6%|▋ | 18/285 [02:12<32:28, 7.30s/it] 7%|▋ | 19/285 [02:19<32:30, 7.33s/it] 7%|▋ | 20/285 [02:26<32:17, 7.31s/it] 7%|▋ | 21/285 [02:34<32:29, 7.39s/it] 8%|▊ | 22/285 [02:41<32:27, 7.40s/it] 8%|▊ | 23/285 [02:48<31:48, 7.28s/it] 8%|▊ | 24/285 [02:55<31:32, 7.25s/it] 9%|▉ | 25/285 [03:03<31:51, 7.35s/it] 9%|▉ | 26/285 [03:10<31:48, 7.37s/it] 9%|▉ | 27/285 [03:18<31:59, 7.44s/it] 10%|▉ | 28/285 [03:26<32:35, 7.61s/it] 10%|█ | 29/285 [03:33<32:16, 7.56s/it] 11%|█ | 30/285 [03:41<32:10, 7.57s/it] 11%|█ | 31/285 [03:49<32:03, 7.57s/it] 11%|█ | 32/285 [03:56<31:17, 7.42s/it] 12%|█▏ | 33/285 [04:03<31:02, 7.39s/it] 12%|█▏ | 34/285 [04:10<30:51, 7.38s/it] 12%|█▏ | 35/285 [04:18<30:59, 7.44s/it] 13%|█▎ | 36/285 [04:26<31:16, 7.54s/it] 13%|█▎ | 37/285 [04:33<31:14, 7.56s/it] 13%|█▎ | 38/285 [04:41<31:09, 7.57s/it] 14%|█▎ | 39/285 [04:48<30:41, 7.48s/it] 14%|█▍ | 40/285 [04:56<31:10, 7.64s/it] 14%|█▍ | 41/285 [05:03<30:15, 7.44s/it] 15%|█▍ | 42/285 [05:10<29:44, 7.34s/it] 15%|█▌ | 43/285 [05:18<29:57, 7.43s/it] 15%|█▌ | 44/285 [05:26<30:24, 7.57s/it] 16%|█▌ | 45/285 [05:33<30:22, 7.59s/it] 16%|█▌ | 46/285 [05:41<29:59, 7.53s/it] 16%|█▋ | 47/285 [05:49<30:25, 7.67s/it] 17%|█▋ | 48/285 [05:56<29:41, 7.52s/it] 17%|█▋ | 49/285 [06:03<29:18, 7.45s/it] 18%|█▊ | 50/285 [06:11<29:49, 7.62s/it] 18%|█▊ | 51/285 [06:19<30:14, 7.75s/it] 18%|█▊ | 52/285 [06:27<29:41, 7.64s/it] 19%|█▊ | 53/285 [06:34<29:32, 7.64s/it] 19%|█▉ | 54/285 [06:42<28:53, 7.50s/it] 19%|█▉ | 55/285 [06:49<28:20, 7.39s/it] 20%|█▉ | 56/285 [06:56<28:02, 7.35s/it] 20%|██ | 57/285 [07:03<27:41, 7.29s/it] 20%|██ | 58/285 [07:11<27:43, 7.33s/it] 21%|██ | 59/285 [07:18<28:01, 7.44s/it] 21%|██ | 60/285 [07:26<27:50, 7.42s/it] 21%|██▏ | 61/285 [07:33<27:35, 7.39s/it] 22%|██▏ | 62/285 [07:40<27:22, 7.37s/it] 22%|██▏ | 63/285 [07:48<28:00, 7.57s/it] 22%|██▏ | 64/285 [07:56<28:02, 7.62s/it] 23%|██▎ | 65/285 [08:03<27:42, 7.56s/it] 23%|██▎ | 66/285 [08:11<27:24, 7.51s/it] 24%|██▎ | 67/285 [08:18<27:09, 7.48s/it] 24%|██▍ | 68/285 [08:25<26:09, 7.23s/it] 24%|██▍ | 69/285 [08:33<26:43, 7.42s/it] 25%|██▍ | 70/285 [08:41<27:18, 7.62s/it] 25%|██▍ | 71/285 [08:48<26:57, 7.56s/it] 25%|██▌ | 72/285 [08:56<26:54, 7.58s/it] 26%|██▌ | 73/285 [09:03<26:36, 7.53s/it] 26%|██▌ | 74/285 [09:11<26:10, 7.44s/it] 26%|██▋ | 75/285 [09:18<25:49, 7.38s/it] 27%|██▋ | 76/285 [09:25<25:48, 7.41s/it] 27%|██▋ | 77/285 [09:33<25:50, 7.46s/it] 27%|██▋ | 78/285 [09:41<26:01, 7.54s/it] 28%|██▊ | 79/285 [09:48<25:50, 7.53s/it] 28%|██▊ | 80/285 [09:55<25:00, 7.32s/it] 28%|██▊ | 81/285 [10:02<24:34, 7.23s/it] 29%|██▉ | 82/285 [10:09<24:15, 7.17s/it] 29%|██▉ | 83/285 [10:16<24:22, 7.24s/it] 29%|██▉ | 84/285 [10:23<24:08, 7.21s/it] 30%|██▉ | 85/285 [10:31<23:53, 7.17s/it] 30%|███ | 86/285 [10:38<23:58, 7.23s/it] 31%|███ | 87/285 [10:46<24:13, 7.34s/it] 31%|███ | 88/285 [10:54<25:02, 7.63s/it] 31%|███ | 89/285 [11:01<24:14, 7.42s/it] 32%|███▏ | 90/285 [11:08<23:58, 7.38s/it] 32%|███▏ | 91/285 [11:15<23:51, 7.38s/it] 32%|███▏ | 92/285 [11:23<24:11, 7.52s/it] 33%|███▎ | 93/285 [11:31<23:47, 7.44s/it] 33%|███▎ | 94/285 [11:38<23:36, 7.41s/it] 33%|███▎ | 95/285 [11:45<23:16, 7.35s/it] 34%|███▎ | 96/285 [11:53<23:52, 7.58s/it] 34%|███▍ | 97/285 [12:00<23:25, 7.48s/it] 34%|███▍ | 98/285 [12:08<23:01, 7.39s/it] 35%|███▍ | 99/285 [12:15<22:51, 7.37s/it] 35%|███▌ | 100/285 [12:22<22:10, 7.19s/it] 35%|███▌ | 101/285 [12:29<22:01, 7.18s/it] 36%|███▌ | 102/285 [12:36<22:01, 7.22s/it] 36%|███▌ | 103/285 [12:43<21:38, 7.14s/it] 36%|███▋ | 104/285 [12:51<22:05, 7.33s/it] 37%|███▋ | 105/285 [12:58<21:55, 7.31s/it] 37%|███▋ | 106/285 [13:05<21:35, 7.24s/it] 38%|███▊ | 107/285 [13:13<21:38, 7.30s/it] 38%|███▊ | 108/285 [13:21<22:04, 7.49s/it] 38%|███▊ | 109/285 [13:28<21:53, 7.46s/it] 39%|███▊ | 110/285 [13:35<21:45, 7.46s/it] 39%|███▉ | 111/285 [13:43<21:48, 7.52s/it] 39%|███▉ | 112/285 [13:51<22:02, 7.64s/it] 40%|███▉ | 113/285 [13:58<21:39, 7.56s/it] 40%|████ | 114/285 [14:06<21:34, 7.57s/it] 40%|████ | 115/285 [14:13<21:05, 7.45s/it] 41%|████ | 116/285 [14:22<21:48, 7.74s/it] 41%|████ | 117/285 [14:29<21:18, 7.61s/it] 41%|████▏ | 118/285 [14:36<21:01, 7.56s/it] 42%|████▏ | 119/285 [14:44<21:13, 7.67s/it] 42%|████▏ | 120/285 [14:52<21:10, 7.70s/it] 42%|████▏ | 121/285 [15:00<21:16, 7.78s/it] 43%|████▎ | 122/285 [15:07<20:38, 7.60s/it] 43%|████▎ | 123/285 [15:15<20:19, 7.53s/it] 44%|████▎ | 124/285 [15:21<19:39, 7.33s/it] 44%|████▍ | 125/285 [15:29<19:38, 7.37s/it] 44%|████▍ | 126/285 [15:37<19:56, 7.52s/it] 45%|████▍ | 127/285 [15:44<19:40, 7.47s/it] 45%|████▍ | 128/285 [15:52<19:48, 7.57s/it] 45%|████▌ | 129/285 [16:00<19:58, 7.69s/it] 46%|████▌ | 130/285 [16:07<19:23, 7.50s/it] 46%|████▌ | 131/285 [16:14<18:49, 7.34s/it] 46%|████▋ | 132/285 [16:21<18:33, 7.28s/it] 47%|████▋ | 133/285 [16:28<18:34, 7.33s/it] 47%|████▋ | 134/285 [16:36<18:34, 7.38s/it] 47%|████▋ | 135/285 [16:43<18:27, 7.38s/it] 48%|████▊ | 136/285 [16:51<18:48, 7.57s/it] 48%|████▊ | 137/285 [16:59<18:37, 7.55s/it] 48%|████▊ | 138/285 [17:07<18:35, 7.59s/it] 49%|████▉ | 139/285 [17:14<18:13, 7.49s/it] 49%|████▉ | 140/285 [17:21<17:34, 7.27s/it] 49%|████▉ | 141/285 [17:28<17:33, 7.31s/it] 50%|████▉ | 142/285 [17:35<17:28, 7.33s/it] 50%|█████ | 143/285 [17:43<17:31, 7.41s/it] 51%|█████ | 144/285 [17:50<16:50, 7.17s/it] 51%|█████ | 145/285 [17:57<17:01, 7.30s/it] 51%|█████ | 146/285 [18:05<17:15, 7.45s/it] 52%|█████▏ | 147/285 [18:13<17:17, 7.52s/it] 52%|█████▏ | 148/285 [18:20<17:10, 7.52s/it] 52%|█████▏ | 149/285 [18:27<16:30, 7.28s/it] 53%|█████▎ | 150/285 [18:34<16:24, 7.29s/it] 53%|█████▎ | 151/285 [18:42<16:39, 7.46s/it] 53%|█████▎ | 152/285 [18:49<16:26, 7.42s/it] 54%|█████▎ | 153/285 [18:57<16:25, 7.46s/it] 54%|█████▍ | 154/285 [19:04<15:59, 7.33s/it] 54%|█████▍ | 155/285 [19:12<16:17, 7.52s/it] 55%|█████▍ | 156/285 [19:19<16:05, 7.48s/it] 55%|█████▌ | 157/285 [19:28<16:30, 7.74s/it] 55%|█████▌ | 158/285 [19:35<16:15, 7.68s/it] 56%|█████▌ | 159/285 [19:42<15:28, 7.37s/it] 56%|█████▌ | 160/285 [19:50<15:33, 7.47s/it] 56%|█████▋ | 161/285 [19:57<15:08, 7.32s/it] 57%|█████▋ | 162/285 [20:04<15:10, 7.40s/it] 57%|█████▋ | 163/285 [20:11<14:56, 7.35s/it] 58%|█████▊ | 164/285 [20:19<15:03, 7.47s/it] 58%|█████▊ | 165/285 [20:26<14:47, 7.40s/it] 58%|█████▊ | 166/285 [20:33<14:18, 7.22s/it] 59%|█████▊ | 167/285 [20:40<13:55, 7.08s/it] 59%|█████▉ | 168/285 [20:47<14:04, 7.21s/it] 59%|█████▉ | 169/285 [20:55<14:16, 7.38s/it] 60%|█████▉ | 170/285 [21:02<13:53, 7.25s/it] 60%|██████ | 171/285 [21:09<13:50, 7.28s/it] 60%|██████ | 172/285 [21:17<13:41, 7.27s/it] 61%|██████ | 173/285 [21:25<13:57, 7.48s/it] 61%|██████ | 174/285 [21:32<13:32, 7.32s/it] 61%|██████▏ | 175/285 [21:39<13:35, 7.42s/it] 62%|██████▏ | 176/285 [21:46<13:05, 7.21s/it] 62%|██████▏ | 177/285 [21:53<13:01, 7.24s/it] 62%|██████▏ | 178/285 [22:01<13:02, 7.31s/it] 63%|██████▎ | 179/285 [22:08<13:06, 7.42s/it] 63%|██████▎ | 180/285 [22:15<12:40, 7.24s/it] 64%|██████▎ | 181/285 [22:23<12:45, 7.36s/it] 64%|██████▍ | 182/285 [22:30<12:43, 7.41s/it] 64%|██████▍ | 183/285 [22:38<12:39, 7.44s/it] 65%|██████▍ | 184/285 [22:46<12:40, 7.53s/it] 65%|██████▍ | 185/285 [22:54<12:41, 7.62s/it] 65%|██████▌ | 186/285 [23:01<12:22, 7.50s/it] 66%|██████▌ | 187/285 [23:09<12:31, 7.67s/it] 66%|██████▌ | 188/285 [23:16<12:16, 7.59s/it] 66%|██████▋ | 189/285 [23:23<11:56, 7.46s/it] 67%|██████▋ | 190/285 [23:31<11:41, 7.39s/it] 67%|██████▋ | 191/285 [23:38<11:43, 7.48s/it] 67%|██████▋ | 192/285 [23:46<11:35, 7.48s/it] 68%|██████▊ | 193/285 [23:53<11:26, 7.47s/it] 68%|██████▊ | 194/285 [24:00<11:05, 7.32s/it] 68%|██████▊ | 195/285 [24:08<11:00, 7.33s/it] 69%|██████▉ | 196/285 [24:15<10:56, 7.38s/it] 69%|██████▉ | 197/285 [24:23<11:00, 7.51s/it] 69%|██████▉ | 198/285 [24:30<10:52, 7.50s/it] 70%|██████▉ | 199/285 [24:38<10:41, 7.46s/it] 70%|███████ | 200/285 [24:45<10:25, 7.36s/it] 70%|███████ | 200/285 [24:45<10:25, 7.36s/it] 71%|███████ | 201/285 [24:52<10:24, 7.43s/it] 71%|███████ | 202/285 [25:00<10:23, 7.51s/it] 71%|███████ | 203/285 [25:08<10:31, 7.70s/it] 72%|███████▏ | 204/285 [25:16<10:18, 7.63s/it] 72%|███████▏ | 205/285 [25:23<09:59, 7.49s/it] 72%|███████▏ | 206/285 [25:30<09:53, 7.51s/it] 73%|███████▎ | 207/285 [25:38<09:40, 7.45s/it] 73%|███████▎ | 208/285 [25:45<09:29, 7.39s/it] 73%|███████▎ | 209/285 [25:52<09:07, 7.20s/it] 74%|███████▎ | 210/285 [25:59<09:11, 7.35s/it] 74%|███████▍ | 211/285 [26:07<09:13, 7.48s/it] 74%|███████▍ | 212/285 [26:15<09:10, 7.55s/it] 75%|███████▍ | 213/285 [26:22<08:54, 7.42s/it] 75%|███████▌ | 214/285 [26:29<08:30, 7.18s/it] 75%|███████▌ | 215/285 [26:36<08:27, 7.25s/it] 76%|███████▌ | 216/285 [26:43<08:10, 7.11s/it] 76%|███████▌ | 217/285 [26:51<08:15, 7.28s/it] 76%|███████▋ | 218/285 [26:58<08:09, 7.30s/it] 77%|███████▋ | 219/285 [27:06<08:18, 7.55s/it] 77%|███████▋ | 220/285 [27:14<08:10, 7.54s/it] 78%|███████▊ | 221/285 [27:22<08:10, 7.66s/it] 78%|███████▊ | 222/285 [27:28<07:45, 7.39s/it] 78%|███████▊ | 223/285 [27:35<07:28, 7.24s/it] 79%|███████▊ | 224/285 [27:42<07:13, 7.11s/it] 79%|███████▉ | 225/285 [27:50<07:19, 7.32s/it] 79%|███████▉ | 226/285 [27:57<07:06, 7.24s/it] 80%|███████▉ | 227/285 [28:05<07:18, 7.55s/it] 80%|████████ | 228/285 [28:12<07:03, 7.42s/it] 80%|████████ | 229/285 [28:20<06:56, 7.44s/it] 81%|████████ | 230/285 [28:28<07:00, 7.64s/it] 81%|████████ | 231/285 [28:35<06:51, 7.61s/it] 81%|████████▏ | 232/285 [28:42<06:30, 7.37s/it] 82%|████████▏ | 233/285 [28:50<06:27, 7.45s/it] 82%|████████▏ | 234/285 [28:57<06:18, 7.43s/it] 82%|████████▏ | 235/285 [29:04<06:08, 7.37s/it] 83%|████████▎ | 236/285 [29:12<06:01, 7.37s/it] 83%|████████▎ | 237/285 [29:19<05:54, 7.38s/it] 84%|████████▎ | 238/285 [29:27<05:47, 7.39s/it] 84%|████████▍ | 239/285 [29:34<05:39, 7.38s/it] 84%|████████▍ | 240/285 [29:41<05:29, 7.33s/it] 85%|████████▍ | 241/285 [29:49<05:27, 7.45s/it] 85%|████████▍ | 242/285 [29:56<05:20, 7.45s/it] 85%|████████▌ | 243/285 [30:04<05:14, 7.48s/it] 86%|████████▌ | 244/285 [30:11<05:03, 7.41s/it] 86%|████████▌ | 245/285 [30:19<04:56, 7.41s/it] 86%|████████▋ | 246/285 [30:26<04:50, 7.45s/it] 87%|████████▋ | 247/285 [30:34<04:43, 7.47s/it] 87%|████████▋ | 248/285 [30:41<04:35, 7.45s/it] 87%|████████▋ | 249/285 [30:48<04:23, 7.32s/it] 88%|████████▊ | 250/285 [30:56<04:21, 7.47s/it] 88%|████████▊ | 251/285 [31:03<04:12, 7.42s/it] 88%|████████▊ | 252/285 [31:10<04:01, 7.31s/it] 89%|████████▉ | 253/285 [31:18<03:59, 7.48s/it] 89%|████████▉ | 254/285 [31:25<03:45, 7.26s/it] 89%|████████▉ | 255/285 [31:32<03:40, 7.35s/it] 90%|████████▉ | 256/285 [31:40<03:36, 7.47s/it] 90%|█████████ | 257/285 [31:48<03:31, 7.54s/it] 91%|█████████ | 258/285 [31:56<03:25, 7.61s/it] 91%|█████████ | 259/285 [32:03<03:18, 7.62s/it] 91%|█████████ | 260/285 [32:10<03:07, 7.50s/it] 92%|█████████▏| 261/285 [32:18<02:58, 7.45s/it] 92%|█████████▏| 262/285 [32:25<02:50, 7.41s/it] 92%|█████████▏| 263/285 [32:33<02:42, 7.40s/it] 93%|█████████▎| 264/285 [32:40<02:34, 7.38s/it] 93%|█████████▎| 265/285 [32:48<02:29, 7.49s/it] 93%|█████████▎| 266/285 [32:55<02:23, 7.55s/it] 94%|█████████▎| 267/285 [33:03<02:16, 7.58s/it] 94%|█████████▍| 268/285 [33:10<02:07, 7.53s/it] 94%|█████████▍| 269/285 [33:17<01:58, 7.41s/it] 95%|█████████▍| 270/285 [33:25<01:49, 7.32s/it] 95%|█████████▌| 271/285 [33:32<01:42, 7.32s/it] 95%|█████████▌| 272/285 [33:39<01:36, 7.39s/it] 96%|█████████▌| 273/285 [33:46<01:25, 7.12s/it] 96%|█████████▌| 274/285 [33:54<01:19, 7.26s/it] 96%|█████████▋| 275/285 [34:01<01:13, 7.36s/it] 97%|█████████▋| 276/285 [34:09<01:07, 7.50s/it] 97%|█████████▋| 277/285 [34:17<01:00, 7.54s/it] 98%|█████████▊| 278/285 [34:24<00:52, 7.44s/it] 98%|█████████▊| 279/285 [34:32<00:45, 7.53s/it] 98%|█████████▊| 280/285 [34:38<00:36, 7.35s/it] 99%|█████████▊| 281/285 [34:47<00:30, 7.59s/it] 99%|█████████▉| 282/285 [34:54<00:22, 7.53s/it] 99%|█████████▉| 283/285 [35:02<00:15, 7.56s/it]100%|█████████▉| 284/285 [35:09<00:07, 7.53s/it]100%|██████████| 285/285 [35:16<00:00, 7.32s/it] 100%|██████████| 285/285 [35:16<00:00, 7.32s/it]100%|██████████| 285/285 [35:16<00:00, 7.43s/it]
Some weights of EsmForSequenceClassification were not initialized from the model checkpoint at facebook/esm2_t33_650M_UR50D and are newly initialized: ['classifier.out_proj.bias', 'classifier.dense.weight', 'classifier.dense.bias', 'classifier.out_proj.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
{'loss': 0.3517, 'learning_rate': 1e-05, 'epoch': 3.47}
{'train_runtime': 2116.4754, 'train_samples_per_second': 8.727, 'train_steps_per_second': 0.135, 'train_loss': 0.2526006033546046, 'epoch': 4.94}
Task: IC-IT
Model: ESM-2
--------------------------------------------------
0%| | 0/40 [00:00<?, ?it/s] 2%|▎ | 1/40 [00:09<06:23, 9.83s/it] 5%|▌ | 2/40 [00:20<06:29, 10.25s/it] 8%|▊ | 3/40 [00:29<06:08, 9.96s/it] 10%|█ | 4/40 [00:38<05:41, 9.48s/it] 12%|█▎ | 5/40 [00:48<05:31, 9.46s/it] 15%|█▌ | 6/40 [00:57<05:19, 9.41s/it] 18%|█▊ | 7/40 [01:06<05:06, 9.29s/it] 20%|██ | 8/40 [01:15<04:57, 9.29s/it] 22%|██▎ | 9/40 [01:24<04:46, 9.24s/it] 25%|██▌ | 10/40 [01:34<04:36, 9.22s/it] 28%|██▊ | 11/40 [01:44<04:35, 9.48s/it] 30%|███ | 12/40 [01:53<04:23, 9.39s/it] 32%|███▎ | 13/40 [02:03<04:17, 9.54s/it] 35%|███▌ | 14/40 [02:12<04:07, 9.51s/it] 38%|███▊ | 15/40 [02:21<03:52, 9.29s/it] 40%|████ | 16/40 [02:31<03:45, 9.40s/it] 42%|████▎ | 17/40 [02:41<03:39, 9.55s/it] 45%|████▌ | 18/40 [02:50<03:29, 9.54s/it] 48%|████▊ | 19/40 [03:00<03:25, 9.79s/it] 50%|█████ | 20/40 [03:10<03:14, 9.73s/it] 52%|█████▎ | 21/40 [03:19<02:58, 9.40s/it] 55%|█████▌ | 22/40 [03:28<02:51, 9.53s/it] 57%|█████▊ | 23/40 [03:38<02:40, 9.45s/it] 60%|██████ | 24/40 [03:47<02:29, 9.37s/it] 62%|██████▎ | 25/40 [03:57<02:25, 9.68s/it] 65%|██████▌ | 26/40 [04:07<02:14, 9.60s/it] 68%|██████▊ | 27/40 [04:16<02:04, 9.59s/it] 70%|███████ | 28/40 [04:26<01:55, 9.59s/it] 72%|███████▎ | 29/40 [04:35<01:44, 9.53s/it] 75%|███████▌ | 30/40 [04:45<01:36, 9.64s/it] 78%|███████▊ | 31/40 [04:54<01:25, 9.49s/it] 80%|████████ | 32/40 [05:03<01:14, 9.30s/it] 82%|████████▎ | 33/40 [05:13<01:05, 9.35s/it] 85%|████████▌ | 34/40 [05:23<00:57, 9.51s/it] 88%|████████▊ | 35/40 [05:32<00:47, 9.51s/it] 90%|█████████ | 36/40 [05:41<00:37, 9.42s/it] 92%|█████████▎| 37/40 [05:50<00:27, 9.25s/it] 95%|█████████▌| 38/40 [05:59<00:18, 9.20s/it] 98%|█████████▊| 39/40 [06:09<00:09, 9.28s/it]100%|██████████| 40/40 [06:18<00:00, 9.26s/it] 100%|██████████| 40/40 [06:18<00:00, 9.26s/it]100%|██████████| 40/40 [06:18<00:00, 9.46s/it]
{'train_runtime': 378.4339, 'train_samples_per_second': 6.897, 'train_steps_per_second': 0.106, 'train_loss': 0.6899797439575195, 'epoch': 4.9}
wandb: - 0.026 MB of 0.026 MB uploadedwandb: \ 0.026 MB of 0.026 MB uploadedwandb: | 0.026 MB of 0.026 MB uploadedwandb: / 0.026 MB of 0.026 MB uploadedwandb:
wandb: Run history:
wandb: train/epoch ▁█▁██
wandb: train/global_step ▆█▆█▁
wandb: train/learning_rate ▁▁
wandb: train/loss ▁█
wandb: train/total_flos ██▁
wandb: train/train_loss ▁▂█
wandb: train/train_runtime ██▁
wandb: train/train_samples_per_second ▇█▁
wandb: train/train_steps_per_second ██▁
wandb:
wandb: Run summary:
wandb: train/epoch 4.9
wandb: train/global_step 40
wandb: train/learning_rate 1e-05
wandb: train/loss 0.3517
wandb: train/total_flos 5836361824803396.0
wandb: train/train_loss 0.68998
wandb: train/train_runtime 378.4339
wandb: train/train_samples_per_second 6.897
wandb: train/train_steps_per_second 0.106
wandb:
wandb: 🚀 View run visionary-silence-414 at: https://wandb.ai/bioinformatics-group/huggingface/runs/7lja2kvx
wandb: ️⚡ View job at https://wandb.ai/bioinformatics-group/huggingface/jobs/QXJ0aWZhY3RDb2xsZWN0aW9uOjE1MDU1Mjk2NQ==/version_details/v0
wandb: Synced 6 W&B file(s), 0 media file(s), 2 artifact file(s) and 0 other file(s)
wandb: Find logs at: ./wandb/run-20240319_170959-7lja2kvx/logs