Training log
Validation loss at the end of each session. Pretraining finished at step 15,000 with 2.971.
Validation loss by training stepLower is better
201.9Mparameters
15,000steps, over 9 sessions
3.9Btokens seen
₹0cash on compute
| Point | Step | Validation loss |
|---|---|---|
| Session 2 start | 1,860 | 3.556 |
| Session 2 | 3,903 | 3.268 |
| Session 3 | 5,697 | 3.199 |
| Session 4 | 7,656 | 3.070 |
| Session 5 | 9,677 | 3.059 |
| Session 6 | 11,241 | 3.060 |
| Session 7 | 12,753 | 3.023 |
| Session 8 | 14,766 | 2.922 |
| Session 9, pretraining complete | 15,000 | 2.971 |
Single readings swing by about 0.1, so read the shape, not one row. Perplexity at the end is about 19.5.
Questions about the run?
Write to us or book a short call.