Everett Stenberg / LabTry LMSteinshark ↗

PRETRAINING / RUN MONITOR

Learning, one token at a time.

Loading checkpoint…

ConnectingWaiting for metrics

Training progress

—
——

Throughput

—tokens / second

Training loss

—cross-entropy

Validation loss

—cross-entropy

Estimated remaining

—at latest throughput

Learning curves

TrainingValidation
View loss samples
TokensTrainValidation

Latest checkpoint

—

Elapsed training time

—

Context curriculum

1,024 through 28B tokens
2,048 for the final 2B