I just noticed that the models we trained are all ...
# proj-codescout
r
I just noticed that the models we trained are all saved (by skyrl) in FP32 precision (due to skyrl's save setting by default)...
Yes! My concern wasn’t about the metrics — I noticed this because I was evaluating my own trained models and realized each 4B checkpoint sums up to ~17GB 😂
👍 1