# machine-learning
- c
ColdFir3
10/21/2021, 9:02 PMOh the quadro series yeahh, damn how much is the rent for it? - c
Couch
10/21/2021, 9:02 PMpypi says checkpointon disk - g
GlobalIndustrial
10/21/2021, 9:03 PM$1.25/hr - g
GlobalIndustrial
10/21/2021, 9:04 PMbut it was a massive hassle to get the colab notebook to work on it, mismatching package versions and everything - c
ColdFir3
10/21/2021, 9:06 PMThat's actually really cheap damn, is it faster than a V100 or would you not know? - g
GlobalIndustrial
10/21/2021, 9:06 PMno clue, Colab never gave me a V100 and they timed me out from accessing GPUs - c
ColdFir3
10/21/2021, 9:09 PMFair enough - g
GlobalIndustrial
10/21/2021, 9:09 PMi dont think my training is going too well though - c
ColdFir3
10/21/2021, 9:10 PMThat's pain - c
ColdFir3
10/21/2021, 9:11 PM - g
GlobalIndustrial
10/21/2021, 9:14 PMyeah it's at epoch 200 and the best loss is 0.382 - g
GlobalIndustrial
10/21/2021, 9:15 PMand the current loss 0.462 - c
ColdFir3
10/21/2021, 9:18 PMtry adjust the batch size accordingly and if really needed adjust the learning rate - g
GlobalIndustrial
10/21/2021, 9:20 PMbatch size is 32 and learning rate is 1e-3, the defaults - g
GlobalIndustrial
10/21/2021, 9:20 PMno clue what to really do with them - g
GlobalIndustrial
10/21/2021, 9:23 PMit's a pretty challenging dataset probably, here's a sample - c
ColdFir3
10/21/2021, 9:23 PMhow many wav samples are you using - g
GlobalIndustrial
10/21/2021, 9:24 PM545 - g
GlobalIndustrial
10/21/2021, 9:25 PMi was wondering if it would make it easier to train if i replaced all instances of "Ma'am" with "Man" in the transcripts, or if that's unneeded - c
ColdFir3
10/21/2021, 9:26 PMDAMN I think for a RTX6000 it should definitely be able to with handle a batch size of 109 try that - c
ColdFir3
10/21/2021, 9:26 PMkeep the learning rate and see if anything changes - g
GlobalIndustrial
10/21/2021, 9:26 PMno, it was running out of VRAM with 64 - c
ColdFir3
10/21/2021, 9:26 PMhow fast was it to reach to 200 EPOCH? - c
ColdFir3
10/21/2021, 9:27 PMoh damn yikes - g
GlobalIndustrial
10/21/2021, 9:27 PMuhh - g
GlobalIndustrial
10/21/2021, 9:27 PMabout 20 minutes or so idk - c
ColdFir3
10/21/2021, 9:27 PMtry 48 - c
ColdFir3
10/21/2021, 9:27 PMthats FAST woahh - g
GlobalIndustrial
10/21/2021, 9:27 PMi think 48 was running out of vram too - g
GlobalIndustrial
10/21/2021, 9:27 PMit's using 20gb out of 24