found my answer in the guide, looks like I didn't use enough wavs to train it: https://uberduck-guide.gitbook.io/uberduck-written-tutorial/troubleshoot-and-bugs/troubleshoot-and-bugs#i-got-this-ladys-default-voice-which-is-thats-not-my-model.-what-to-do