Yes, either deleting them from the VSCode file explorer (top of the explorer panel by default) or using your operating systems' file browser. Either should work