Do you have an ssh key set up? If not, setting one up should fix that. If you do, setting up a graphical password entry would help. If you tell me more about your OS and setup I might be able to help.