Should I remove the public key after adding it to the server's authorized_keys file?

view full story

http://stackoverflow.com – I'm done setting up ssh login using public/private key pair. I have my id_rsa (private key) in my ~/.ssh directory and also still have id_rsa.pub (public key) in the same directory. I'm no security expert, but something tells me its not a good idea to keep both keys in the same directory? Is it a good practice to remove the public key file after I've added it to the server's authorized_keys file? If there is no harm in keeping the public key around, should I move it to a different directory? One shortcoming I can think of is that I would have to re-generate a public/private key pair if I wan (HowTos)