git remote set-url origin git@github.com:USERNAME/REPOSITORY.git

Source: git – SSH Key – Still asking for password and passphrase – Stack Overflow