To list all SSH keys used by ssh agent on your system, run
ssh-add -l
Example
To add all available ssh keys to agent, run
ssh-add
Remove SSH Key
To remove all SSH keys from agent, run
ssh-add -D
To remove specific key, run
ssh-add -d /path/to/file
Or you can just remove they ssh key files from your ~/.ssh folder.