SSH IdentityAgent option
The IdentityAgent option specifies what UNIX-domain socket to use to communicate with the authentication agent. When configured, it overrides the environment variable SSH_AUTH_SOCK and provides the option to select a specific agent.
Besides the option to define a socket, the location of the socket can also be provided by the SSH_AUTH_SOCK environment variable. In that case the value should defined as “SSH_AUTH_SOCK” (without quotes). If the value starts with a ‘$’, it indicates that another environment variable is to be used.
To disable the usage of the SSH-agent, define the value “none” (without quotes).
Host *
# Disable entities known to ssh-agent for all systems
IdentityAgent none