When using curl linux command line tool, to set user agent, run
curl --user-agent "USER_AGENT_HERE" URL_HERE
You can also use
curl -A "USER_AGENT_HERE" URL_HERE
By changing user agent, you can view a site as google bot, check Fetch as Google with curl
Back to curl
Leave a Reply