Have you ever wondered how does Google to index pages of those sites that require registration or even have to pay? Because he, and not us? to almost everything there is an answer. The search engine at the time of scanning, is recognized by the site, which then gives him permission to enter.
order to access even us poor mortals, so there is only one method: Disguised as Google. Simply changing a parameter called "User Agent". With Explorer and Opera this operation is a bit '
complicated but doable, while Firefox seems to be much simpler, as it uses a plugin called "
Agent Switcher. "
Once installed
plugin, restart Firefox and configure it from the Tools menu by going to User Agent Switcher -> Options -> Options -> User Agent -> Add and enter in the "description" the word
Googlebot 2.1
- and as a "User Agent" the writing
- Googlebot/2.1 (http://www.googlebot.com/bot.html)
.
0 comments:
Post a Comment