I even ripped the thread title from here
Disguise Yourself As Google Bot - Quicksilverscreen Forum!
It's actually from here tho-
@ classic tutorials: Become a Googlebot, get a Free Pass
Quote:
The Problem:
Sometimes you conduct some search on Google and the engine returns a number of results, but when you try to open the ones that looks the most promising you get a registration page. One thing that you can do is click on the cached content to view the page directly from Google's cache. But what if you want to view another page from the same site, not present in google's cache?
The Solution:
Its evident that there are some sites that allows Google but not you. So why not disguise yourself as Google? Thats exactly what we will do by changing the browser's user agent to Googlebot. Copy the following code into notepad and save it as a .reg file
|
ill have a tinker in a bit.