Skip to main content

Advertisement

Table 2 Detecting Googlebots by checking URL markers

From: PathMarker: protecting web contents against inside crawlers

Visitor IP URL URL marker
66.249.67.83 home/node/show/12/ home/topic/show/855/;66.249.67.71
66.249.67.77 home/topic/add/ home/home/getmore/13/;66.249.67.83
66.249.67.86 home/policy/ home/user/profile/13/;66.249.67.80
66.249.67.80 home/node/ home/home/getmore/70/;66.249.67.92
66.249.67.71 home/node/show/12/15/ /index.php/node/show/12/8/;66.249.67.77