Table 2 Detecting Googlebots by checking URL markers
From: PathMarker: protecting web contents against inside crawlers
Visitor IP | URL | URL marker |
|---|---|---|
66.249.67.83 | home/node/show/12/ | home/topic/show/855/;66.249.67.71 |
66.249.67.77 | home/topic/add/ | home/home/getmore/13/;66.249.67.83 |
66.249.67.86 | home/policy/ | home/user/profile/13/;66.249.67.80 |
66.249.67.80 | home/node/ | home/home/getmore/70/;66.249.67.92 |
66.249.67.71 | home/node/show/12/15/ | /index.php/node/show/12/8/;66.249.67.77 |