|
Q
|
How can I use BrowserHawk to detect search engines and other such crawlers?
|
|
A
|
Check the Crawler property which is a boolean. If set to True, the visiting agent is a crawler/robot. You can further refine your testing to identify specific crawlers by also using the Browser property, which is set to a name which identifies the most popular search engines and crawlers.
For example:
set bh = Server.CreateObject("cyscape.browserObj")
if bh.crawler = True and bh.Browser = "Google" then
...
end if
|
