From: Digest To: "OS/2GenAu Digest" Date: Fri, 15 Aug 2008 00:00:25 EST-10EDT,10,1,0,7200,4,1,0,7200,3600 Subject: [os2genau_digest] No. 1690 Reply-To: X-List-Unsubscribe: www.os2site.com/list/ ************************************************** Thursday 14 August 2008 Number 1690 ************************************************** Subjects for today 1 Re: [OS2-ISP]: Fwd: Robots.txt files restricting msnbot at http://www.warpspeed dot com dot au/robots.txt and http://firedragon.warpspeed dot com dot au/firedragon/robots.txt : Ian Manners" **= Email 1 ==========================** Date: Thu, 14 Aug 2008 10:19:28 +1000 (EST) From: "Ian Manners" Subject: Re: [OS2-ISP]: Fwd: Robots.txt files restricting msnbot at http://www.warpspeed dot com dot au/robots.txt and http://firedragon.warpspeed dot com dot au/firedragon/robots.txt PS, >>> I remember a thread on this list on how to block them. Anyone else >>> get an email like this? I also use MODrewrite, anything with selected UserAgents, originating IP's, refering URL's etc gets redirected to another website, or to 127.0.0.1. Cheers Ian Manners http://www.os2site dot com/ ----------------------------------------------------------------------------------