# /robots.txt file for http://webcrawler.com/ # mail webmaster@webcrawler.com for constructive criticism User-agent: * Disallow: /26/03/ Disallow: /insurance.html Disallow: /Park%20Resorts Disallow: /static_caravan_information/26/03/2009 Disallow: /static_caravan_information/static_caravan_purchase_and_licence_agreements.html Disallow: /Static_caravans_research.html Disallow: /index.asp?Action=CARAVAN%20MANUFACTURERS&ManufacturerID* Disallow: /index.asp?Action=FORUM%20NEW%20TOPIC&SiteID=LEA20070402130612 Disallow: /index.asp?Action=FORUM%20TOPIC%20REPLY&ThreadID* Disallow: /index.asp?Page=Sitemap Disallow: /index.asp?Page=Terms%20and%20Conditions Disallow: /Skins/ Disallow: /static_caravan_manufacturers/26/03/ Disallow: /static_caravan_manufacturers/JavaScript/ Disallow: /user_reviews/26/03/ Disallow: /user_reviews/JavaScript/ Disallow: /index.asp?Action=CARAVAN%20SALES%20SEARCH&County=County+Durham Disallow: /index.asp?Action=CARAVAN%20SALES%20SEARCH&County=Surrey Disallow: /index.asp?Action=CARAVAN%20SALES%20SEARCH&County=Wiltshire Sitemap: /sitemap.xml