# This file implements the "robot exclusion protocol". It tells robots # such as web crawlers and other search engines not to proceed below # the root of this database. # See # http://info.webcrawler.com/mak/projects/robots/norobots.html # for a description of the robot exclusion protocol and more information # on how this file works. User-agent: * Disallow: /Booking/ Disallow: /EasyHome/ Disallow: /Landlord/ Disallow: /Product/ Disallow: /Report/ Disallow: /SilverMaster35/ Disallow: /Speeltuin/ Disallow: /Supplier/ Disallow: /Survey/ Disallow: /Translator/ Disallow: /w3c/ Crawl-delay: 60