# robots.txt for http://www.masterfile.com/ User-agent: msnbot Disallow: / User-agent: * #florin; Crawl-delay setting configured for 'very slow' Crawl-delay: 5 Disallow: /*? Allow: /*?v= Disallow: /checkout Disallow: /contest Disallow: /cop Disallow: /demo Disallow: /enlarged Disallow: /formsubmits Disallow: /hirescomp Disallow: /imagepreview Disallow: /info/artists/adcampaign.html Disallow: /info/artists/contractterms.html Disallow: /info/artists/contributingartists.html Disallow: /info/ourcollections.html Disallow: /info/products/myimageprofile.html Disallow: /info/products/pubs/greenworld.html Disallow: /info/products/pubs/mysteries.html Disallow: /info/products/rightscontrol.html Disallow: /info/products/search.html Disallow: /info/products/tagcloud.html Disallow: /lb_admin Disallow: /maintenance Disallow: /marketing Disallow: /myaccount Disallow: /mylightboxes Disallow: /promos/featuredartists Disallow: /radius Disallow: /registration Disallow: /secure Disallow: /shoppingcart Disallow: /spa Disallow: /streamer Disallow: /universe Disallow: /viewlightbox # Disallow: /subscribe ## allowed, implicitly - Lev, 2006.06.06 ## ## all files in the root, plus... # # browse/ # info/ # help/ # clickme/ # email/ # promos/