User-agent: * # disallow all files in these directories Disallow: /hoteles/wp-admin Disallow: /hoteles/wp-includes Disallow: /hoteles/wp-content/plugins Disallow: /hoteles/wp-content/cache Disallow: /hoteles/wp-content/themes Disallow: /hoteles/cgi-bin/ Disallow: /hoteles/z/j/ Disallow: /hoteles/z/c/ Disallow: /hoteles/stats/ Disallow: /hoteles/dh_ Disallow: /hoteles/about/ Disallow: /hoteles/contact/ Disallow: /hoteles/tag/ Disallow: /hoteles/wp-admin/ Disallow: /hoteles/wp-includes/ Disallow: /hoteles/contact Disallow: /hoteles/manual Disallow: /hoteles/manual/* Disallow: /hoteles/phpmanual/ Disallow: /hoteles/category/ Disallow: /hoteles/trackback Disallow: /hoteles/*trackback Disallow: /hoteles/*trackback* Disallow: /hoteles/*/trackback Disallow: /hoteles/*?* Disallow: /hoteles/*.html/$ Disallow: /hoteles/*feed* Disallow: /turismo/administrator/ Disallow: /turismo/cache/ Disallow: /turismo/components/ Disallow: /turismo/editor/ Disallow: /turismo/help/ Disallow: /turismo/images/ Disallow: /turismo/includes/ Disallow: /turismo/language/ Disallow: /turismo/mambots/ Disallow: /turismo/media/ Disallow: /turismo/modules/ Disallow: /turismo/templates/ Disallow: /turismo/installation Disallow: /turismo/*?* User-agent: Googlebot # disallow all files ending with these extensions Disallow: /hoteles/*.php$ Disallow: /hoteles/*.js$ Disallow: /hoteles/*.inc$ Disallow: /hoteles/*.css$ Disallow: /hoteles/*.gz$ Disallow: /hoteles/*.wmv$ Disallow: /hoteles/*.cgi$ Disallow: /hoteles/*.xhtml$ # disallow all files with ? in url Disallow: /hoteles/*?* Disallow: /turismo/*?* # disable duggmirror User-agent: duggmirror Disallow: / # allow google image bot to search all images User-agent: Googlebot-Image Disallow: Allow: /* # allow adsense bot on entire site User-agent: Mediapartners-Google Disallow: Allow: /* # block print and email User-agent: * Disallow: /hoteles/*/*/email/$ Disallow: /hoteles/*/*/print/$ Disallow: /hoteles/*/*/#$ Disallow: /hoteles/page/ # block all folders with broken links User-agent: * Disallow: /hoteles/20$