#robots.txt for http://www.fishkamchatka.ru/ User-Agent: * Crawl-delay: 2 # задает таймаут в 2 секунды Allow: / Disallow: /testb Disallow: /images Disallow: /doc Disallow: /css Disallow: /dokupimlink Disallow: /links Disallow: /popup Disallow: /video Disallow: /sayno Disallow: /trade Disallow: /about Disallow: /acrobat Disallow: /setlinks_768dd Disallow: /museum Disallow: Clean-param: s&title / Clean-param: s /?con=registration