# Disallow all crawlers access to certain pages. User-Agent: * Disallow: /basket Disallow: /notepad Disallow: /recommend Disallow: /result