# robots.txt for our home directory # to disallow all (*) robots from searching certain areas User-agent: * Disallow: /test/ Disallow: /assets/ Disallow: /Forgotten/ Disallow: /Contact-US/