# robots.txt file # # make it apply to all agents User-agent: * # # Prevent access to secure or problematic directories # Disallow: /archive/ Disallow: