# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # # A robot just asks if it can visit a page, for example: # User-agent: * # Allow: / # # But a robot can also be told to stay away from certain pages: # User-agent: * # Disallow: / # # The following tells all robots that they can visit all pages. # User-agent: * Disallow: /auth/ Allow: / Sitemap: https://chefito.de/sitemap.xml