User-agent: * Disallow: / Disallow: /web/backup/ Disallow: /web/bin/ Disallow: /web/cache/ Disallow: /web/grav/ Disallow: /web/logs/ Disallow: /web/system/ Disallow: /web/vendor/ Disallow: /web/user/ Allow: /web/user/pages/ Allow: /web/user/themes/ Allow: /web/