## robots.txt for Opencart E-commerce website ## Enable robots.txt rules for all crawlers User-agent: * ## Crawl-delay parameter: number of seconds to wait between successive requests to the same server. ## Set a custom crawl rate if you're experiencing traffic problems with your server. Crawl-delay: 30 ## Website sitemap Sitemap: https://greensports.com.au/sitemap.xml ## Disallow Opencart admin page Disallow: /admin/ ## Disallow Opencart folders Disallow: /image/ Disallow: /system/ Disallow: /install/ ## Do not crawl pages that are sorted or paged. Disallow: /*?page* Disallow: /*?order=desc Disallow: /*?order=asc ## Uncomment it only if you activated SEO URLs. Disallow: /index.php/ ## IMAGE CRAWLERS SETTINGS ## Extra: Uncomment if you do not wish Google and Bing to index your images # User-agent: Googlebot-Image # Disallow: / # User-agent: msnbot-media # Disallow: /