Incorrect structure

The structure for robots.txt is incorrect for some/most search engines.
This commit is contained in:
ic0nic 2013-11-01 01:22:16 +01:00 committed by Simon Rupf
parent 3b3a841be6
commit c918a9fe2e

View File

@ -1,4 +1,4 @@
# Might as well keep robots away for performance and privacy reasons. # Might as well keep robots away for performance and privacy reasons.
User-agent: * User-agent: *
Disallow: /
Allow: /index.php Allow: /index.php
Disallow: /