StarMirror/haste-server
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Added non-standard but desirable robots.txt

Browse Source
This commit is contained in:
John Crepezzi 2011-12-16 08:18:04 -05:00
parent 44f7ab3f33
commit 14a23388a8
1 changed files with 3 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
static/robots.txt
View File

@ -1,3 +1,4 @@
User-agent: *
Allow: /about
Disallow: /
Disallow: /*
Allow: /?okparam=
Allow: /$