kamp/searxng
1
0
Fork 0
mirror of https://github.com/searxng/searxng.git synced 2024-11-22 20:17:45 +01:00
Code

[mod] robots.txt update

Browse Source
This commit is contained in:
asciimoo 2014-01-20 01:38:17 +01:00
parent ffc93ba256
commit 692c0bf5f0
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
searx/webapp.py
View File

@ -226,6 +226,7 @@ def robots():
Allow: / Allow: /
Allow: /about Allow: /about
Disallow: /stats Disallow: /stats
Disallow: /engines
""", mimetype='text/plain') """, mimetype='text/plain')