1
0
mirror of https://github.com/searxng/searxng.git synced 2024-11-23 04:27:46 +01:00

[mod] robots.txt update

This commit is contained in:
asciimoo 2014-01-20 01:38:17 +01:00
parent ffc93ba256
commit 692c0bf5f0

View File

@ -226,6 +226,7 @@ def robots():
Allow: / Allow: /
Allow: /about Allow: /about
Disallow: /stats Disallow: /stats
Disallow: /engines
""", mimetype='text/plain') """, mimetype='text/plain')