1
0
mirror of https://github.com/searxng/searxng.git synced 2024-11-22 20:17:45 +01:00

[mod] robots.txt update

This commit is contained in:
asciimoo 2014-01-20 01:38:17 +01:00
parent ffc93ba256
commit 692c0bf5f0

View File

@ -226,6 +226,7 @@ def robots():
Allow: /
Allow: /about
Disallow: /stats
Disallow: /engines
""", mimetype='text/plain')