1
0
mirror of https://github.com/searxng/searxng.git synced 2024-07-02 15:30:42 +02:00

[mod] robots.txt update

This commit is contained in:
asciimoo 2014-01-20 01:38:17 +01:00
parent ffc93ba256
commit 692c0bf5f0

View File

@ -226,6 +226,7 @@ def robots():
Allow: /
Allow: /about
Disallow: /stats
Disallow: /engines
""", mimetype='text/plain')