mirror of
https://github.com/searxng/searxng.git
synced 2024-11-22 04:01:40 +01:00
823c490c84
Block requests from PetalBlock. Normally robots.txt is enough to stop PetalBlock from making requests [1]. However, if SearXNG is offered below a path (example.org/search), then the robots.txt is not available in the root paths of the domain / subdomain. [1] https://webmaster.petalsearch.com/site/petalbot Signed-off-by: Markus Heiser <markus.heiser@darmarit.de> |
||
---|---|---|
.. | ||
__init__.py | ||
ahmia_filter.py | ||
hash_plugin.py | ||
hostname_replace.py | ||
limiter.py | ||
oa_doi_rewrite.py | ||
search_on_category_select.py | ||
self_info.py | ||
tor_check.py | ||
tracker_url_remover.py | ||
vim_hotkeys.py |