kamp/searxng
1
0
Fork 0
mirror of https://github.com/searxng/searxng.git synced 2024-11-15 09:10:12 +01:00
Code
5,638 Commits 8 Branches 17 Tags 132 MiB
284ac8bfd8
Commit Graph

5638 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Markus Heiser
55b30b5b49
[fix] searx_extra/update scripts: set_loggers(wikidata, 'wikidata') (#331) 
* [fix] searx_extra/update scripts: set_loggers(wikidata, 'wikidata')

To test use::

    ./manage pyenv.cmd searx_extra/update/update_currencies.py
    ./manage pyenv.cmd searx_extra/update/update_osm_keys_tags.py
    ./manage pyenv.cmd searx_extra/update/update_wikidata_units.py

The script `update_engine_descriptions.py` seems to have some issues not related
to this patch.

    ./manage pyenv.cmd python -m pip install -U pycld3
    ./manage pyenv.cmd searx_extra/update/update_engine_descriptions.py

Closes: https://github.com/searxng/searxng/issues/328
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-19 11:10:02 +02:00
Alexandre Flament
d95c46d646
Merge pull request #329 from searxng/translations_update 
Update translations
 2021-09-17 15:53:45 +02:00
searxng-bot
1bc50c1eb4 [translations] update 
3834942d - 2021-09-15 - ButterflyOfFire <butterflyoffire@protonmail.com>
 2021-09-17 13:50:32 +00:00
Alexandre Flament
07a2633aee
Merge pull request #327 from dalf/pyenv.activate 
[mod] utils/lib.sh: add pyenv.activate
 2021-09-17 15:48:51 +02:00
Markus Heiser
7a3a1cd115 [mod] manage - use pyenv.activate where it makes sense 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-17 15:31:09 +02:00
Alexandre Flament
e5e322e8ed [mod] utils/lib.sh: add pyenv.activate 
* initialize virtualenv (pyenv.install)
* activate virtualenv

close #310
 2021-09-17 14:15:35 +02:00
Alexandre Flament
dc74df3a55
Merge pull request #261 from dalf/upgrade_httpx 
[upd] upgrade httpx 0.19.0
 2021-09-17 11:48:37 +02:00
Alexandre Flament
0d9959e649
Merge pull request #325 from searxng/dependabot/pip/master/pylint-2.11.1 
Bump pylint from 2.10.2 to 2.11.1
 2021-09-17 11:36:51 +02:00
Markus Heiser
8905607d1c
Merge pull request #326 from searxng/dependabot/pip/master/sphinx-4.2.0 
Bump sphinx from 4.1.2 to 4.2.0
 2021-09-17 08:23:17 +00:00
Markus Heiser
443bf35e09 [pylint] fix global-variable-not-assigned issues 
If there is no write access, there is no need for global.  Remove global
statement if there is no assignment.

global-variable-not-assigned:
  Using global for names but no assignment is done Used when a variable is
  defined through the "global" statement but no assignment to this variable is
  done.

In Pylint 2.11 the global-variable-not-assigned checker now catches global
variables that are never reassigned in a local scope and catches (reassigned)
functions [1][2]

[1] https://pylint.pycqa.org/en/latest/whatsnew/2.11.html
[2] https://github.com/PyCQA/pylint/issues/1375

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-17 10:14:27 +02:00
Alexandre Flament
41f6359d06 [fix] error recorder: avoid RuntimeError on some rare occasion 
httpx.RequestError (subclass of httpx.HTTPError) has a property request.
This property raises a RuntimeError if the attributes _request is None.
To avoid a cascade of errors, this commit reads directly the _request attribute.
 2021-09-17 10:06:24 +02:00
Alexandre Flament
b10403d3a1 [mod] searx.network: remove redundant code 
searx.client.new_client: the proxies parameter is a dictonnary,
and the protocol (key of the dictionnary) is already normalized
(see usage of searx.network.network.PROXY_PATTERN_MAPPING)
 2021-09-17 10:06:24 +02:00
Alexandre Flament
8e73438cbe [upd] upgrade httpx 0.19.0 
adjust searx.network module to the new internal API
see https://github.com/encode/httpx/pull/1522
 2021-09-17 10:06:22 +02:00
Markus Heiser
fe6470cbe6 [pylint] disable consider-using-f-string in .pylintrc 
Pylint 2.11 added [1][2]

consider-using-f-string:
  Emitted when .format() or '%' is being used to format a string.

We're not ready to enforce f-strings everywhere, so just disable this new
warning.

[1] https://pylint.pycqa.org/en/latest/whatsnew/2.11.html
[2] https://github.com/PyCQA/pylint/issues/3592

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-17 09:22:11 +02:00
dependabot[bot]
4570865ccf
Bump sphinx from 4.1.2 to 4.2.0 
Bumps [sphinx](https://github.com/sphinx-doc/sphinx) from 4.1.2 to 4.2.0.
- [Release notes](https://github.com/sphinx-doc/sphinx/releases)
- [Changelog](https://github.com/sphinx-doc/sphinx/blob/4.x/CHANGES)
- [Commits](https://github.com/sphinx-doc/sphinx/compare/v4.1.2...v4.2.0)

---
updated-dependencies:
- dependency-name: sphinx
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-09-17 07:05:07 +00:00
dependabot[bot]
cfef47f682
Bump pylint from 2.10.2 to 2.11.1 
Bumps [pylint](https://github.com/PyCQA/pylint) from 2.10.2 to 2.11.1.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Changelog](https://github.com/PyCQA/pylint/blob/main/ChangeLog)
- [Commits](https://github.com/PyCQA/pylint/compare/v2.10.2...v2.11.1)

---
updated-dependencies:
- dependency-name: pylint
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2021-09-17 07:05:02 +00:00
Alexandre Flament
602cbc2c99
Merge pull request #297 from dalf/engine-logger-enh 
debug mode: more readable logging
 2021-09-14 07:06:28 +02:00
Markus Heiser
aba3566fbd
Merge pull request #318 from return42/fix-doc-brand 
[brand] docs - normalize project name to SearXNG
 2021-09-13 12:40:47 +00:00
Markus Heiser
ecb7e73e03 [brand] docs - normalize project name to SearXNG 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-13 14:36:24 +02:00
Markus Heiser
de5a8ee7d7 [fix] settings - displayed name is SearXNG 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-13 14:36:24 +02:00
Alexandre Flament
823a2fc792
Merge pull request #317 from return42/fix-manage-usage 
[fix] manage help(): commands babel.* has been renamed to weblate.*
 2021-09-13 09:09:48 +02:00
Markus Heiser
97acedd9fe
Merge pull request #305 from dalf/fix-engine-logger 
[fix] logger per engine: make .logger is always initialized
 2021-09-13 07:03:37 +00:00
Alexandre Flament
f8793fbda0 [fix] logger per engine: make .logger is always initialized 
the openstreetmap engine imports code from the wikidata engine.
before this commit, specific code make sure to copy the logger variable to the wikidata engine.

with this commit searx.engines.load_engine makes sure the .logger is initialized.
The implementation scans sys.modules for module name starting with searx.engines.
 2021-09-13 08:47:59 +02:00
Markus Heiser
3f2c10ef9c [fix] manage help(): commands babel.* has been renamed to weblate.* 
In commit 97355672c the functions named babel.* has been renamed to weblate.*
but it was forgotten to change it also in the help().

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-12 15:46:00 +02:00
Markus Heiser
c3473480f4
Merge pull request #314 from MrPaulBlack/engine-stats-link 
Engine stats link
 2021-09-12 09:11:12 +00:00
MrPaulBlack
644ccf16be [theme] make engine stats clickable 2021-09-12 10:52:15 +02:00
MrPaulBlack
48d4296caa [theme] link to engine stats in footer 2021-09-12 10:37:21 +02:00
Markus Heiser
ecd6ca86d0
Merge pull request #308 from dalf/plugin_hostname_replace 
[enh] add hostname_replace plugin
 2021-09-12 07:53:09 +00:00
Alexandre Flament
0f43b39eac [enh] add hostname_replace plugin 
* backport of https://github.com/searx/searx/pull/2724
* allow to remove result if the replacement is the boolean value false
 2021-09-11 13:23:06 +02:00
Alexandre Flament
2de95af923
Merge pull request #313 from dalf/fix-pr-257 
[fix] PR #257: use the image_proxy network instead of the default network
 2021-09-11 11:22:29 +02:00
Alexandre Flament
2b53d718e4 [fix] PR #257: use the image_proxy network instead of the default network 2021-09-11 11:15:51 +02:00
Alexandre Flament
6abc37efc7 [mod] production mode: make sure to set the log level to WARNING 
set:
* the root logger level to WARNING
* the werkzeug logger level to WARNING (useful when there is no uwsgi)
 2021-09-11 10:13:16 +02:00
Alexandre Flament
0e42db9da1 [mod] xpath engine: remove logging of the requested URL 2021-09-11 10:13:16 +02:00
Alexandre Flament
91a6d80e82 [mod] debug mode: log HTTP requests with network name 
For example wikipedia requests use the logger name "searx.network.wikipedia"

Log is disable when searx_debug is False
 2021-09-11 10:13:14 +02:00
Alexandre Flament
577998106a [mod] debug mode: use coloredlogs package 
in debug mode, add some padding to make the output more readable
in procution mode, add the timestamp
 2021-09-10 21:49:34 +02:00
Alexandre Flament
b513917ef9 [mod] searx.metrics & searx.search: use the engine loggers 
metrics & processors use the engine logger
 2021-09-10 21:49:34 +02:00
Markus Heiser
76e0f6807c
Merge pull request #311 from dalf/fix-pr-302 
[fix] searx/results.py: strip result['content'] only if it exists
 2021-09-10 16:10:33 +00:00
Alexandre Flament
d9658a7f91 [fix] searx/results.py: strip result['content'] only if it exists 
fix PR #302
 2021-09-10 17:58:19 +02:00
Markus Heiser
13a4d20e8d
Merge pull request #306 from dalf/docs-brand 
[doc] searxng brand
 2021-09-10 15:42:20 +00:00
Alexandre Flament
75daef8986
Merge pull request #309 from searxng/ci-python-3.10.0-rc.2 
[ci] add Python 3.10.0-rc.2
 2021-09-10 13:20:41 +02:00
Alexandre Flament
ca73a37679
[ci] add Python 3.10.0-rc.2 2021-09-10 13:13:49 +02:00
Alexandre Flament
4833d85e2e [doc] update copyright notice and HTML title 2021-09-10 11:49:57 +02:00
Markus Heiser
b671e0364f
Merge pull request #302 from dalf/mod_plugin_on_result 
[mod] plugin: call on_result for each result of each engines.
 2021-09-10 09:20:26 +00:00
Alexandre Flament
0b27c8698f [doc] update docs/dev/plugins.rst 2021-09-10 10:58:22 +02:00
Markus Heiser
449ff70898
Merge pull request #307 from dalf/remove-transifex-ref 
[fix] remove references to transifex
 2021-09-10 07:14:07 +00:00
Alexandre Flament
70c9bb6f2c [fix] remove references to transifex 2021-09-09 21:29:55 +02:00
Alexandre Flament
b941763e20 [mod] ahmia_filter: use on_result instead of post_search 
see commit 6c9ae7911e9639bc46cd53af215734b4bdb61ba9
 2021-09-09 11:31:46 +02:00
Alexandre Flament
660c180170 [mod] plugin: call on_result after each engine from the ResultContainer 
Currently, searx.search.Search calls on_result once the engine results have been merged
(ResultContainer.order_results).

on_result plugins can rewrite the results: once the URL(s) are modified, even they can be merged,
it won't be the case since ResultContainer.order_results has already be called.

This commit call on_result inside for each result of each engines.
In addition the on_result function can return False to remove the result.

Note: the on_result function now run on the engine thread instead of the Flask thread.
 2021-09-09 11:31:44 +02:00
Alexandre Flament
1973e4ecf6
Merge pull request #303 from return42/fix-README 
[fix] README - fix minor typo
 2021-09-08 09:39:45 +02:00
Markus Heiser
dad82cac1a [fix] README - fix minor typo 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-09-08 09:00:48 +02:00