kamp/searxng
1
0
Fork 0
mirror of https://github.com/searxng/searxng.git synced 2024-11-22 20:17:45 +01:00
Code
7,486 Commits 6 Branches 17 Tags 134 MiB
3568a3cafb
Commit Graph

7486 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
searxng-bot
7850c77c2c [translations] update from Weblate 
d2fb466c - 2023-04-02 - return42 <markus.heiser@darmarit.de>
5576f597 - 2023-04-02 - return42 <markus.heiser@darmarit.de>
4b28cab9 - 2023-03-31 - Vistaus <vistausss@fastmail.com>
 2023-04-07 07:07:51 +00:00
Markus Heiser
f46d0584ef
Merge pull request #2322 from return42/fix-2321 
[fix] Gigablast.com has been erased
 2023-04-06 23:49:58 +02:00
Markus Heiser
64e221426a
Merge pull request #2312 from return42/fix-1020-part-2 
[fix] categories can't be removed from UI (categories_as_tabs)
 2023-04-06 10:36:51 +02:00
Markus Heiser
5234e45010 [fix] Gigablast.com has been erased 
[1] https://www.reddit.com/r/searchengines/comments/128wdcp/gigablastcom_has_been_erased/

Closes: https://github.com/searxng/searxng/issues/2321
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-06 08:22:57 +02:00
Markus Heiser
934249dd05
Merge pull request #2315 from return42/fix-2314 
[fix] ./manage: replace data.languages by data.traits
 2023-04-05 07:53:41 +02:00
Markus Heiser
cd26f3ea2f [fix] ./manage: replace data.languages by data.traits 
Follow up of https://github.com/searxng/searxng/pull/2269

Related:

- https://github.com/searxng/searxng/issues/2314

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-05 07:44:29 +02:00
Markus Heiser
3ab85db5dd
Merge pull request #2313 from return42/limiter-route-healthz 
[fix] limiter: never block a /healthz request
 2023-04-03 19:42:26 +02:00
Markus Heiser
03f94962b6 [fix] limiter: never block a /healthz request 
Related: https://github.com/searxng/searxng/issues/2310#issuecomment-1494417531
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-03 19:36:28 +02:00
Markus Heiser
0c4003ab2d [fix] categories can't be removed from UI (categories_as_tabs) 
When using ``use_default_settings: true``, removing default categories from
settings.yml will not remove them from the UI.

The value ``categories_as_tabs`` is a dictionary type (a4c2cfb) and dictionary
types are merged additive by ``settings_loader.update_settings()``.

This patch replaces the default ``categories_as_tabs`` by the one from the
``user_settings``.

Related: https://github.com/searxng/searxng/issues/1019#issuecomment-1193145654
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-03 19:08:27 +02:00
Markus Heiser
464e69665c
Merge pull request #2309 from return42/fix-392 
[fix] engine ddg: quote !bangs in a request send to ddg
 2023-04-03 09:59:16 +02:00
Markus Heiser
a762172bf7 [fix] engine ddg: quote !bangs in a request send to ddg 
Closes: https://github.com/searxng/searxng/issues/392
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-03 09:52:16 +02:00
Markus Heiser
b8100e4e16
Merge pull request #2308 from return42/fix-1959-2 
[fix] engine google-News: fix decoding of URLs (part 2)
 2023-04-02 19:25:10 +02:00
Markus Heiser
0430662189 [fix] engine google-News: fix decoding of URLs (part 2) 
Follow up of 8de8070ed to fix the issue reported by AlyoshaVasilieva [1].

[1] https://github.com/searxng/searxng/issues/1959#issuecomment-1493300574

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-02 19:19:59 +02:00
Markus Heiser
a5155a32c0
Merge pull request #2306 from return42/fix-1959 
[fix] engine google-News: fix decoding of URLs
 2023-04-02 08:02:37 +02:00
Paul Braeuning
24dba7634e
Merge pull request #2304 from return42/limiter-mod 
[mod] limiter: minor improvements
 2023-04-01 21:55:13 +02:00
Markus Heiser
66810ce711 [mod] limiter: minor improvements 
- requests without HTTP header 'Connection' or missing 'User-Agent' will be
  blocked by the limiter

- re_bot is related to 'User-Agent' and has been renamed to block_user_agent

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-01 19:42:49 +02:00
Markus Heiser
8de8070ed9 [fix] engine google-News: fix decoding of URLs 
Google-News returns internal links where the origin URL is encoded in a
base64 (RFC 2045 aka URL-safe) string.

Closes: https://github.com/searxng/searxng/issues/1959
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-01 19:33:13 +02:00
Markus Heiser
7592d85982
Merge pull request #2186 from return42/limiter-debug-log 
[mod] plugin limiter: improve the log messages
 2023-04-01 10:11:17 +02:00
Markus Heiser
afd8fcce36 [mod] plugin limiter: improve the log messages 
In debug mode more detailed logging is needed to evaluate if an access should
have been blocked by the limiter.

BTW: remove duplicate code checking bot signature ``re_bot.match(user_agent)``

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-04-01 09:20:58 +02:00
Markus Heiser
901ccce664
Merge pull request #2303 from Venca24/devel_seznam 
[fix] engine seznam
 2023-03-31 17:33:09 +02:00
Markus Heiser
509afbbb84 [fix] engine seznam: fix issues reported by black & pylint 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-31 17:25:39 +02:00
Venca24
c8d78355ff [fix] engine seznam 2023-03-31 16:11:27 +02:00
Markus Heiser
27611470bf
Merge pull request #2300 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/sharp-0.32.0 
Bump sharp from 0.31.3 to 0.32.0 in /searx/static/themes/simple
 2023-03-31 14:48:25 +02:00
dependabot[bot]
b99e028ed0
Bump sharp from 0.31.3 to 0.32.0 in /searx/static/themes/simple 
Bumps [sharp](https://github.com/lovell/sharp) from 0.31.3 to 0.32.0.
- [Release notes](https://github.com/lovell/sharp/releases)
- [Changelog](https://github.com/lovell/sharp/blob/main/docs/changelog.md)
- [Commits](https://github.com/lovell/sharp/compare/v0.31.3...v0.32.0)

---
updated-dependencies:
- dependency-name: sharp
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-31 11:39:17 +00:00
Markus Heiser
68703ba22e
Merge pull request #2282 from searxng/dependabot/npm_and_yarn/searx/static/themes/simple/master/ionicons-7.1.0 
Bump ionicons from 6.1.3 to 7.1.0 in /searx/static/themes/simple
 2023-03-31 13:36:12 +02:00
Markus Heiser
7e0e461aa1
Merge pull request #2298 from searxng/dependabot/pip/master/redis-4.5.4 
Bump redis from 4.5.1 to 4.5.4
 2023-03-31 13:25:25 +02:00
Markus Heiser
f3b8e5734b
Merge pull request #2299 from searxng/dependabot/pip/master/selenium-4.8.3 
Bump selenium from 4.8.2 to 4.8.3
 2023-03-31 13:12:57 +02:00
dependabot[bot]
615c8ebcfd
Bump selenium from 4.8.2 to 4.8.3 
Bumps [selenium](https://github.com/SeleniumHQ/Selenium) from 4.8.2 to 4.8.3.
- [Release notes](https://github.com/SeleniumHQ/Selenium/releases)
- [Commits](https://github.com/SeleniumHQ/Selenium/commits)

---
updated-dependencies:
- dependency-name: selenium
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-31 07:56:56 +00:00
dependabot[bot]
ec5739bec9
Bump redis from 4.5.1 to 4.5.4 
Bumps [redis](https://github.com/redis/redis-py) from 4.5.1 to 4.5.4.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/v4.5.1...v4.5.4)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-31 07:56:50 +00:00
Markus Heiser
a9680f0f75
Merge pull request #2297 from searxng/translations_update 
Update translations
 2023-03-31 09:24:58 +02:00
searxng-bot
c1c24fc231 [translations] update from Weblate 
17ad1118 - 2023-03-29 - return42 <markus.heiser@darmarit.de>
61446791 - 2023-03-29 - return42 <markus.heiser@darmarit.de>
 2023-03-31 07:07:59 +00:00
Markus Heiser
0311d634ae
Merge pull request #2296 from return42/fix-1879 
[fix] engine flickr: adapt to the new data model from flicker's response
 2023-03-30 21:21:05 +02:00
Markus Heiser
270ad18897 [fix] engine flickr: adapt to the new data model from flicker's response 
Closes: https://github.com/searxng/searxng/issues/1879
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-30 21:04:53 +02:00
Markus Heiser
767f22eca1
Merge pull request #2293 from return42/fix-1454 
[fix] engine gigablast: add &userid=<User ID>&code=<Feed Code>
 2023-03-29 17:50:40 +02:00
Markus Heiser
2b8dfab33f [fix] engine gigablast: add &userid=<User ID>&code=<Feed Code> 
Gigablast's API does block unauthorized request[1].

[1] https://gigablast.com/searchfeed.html

Closes: https://github.com/searxng/searxng/issues/1454
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-29 16:18:02 +02:00
Markus Heiser
d179b62cf5
Merge pull request #2288 from searxng/update_data_update_firefox_version.py 
Update searx.data - update_firefox_version.py
 2023-03-29 13:48:32 +02:00
Markus Heiser
381c6751d6
Merge pull request #2289 from searxng/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2023-03-29 13:48:03 +02:00
Markus Heiser
fc51d9a0fe
Merge pull request #2291 from searxng/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2023-03-29 13:46:40 +02:00
Markus Heiser
2fbe4ab0c0
Merge pull request #2292 from searxng/update_data_update_engine_descriptions.py 
Update searx.data - update_engine_descriptions.py
 2023-03-29 13:46:14 +02:00
Markus Heiser
f950119ca8
Merge pull request #2269 from return42/locale-revision 
Revision of the locale- and language- handling in SearXNG
 2023-03-29 09:47:21 +02:00
dalf
4c80340b62 Update searx.data - update_engine_descriptions.py 2023-03-29 00:28:45 +00:00
dalf
b39ce7ff82 Update searx.data - update_currencies.py 2023-03-29 00:16:21 +00:00
dalf
814ac8cacb Update searx.data - update_ahmia_blacklist.py 2023-03-29 00:16:17 +00:00
dalf
43d30cab81 Update searx.data - update_firefox_version.py 2023-03-29 00:16:14 +00:00
Markus Heiser
6f9e678346 [fix] engine: google has changed the layout of its response 
Since 28. March google has changed its response, this patch fixes the google
engine to scrap out the results & images from the new designed response.

closes: https://github.com/searxng/searxng/issues/2287

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-28 14:39:16 +02:00
dalf
1498202b0b Update searx.data - update_engine_traits.py 2023-03-24 11:30:18 +01:00
dependabot[bot]
212de1a0f5 Bump babel from 2.11.0 to 2.12.1 
Bumps [babel](https://github.com/python-babel/babel) from 2.11.0 to 2.12.1.
- [Release notes](https://github.com/python-babel/babel/releases)
- [Changelog](https://github.com/python-babel/babel/blob/master/CHANGES.rst)
- [Commits](https://github.com/python-babel/babel/compare/v2.11.0...v2.12.1)

---
updated-dependencies:
- dependency-name: babel
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2023-03-24 11:26:15 +01:00
Markus Heiser
16f0db4493 [mod] replace utils.match_language by locales.match_locale 
This patch replaces the *full of magic* ``utils.match_language`` function by a
``locales.match_locale``.  The ``locales.match_locale`` function is based on the
``locales.build_engine_locales`` introduced in 9ae409a0 [1].

In the past SearXNG did only support a search by a language but not in a region.
This has been changed a long time ago and regions have been added to SearXNG
core but not to the engines.  The ``utils.match_language`` was the function to
handle the different aspects of language/regions in SearXNG core and the
supported *languages* in the engine.  The ``utils.match_language`` did it with
some magic and works good for most use cases but fails in some edge case.

To replace the concurrence of languages and regions in the SearXNG core the
``locales.build_engine_locales`` was introduced in 9ae409a0 [1].  With the last
patches all engines has been migrated to a ``fetch_traits`` and a
language/region concept that is based on ``locales.build_engine_locales``.

To summarize: there is no longer a need for the ``locales.match_language``.

[1] https://github.com/searxng/searxng/pull/1652

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
4d4aa13e1f [mod] remove obsolete EngineTraits.supported_languages 
All engines has been migrated from ``supported_languages`` to the
``fetch_traits`` concept.  There is no longer a need for the obsolete code that
implements the ``supported_languages`` concept.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00
Markus Heiser
96a2eec3b5 [mod] Archlinux Wiki: improved request API & upgrade to data_type: traits_v1 
re-implementation of the Archlinux Wiki:

- fetch_traits(): fetch languages, wiki URLs and title arguments
- add content field to the result list
- add documentation

Wikis from wiki.archlinux.fr, wiki.archlinux.ro, archtr.org/wiki do no longer
exists (has been merged in the main wiki).

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2023-03-24 10:37:42 +01:00