kamp/searxng
1
0
Fork 0
mirror of https://github.com/searxng/searxng.git synced 2024-11-22 20:17:45 +01:00
Code
8adbc4fcec
searxng/searx/engines
History
Markus Heiser 27369ebec2 [fix] searxng_extra/update/update_engine_descriptions.py (part 1) 
Follow up of #2269

The script to update the descriptions of the engines does no longer work since
PR #2269 has been merged.

searx/engines/wikipedia.py
==========================

1. There was a misusage of zh-classical.wikipedia.org:

   - `zh-classical` is dedicate to classical Chinese [1] which is not
     traditional Chinese [2].

   - zh.wikipedia.org has LanguageConverter enabled [3] and is going to
     dynamically show simplified or traditional Chinese according to the
     HTTP Accept-Language header.

2. The update_engine_descriptions.py needs a list of all wikipedias.  The
   implementation from #2269 included only a reduced list:

   - https://meta.wikimedia.org/wiki/Wikipedia_article_depth
   - https://meta.wikimedia.org/wiki/List_of_Wikipedias

searxng_extra/update/update_engine_descriptions.py
==================================================

Before PR #2269 there was a match_language() function that did an approximation
using various methods.  With PR #2269 there are only the types in the data model
of the languages, which can be recognized by babel.  The approximation methods,
which are needed (only here) in the determination of the descriptions, must be
replaced by other methods.

[1] https://en.wikipedia.org/wiki/Classical_Chinese
[2] https://en.wikipedia.org/wiki/Traditional_Chinese_characters
[3] https://www.mediawiki.org/wiki/Writing_systems#LanguageConverter

Closes: https://github.com/searxng/searxng/issues/2330
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-04-15 16:03:59 +02:00
..
__init__.py [mod] clarify the difference of the default category and subgrouping 2023-04-07 11:03:25 +02:00
9gag.py get the not cropped version of the thumbnail when the image height is not too important 2022-08-24 18:33:11 +07:00
1337x.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
ahmia.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
apkmirror.py rollback test 2023-03-15 19:55:20 +01:00
apple_app_store.py remove thumbnail from results 2022-08-27 06:23:30 +07:00
apple_maps.py add poi's website and phone number, doesn't crash when there is no displayMapRegion, query the token on the first request 2022-08-27 06:17:58 +07:00
archlinux.py [mod] Archlinux Wiki: improved request API & upgrade to data_type: traits_v1 2023-03-24 10:37:42 +01:00
artic.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
arxiv.py Science category: update the engines 2022-09-23 20:45:58 +02:00
bandcamp.py [mod] bandcamp & genius: in result set img_src instead thumbnail 2022-02-21 22:12:07 +01:00
base.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
bing_images.py [mod] bing_images: use async API & upgrade to data_type: traits_v1 2023-03-24 10:37:42 +01:00
bing_news.py [mod] bing_news: use async API & upgrade to data_type: traits_v1 2023-03-24 10:37:42 +01:00
bing_videos.py [mod] bing_videos: use async API & upgrade to data_type: traits_v1 2023-03-24 10:37:42 +01:00
bing.py [fix] Bing-WEB: use <span class='algoSlug_icon'> for the description 2023-04-08 09:43:04 +02:00
btdigg.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
command.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
core.py [fix] doc of the paper.html template (isbn, issn) 2022-09-25 15:46:29 +02:00
crossref.py [mod] make python code pylint 2.16.1 compliant 2023-02-10 13:59:21 +01:00
currency_convert.py [pylint] engines/currency_convert.py 2022-02-01 08:02:42 +01:00
dailymotion.py [mod] Dailymotion: improved request API & upgrade to data_type: traits_v1 2023-03-24 10:37:42 +01:00
deepl.py [mod] add deepl translation engine 2022-08-10 09:14:36 +02:00
deezer.py [mod] templates: rename field for <iframe> URL to iframe_src 2022-02-18 19:00:49 +01:00
demo_offline.py [mod] replace engines_languages.json by engines_traits.json 2023-03-24 10:37:42 +01:00
demo_online.py [mod] add 'Accept-Language' HTTP header to online processores 2022-08-01 17:01:59 +02:00
deviantart.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
dictzone.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
digbt.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
docker_hub.py [mod] make python code pylint 2.16.1 compliant 2023-02-10 13:59:21 +01:00
doku.py [fix] issues reported by pylint 2021-12-27 10:16:20 +01:00
duckduckgo_definitions.py [mod] DuckDuckGo: reversed engineered & upgrade to data_type: traits_v1 2023-03-24 10:37:42 +01:00
duckduckgo_images.py [mod] DuckDuckGo: reversed engineered & upgrade to data_type: traits_v1 2023-03-24 10:37:42 +01:00
duckduckgo_weather.py [mod] clarify the difference of the default category and subgrouping 2023-04-07 11:03:25 +02:00
duckduckgo.py [fix] engine ddg: quote !bangs in a request send to ddg 2023-04-03 09:52:16 +02:00
duden.py [fix] engine duden - don't raise exception on empty result list 2022-08-20 08:41:03 +02:00
dummy-offline.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
dummy.py [enh] engines: add about variable 2021-01-14 20:57:17 +01:00
ebay.py [mod] Pass desired ebay domain in settings 2022-04-16 19:10:35 +02:00
elasticsearch.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
emojipedia.py [fix] emojipedia - update XPath to be relative 2022-07-24 19:14:26 +02:00
fdroid.py [enh] add more categories 2022-01-05 11:00:11 +01:00
flickr_noapi.py [fix] engine flickr: adapt to the new data model from flicker's response 2023-03-30 21:04:53 +02:00
flickr.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
framalibre.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
freesound.py [mod] result_templates/default.html replace embedded HTML by data_src audio_src 2022-02-13 14:20:47 +01:00
frinkiac.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
genius.py [mod] bandcamp & genius: in result set img_src instead thumbnail 2022-02-21 22:12:07 +01:00
gentoo.py [mod] remove obsolete EngineTraits.supported_languages 2023-03-24 10:37:42 +01:00
github.py [fix] typos / reported by @kianmeng in searx PR-3366 2022-09-27 18:32:14 +02:00
google_images.py [mod] Google: reversed engineered & upgrade to data_type: traits_v1 2023-03-24 10:37:42 +01:00
google_news.py [fix] engine google-News: fix decoding of URLs (part 2) 2023-04-02 19:19:59 +02:00
google_play_apps.py [mod] add 'Accept-Language' HTTP header to online processores 2022-08-01 17:01:59 +02:00
google_scholar.py [mod] Google: reversed engineered & upgrade to data_type: traits_v1 2023-03-24 10:37:42 +01:00
google_videos.py [mod] Google: reversed engineered & upgrade to data_type: traits_v1 2023-03-24 10:37:42 +01:00
google.py [fix] engine: google has changed the layout of its response 2023-03-28 14:39:16 +02:00
imdb.py [enh] move dictionaries, Erowid & IMDb out of general category 2022-01-05 11:03:44 +01:00
ina.py [fix] ina engine 2022-01-28 22:33:41 +01:00
invidious.py [mod] templates: rename field for <iframe> URL to iframe_src 2022-02-18 19:00:49 +01:00
jisho.py [format.python] based on bugfix in 9ed626130 2022-05-07 18:23:10 +02:00
json_engine.py [enh] Initial no paging support for Yep.com 2022-06-11 14:17:44 +02:00
kickass.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
lingva.py [mod] Adds Lingva translate engine 2022-07-04 19:06:45 +02:00
loc.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
mediathekviewweb.py [fix] engine mediathekviewweb: replace http links by https 2022-03-07 19:49:16 +01:00
mediawiki.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
meilisearch.py [pylint] engines: drop no longer needed 'missing-function-docstring' 2021-09-07 13:26:59 +02:00
metacpan.py Add MetaCPAN engine 2022-11-07 08:07:06 -06:00
mixcloud.py [mod] add artwork to mixcloud & soundcloud engines 2022-02-19 21:59:12 +01:00
mongodb.py [fix] pyright repported errors 2022-07-30 18:04:44 +02:00
mysql_server.py [fix] pyright repported errors 2022-07-30 18:04:44 +02:00
nyaa.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
opensemantic.py [enh] engines: add about variable 2021-01-14 20:57:17 +01:00
openstreetmap.py [mod] add 'Accept-Language' HTTP header to online processores 2022-08-01 17:01:59 +02:00
openverse.py [fix] ccengine engine - avoid unwanted redirects 2022-01-07 14:14:31 +01:00
pdbe.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
peertube.py [mod] Peertube: re-engineered & upgrade to data_type: traits_v1 2023-03-24 10:37:42 +01:00
petal_images.py [enh] Initial Petalsearch Images support 2022-06-02 14:32:37 +02:00
photon.py [fix] typos / reported by @kianmeng in searx PR-3366 2022-09-27 18:32:14 +02:00
piratebay.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
postgresql.py [fix] pyright repported errors 2022-07-30 18:04:44 +02:00
pubmed.py Science category: update the engines 2022-09-23 20:45:58 +02:00
qwant.py [mod] qwant: fetch engine traits (data_type: traits_v1) 2023-03-24 10:37:42 +01:00
recoll.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
reddit.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
redis_server.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
rumble.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
scanr_structures.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
searchcode_code.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
searx_engine.py reference docs.searxng.org 2022-01-02 21:18:29 +01:00
semantic_scholar.py [mod] science category: various update of about PR 1705 2022-09-23 20:52:55 +02:00
sepiasearch.py [mod] SepiaSearch: re-engineered & upgrade to data_type: traits_v1 2023-03-24 10:37:42 +01:00
seznam.py [fix] engine seznam: fix issues reported by black & pylint 2023-03-31 17:25:39 +02:00
sjp.py [fix] sjp engine - convert enginename to a latin1 compliance name 2022-07-24 21:10:55 +02:00
solidtorrents.py [fix] solidtorrents engine: store random bas_url in param 2022-02-04 14:55:21 +01:00
solr.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
soundcloud.py [mod] add artwork to mixcloud & soundcloud engines 2022-02-19 21:59:12 +01:00
spotify.py [mod] templates: rename field for <iframe> URL to iframe_src 2022-02-18 19:00:49 +01:00
springer.py [fix] springer: unsupported operand type(s) for +: 'NoneType' and 'str' 2022-09-25 15:25:55 +02:00
sqlite.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
stackexchange.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
startpage.py [mod] Startpage: reversed engineered & upgrade to data_type: traits_v1 2023-03-24 10:37:42 +01:00
tineye.py [fix] engine tineye: handle 422 response of not supported img format 2022-07-23 16:00:58 +02:00
tokyotoshokan.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
torznab.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
translated.py [enh] move dictionaries, Erowid & IMDb out of general category 2022-01-05 11:03:44 +01:00
twitter.py add explanation of token 2022-08-17 19:45:42 +07:00
unsplash.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
vimeo.py [mod] templates: rename field for <iframe> URL to iframe_src 2022-02-18 19:00:49 +01:00
wikidata.py [fix] searxng_extra/update/update_engine_descriptions.py (part 1) 2023-04-15 16:03:59 +02:00
wikipedia.py [fix] searxng_extra/update/update_engine_descriptions.py (part 1) 2023-04-15 16:03:59 +02:00
wolframalpha_api.py [fix] typos / reported by @kianmeng in searx PR-3366 2022-09-27 18:32:14 +02:00
wolframalpha_noapi.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
wordnik.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
wttr.py [mod] clarify the difference of the default category and subgrouping 2023-04-07 11:03:25 +02:00
www1x.py [fix] 1x engine 2022-01-30 19:48:40 +01:00
xpath.py [fix] typos / reported by @kianmeng in searx PR-3366 2022-09-27 18:32:14 +02:00
yacy.py [format.python] initial formatting of the python code 2021-12-27 09:26:22 +01:00
yahoo_news.py [fix] issues reported by pylint 2021-12-27 10:16:20 +01:00
yahoo.py [mod] yahoo: fetch engine traits (data_type: traits_v1) 2023-03-24 10:37:42 +01:00
youtube_api.py [mod] templates: rename field for <iframe> URL to iframe_src 2022-02-18 19:00:49 +01:00
youtube_noapi.py [fix] google & youtube - set EU consent cookie 2022-07-25 13:27:06 +02:00
zlibrary.py [fix] engine z-zlibrary https URL 2022-07-05 22:27:55 +02:00