Finn Steffens
9e2bfe14db
[feat] engine: add right dao
...
* [feat] engine: add right dao
* [enh] right dao engine: allow additional classes
Allow additional classes while parsing to prevent the engine from breaking in the future if additional classes are added to the elements.
Co-authored-by: Bnyro <bnyro@tutanota.com>
---------
Co-authored-by: Bnyro <bnyro@tutanota.com>
2024-09-12 17:51:47 +02:00
Lucas Schwiderski
f05566d925
[fix] json_engine: Fix result fields being mixed up
...
Fixes #3810 .
2024-09-12 10:47:08 +02:00
0xhtml
c45870dd71
[fix] yep engine: remove links to other engines
...
Yep includes links to search for the same query on Google and other
search engines as a result in the search result. This fix skips these
results.
2024-09-12 00:04:04 +02:00
searxng-bot
5cca3f6ef2
[l10n] update translations from Weblate
...
cab91b92cbbc77a9c416ab61e9934b1487b6811132898099cb381eeebb940df50c845d17f12addf27c0879d3777732d1356dbe33cfb1759dacddd7607b9ac6aab0df3e7f9232fbd6f3a339dac4f3bdb5c9fb92cc42dd6412e0c6e1f6103fd4ee95b7f284e4641d5
2024-09-06 11:04:20 +02:00
Markus Heiser
9eda4044be
[fix] bilibili engine - ValueError in duration & HTML in title
...
- ValueError in duration: issue reported in #3799
- HTML in title: related to #3770
[#3799 ] https://github.com/searxng/searxng/issues/3799
[#3770 ] https://github.com/searxng/searxng/pull/3770
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-09-06 07:13:47 +02:00
Markus
21bfb4996e
[fix] engine yahoo: HTML tags are included in result titles
...
- https://github.com/searxng/searxng/issues/3790
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-09-03 22:26:59 +02:00
Bnyro
94a1f39bde
[engine] bahnhof.de: remove engine
2024-09-03 18:52:54 +02:00
Markus Heiser
b774ee04ba
[mod] enable calculator and allow plugin on public instances
...
Remove quirks that prevented the Calculator from being used on public instances.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-09-03 18:36:28 +02:00
Markus Heiser
3a3ff8f020
[mod] hardening "calculator plugin" / limit execution time to 50 ms
...
The execution of the function for the calculation is outsourced to a process
whose runtime is limited to 50 milliseconds.
Related:
- [1] https://github.com/searxng/searxng/pull/3377#issuecomment-2067977375
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-09-03 18:36:28 +02:00
Bnyro
7d9d5186a0
[build] /static
...
Co-authored-by: GenericMale <genericmale00@gmail.com>
2024-09-03 17:49:33 +02:00
GenericMale
e65edb141d
[feat] results: show response times
2024-09-03 17:49:33 +02:00
Brock Vojkovic
b09aa7e360
[fix] correct typo in API_WONDOW to API_WINDOW
2024-09-01 08:37:24 +02:00
Bnyro
5e576b2238
[fix] search: titles including html brackets are not shown properly
2024-08-31 17:11:49 +02:00
Alexander Sulfrian
e86c96974d
[fix] self_info: request.user_agent is not a str
...
The user_agent attribute of the Flask request object is an instance of
the werkzeug.user_agent.UserAgent class.
This will fix the following error of the self_info plugin:
> ERROR:searx.plugins.self_info: Exception while calling post_search
> Traceback (most recent call last):
> File "searx/plugins/__init__.py", line 203, in call
> ret = getattr(plugin, plugin_type)(*args, **kwargs)
> File "searx/plugins/self_info.py", line 31, in post_search
> search.result_container.answers['user-agent'] = {'answer': gettext('Your user-agent is: ') + ua}
> TypeError: can only concatenate str (not "UserAgent") to str
2024-08-30 11:29:34 +02:00
searxng-bot
b05e285384
[l10n] update translations from Weblate
...
085dc9e17b75bb12dc7b1392ff2
2024-08-30 10:05:24 +02:00
Alexander Sulfrian
6a7b1a1a57
[fix] Do not show DDG user-agent from zero click
...
We do not want to show the user-agent information from the duckduckgo
zero click info. This is the user-agent used by searxng and not the
user-agent used by the user.
This was already done for the IP address in:
0fb3f0e4ae
2024-08-30 09:02:37 +02:00
return42
526428a69b
[data] update searx.data - update_ahmia_blacklist.py
2024-08-29 17:49:14 +02:00
return42
d6ee8f38dd
[data] update searx.data - update_wikidata_units.py
2024-08-29 17:48:59 +02:00
return42
d72fbcfd46
[data] update searx.data - update_firefox_version.py
2024-08-29 17:48:25 +02:00
return42
f44775c05a
[data] update searx.data - update_engine_descriptions.py
2024-08-29 17:48:09 +02:00
return42
71451e5770
[data] update searx.data - update_currencies.py
2024-08-29 17:47:47 +02:00
GenericMale
8289436e55
[fix] search: don't show categories without active engine
2024-08-28 14:27:03 +02:00
searxng-bot
4f7dd05d99
[l10n] update translations from Weblate
...
1b63de5ca7c738125f
2024-08-23 12:21:02 +02:00
Dennis ten Hoove
2033f30c8d
[docs] improve Hostname plugin documentation
2024-08-21 14:28:04 +02:00
Austin-Olacsi
e45b771ffa
[feat] engine: implementation of yandex (web, images)
...
It's set to inactive in settings.yml because of CAPTCHA. You need to remove
that from the settings.yml to get in use.
Closes: https://github.com/searxng/searxng/issues/961
2024-08-21 12:08:35 +02:00
Grant Lanham
5276219b9d
Fix tineye engine url, datetime parsing, and minor refactor
...
Changes made to tineye engine:
1. Importing logging if TYPE_CHECKING is enabled
2. Remove unecessary try-catch around json parsing the response, as this
masked the original error and had no immediate benefit
3. Improve error handling explicitely for status code 422 and 400
upfront, deferring json_parsing only for these status codes and
successful status codes
4. Unit test all new applicable changes to ensure compatability
2024-08-21 08:41:53 +02:00
Markus Heiser
799d72e3fd
[mod] add French translation for infopage
...
The French translation was provided by @jcarnat in #3738 .
[3738] https://github.com/searxng/searxng/issues/3738
Co-authored-by: Joel Carnat @jcarnat https://github.com/jcarnat
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-08-20 07:25:39 +02:00
searxng-bot
c0369ee488
[l10n] update translations from Weblate
...
fff02429fb13279293fc7c2faa46697dad47e9ccc396df48553819d431b6c04b942a29c72f4d23a5aa4f47be87
2024-08-16 10:39:17 +02:00
Markus Heiser
8d14d46c00
[build] /static
2024-08-15 18:58:28 +02:00
Markus Heiser
45f03f1902
[fix] search box: clear button don't appear on mouse-copy
...
You have to copy and paste the query without using the keyboard to replicate the
issue. As soon as you press the keyboard the cross appears. [1]
- [1] https://github.com/searxng/searxng/issues/3725#issuecomment-2282655272
Reported-by: @Immortality-IMT in [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-08-15 18:58:28 +02:00
searxng-bot
f1c05e7c16
[l10n] update translations from Weblate
2024-08-09 09:50:24 +02:00
Markus Heiser
dcf95644c6
[breaking change] drop deprecated hostname_replace plugin
...
The successor is “hostname plugin” from PR:
- https://github.com/searxng/searxng/pull/3463
---
Revert "[refactor] hostnames plugin: add fallback for old hostname_replace plugin"
This reverts commit f5eb56b63f
2024-08-08 11:58:32 +02:00
0xhtml
0cfed94b08
[fix] engine google: use extract_text everywhere
2024-08-08 09:59:45 +02:00
0xhtml
7f9ce3b96e
[fix] engine google: strip bubble text from answers
...
Google underlines words inside of answers that can be clicked to show
additional definitions. These definitions inside the answer were not
correctly handled and ended up in the middle of the answer text. With
this fix, the extra definitions are stripped from the answer shown by
the frontend.
2024-08-08 09:59:45 +02:00
return42
e76a4f72ef
[data] update searx.data - update_external_bangs.py
2024-08-02 10:55:07 +02:00
searxng-bot
2f1f54f113
[l10n] update translations from Weblate
...
458a2234c615d49db616bfd767eccd38ad433820b926b11c302c50a588e2e3315ba3d4eba160c69b3fc9d877d461eaf70013c7e9cdfdbabce47c70b467dd7d
2024-08-02 10:53:04 +02:00
Markus Heiser
98c73010f1
[data] update searx.data - update_engine_traits.py
...
$ make data.traits
Last GH action has been failed [1], the bugfixes from aa05685cchttps://github.com/searxng/searxng/actions/runs/10135834050/job/28023757191
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-07-29 10:28:53 +02:00
Markus Heiser
edfd0e2fe5
[fix] brave fetch_traits: Brave added Chinese (zh-hant) to UI
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-07-29 10:28:53 +02:00
return42
3196e7e86b
[data] update searx.data - update_currencies.py
2024-07-29 07:02:52 +02:00
return42
7d47c961c3
[data] update searx.data - update_engine_descriptions.py
2024-07-29 07:01:39 +02:00
return42
ac51c77c33
[data] update searx.data - update_wikidata_units.py
2024-07-29 07:01:01 +02:00
return42
5cba412784
[data] update searx.data - update_ahmia_blacklist.py
2024-07-29 07:00:14 +02:00
return42
fff7792e32
[data] update searx.data - update_firefox_version.py
2024-07-29 07:00:00 +02:00
Markus Heiser
ee959ed9fc
[fix] engine geizhals: if there are no offers, there is no best price
...
Fault pattern: if there are no offers, then an exception has been thrown:
IndexError: list index out of range
This patch makes the addition of “best price” dependent on whether one exists.
Closes : #3685
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-07-28 19:00:51 +02:00
Markus Heiser
022898e502
[fix] fix issues in the language menue introduced by PR #3645
...
In my review of [1] I tried to reformat the template code of the language
menue whereby I have made two mistakes.
- default language was added twice
- in the 'Auto-detect' item a hard coded `[auto]` was implemented where the
`search_language` variable was needed.
[1] https://github.com/searxng/searxng/issues/3645
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-07-28 10:46:11 +02:00
Austin-Olacsi
9f47bdefc6
[feat] engine: implementation of encyclosearch
2024-07-28 10:45:51 +02:00
Markus Heiser
d7bb97b616
[fix] engine yacy images: increase timout from 3 to 5sec
...
Its a leftover from 657dcb97
2024-07-27 17:54:41 +02:00
Bnyro
80226ad6b7
[build] /static
2024-07-27 11:49:58 +02:00
Bnyro
304ddd8114
[feat] videos template: support for view count
2024-07-27 11:49:58 +02:00
Markus Heiser
3f22dbb68a
[fix] products template: don't quote html tags in result.content
...
The result.content field is *safe* HTML, tags to highlight search terms are
intended.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-07-27 11:46:25 +02:00
Bnyro
84abab0808
[feat] engine: implementation of geizhals.de
2024-07-27 11:46:25 +02:00
Markus Heiser
e31b06b686
[fix] remove unused code / _STORAGE_UNIT_VALUE
...
The `_STORAGE_UNIT_VALUE` dictionary is a left over from:
- https://github.com/searxng/searxng/pull/3570
in this PR we removed the old implementations but forgot to delete this
`_STORAGE_UNIT_VALUE`.
Closes: https://github.com/searxng/searxng/pull/3672
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-07-27 10:13:15 +02:00
Sylvain Cau
b9ddd59c5b
[enh] Add API Key support for discourse.org forums
2024-07-27 09:21:40 +02:00
searxng-bot
319afe031e
[l10n] update translations from Weblate
...
2b14808d4
2024-07-26 09:15:40 +02:00
Markus Heiser
657dcb973a
[fix] engine yacy: update list of base URLs
...
https://search.lomig.me
Poor results / tested `!yacy :en hello` and got zero results
https://yacy.ecosys.eu
Slow response (> 6sec for trivial search terms)
https://search.webproject.link
Dead instance / URL offline
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-07-20 09:59:43 +02:00
searxng-bot
ffde256364
[l10n] update translations from Weblate
...
94bacfa68360fa8b30b378bf4628110ad613
2024-07-19 09:16:10 +02:00
Grant Lanham
9a4fa7cc4f
Update mullvad_leta.py to account for img_elem
...
A recent update from Mullvad Leta introduced the img_elem. This update
broke the existing logic. Now, by checking the length of the dom_result
to see if it was included in the return results, we can handle the logic
accordingly.
2024-07-15 06:58:39 +02:00
Markus Heiser
2039060b64
[mod] revision of the settings_loader
...
The intention of this PR is to modernize the settings_loader implementations.
The concept is old (remember, this is partly from 2014), back then we only had
one config file, meanwhile we have had a folder with config files for a very
long time. Callers can now load a YAML configuration from this folder as
follows ::
settings_loader.get_yaml_cfg('my-config.yml')
- BTW this is a fix of #3557 .
- Further the `existing_filename_or_none` construct dates back to times when
there was not yet a `pathlib.Path` in all Python versions we supported in the
past.
- Typehints have been added wherever appropriate
At the same time, this patch should also be downward compatible and not
introduce a new environment variable. The localization of the folder with the
configurations is further based on:
SEARXNG_SETTINGS_PATH (wich defaults to /etc/searxng/settings.yml)
Which means, the default config folder is `/etc/searxng/`.
ATTENTION: intended functional changes!
If SEARXNG_SETTINGS_PATH was set and pointed to a not existing file, the
previous implementation silently loaded the default configuration. This
behavior has been changed: if the file or folder does not exist, an
EnvironmentError exception will be thrown in future.
Closes: https://github.com/searxng/searxng/issues/3557
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-07-14 18:10:06 +02:00
Bnyro
e4da22ee51
[feat] engine: implementation of alpine linux packages
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-07-14 17:57:58 +02:00
Grant Lanham
e56f4b315f
[mod] UX: flush flag icon to right in language select option values
...
If the flag icon is first, it prevents easily searching the select list on the
keyboard. By moving the icon fully to the right, this will enable a user to
search the select list.
Closes: https://github.com/searxng/searxng/issues/3645
2024-07-14 16:39:50 +02:00
Allen
5468d97d39
[mod] remove py 3.6 leftovers
2024-07-13 17:20:50 +02:00
Markus Heiser
37ec668ae1
[build] /static
2024-07-13 17:19:59 +02:00
Markus Heiser
d0bad45d21
[fix] simple theme: in URLs don't truncate descenders (typograhy, FFox)
...
HINT: this is a workaround to fix a rendering bug in FFox-Desktop [3]
Descenders [1] in the URL are truncated, caused by the `overflow: hidden;`
because part of link overflow the flex box [2].
[1] https://en.wikipedia.org/wiki/Descender
[2] https://github.com/searxng/searxng/issues/3550
[3] https://github.com/searxng/searxng/pull/3592#issuecomment-2186313121
Closes: https://github.com/searxng/searxng/issues/3550
Suggested-by: @coxde
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-07-13 17:19:59 +02:00
searxng-bot
d5487a157d
[l10n] update translations from Weblate
...
cecd9182a8e9bf64ae82e209f2d428204a2f4dd16510dfb5015db9686800ded7fc33af6dcbab31eae
2024-07-13 17:18:16 +02:00
Grant Lanham
ef103ba80a
Implement google/brave switch in Mullvad Leta
...
cleanup
Import annontations
2024-07-07 08:08:11 +02:00
searxng-bot
67008226fc
[l10n] update translations from Weblate
...
1f7de30a25d34f39a9930a817f153936f24d3fcf83c9219b2f9ac407ef05dbe23f2ef2cf
2024-07-05 09:30:13 +02:00
Bnyro
4eaa0dd275
[fix] gentoo: use mediawiki engine
2024-07-03 10:24:03 +02:00
Allen
54be8f09a6
[fix] html.unescape stract autocomplete suggestions
2024-07-02 18:16:46 +02:00
Thomas Renard
39aaac40d6
[mod] libretranslate: add direct link to translation (engine)
2024-06-30 16:18:33 +02:00
return42
adaec68728
[data] update searx.data - update_wikidata_units.py
2024-06-29 07:20:59 +02:00
return42
47ffa711d2
[data] update searx.data - update_ahmia_blacklist.py
2024-06-29 07:10:59 +02:00
return42
c7d1f4278d
[data] update searx.data - update_firefox_version.py
2024-06-29 07:09:16 +02:00
return42
985c8b0bce
[data] update searx.data - update_engine_traits.py
2024-06-29 07:08:55 +02:00
return42
7200640055
[data] update searx.data - update_engine_descriptions.py
2024-06-29 07:07:32 +02:00
searxng-bot
46b9273352
[l10n] update translations from Weblate
...
4fc3ba36015a6fae2f2cb08843e794c9db028edf87498bc97997b5d8620edb17d8d6580e57f8e9bde7364acbe49f6ddc2b5a64f2e708cc195d7ad87d2e16d52c73400eba467cf8af
2024-06-28 09:46:44 +02:00
Markus Heiser
a5f8e0899c
[fix] disable Reddit engine by default
...
Reddit is enabled by default .. many bot request will go through Reddit .. we
should disable Reddit by default to cool down the IP [1].
[1] https://github.com/searxng/searxng/issues/3444#issuecomment-2180415057
Closes: https://github.com/searxng/searxng/issues/3444
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-28 08:48:52 +02:00
Markus Heiser
1449824165
[data] update searx.data - update_engine_traits.py
...
$ make data.traits
Last GH action has been failed [1], the bugfixes from
- https://github.com/searxng/searxng/pull/3611
- https://github.com/searxng/searxng/pull/3612
were necessary to update the data.
[1] https://github.com/searxng/searxng/actions/runs/9278028691/job/25528337485
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-25 15:20:51 +02:00
Markus Heiser
0f9926b89a
[fix] brave fetch_traits: layout of the settings page has changed
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-25 15:08:18 +02:00
Markus Heiser
39ffec87b7
[fix] engine zlibrary: handle seized domain
...
The domains of zlibrary instances are known to be seized from time to time.
This leads to problems when, for example, the automated tasks try to update the
engine traits (aka fetch_traits). The search function should also generate a
suitable error message (currently either SSL errors or empty result lists are
returned). [1]
[1] https://github.com/searxng/searxng/issues/3610
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-25 14:40:19 +02:00
Markus Heiser
b8fa4d6195
[fix] bing news results return invalid images
...
Closes: https://github.com/searxng/searxng/issues/3502
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-25 11:12:41 +02:00
Grant Lanham
9a9ca307fe
[fix] implement tests and remove usage of gen_useragent in engines
2024-06-23 11:51:41 +02:00
searxng-bot
7f72c48b59
[l10n] update translations from Weblate
...
3e3c194e80ffab2bcb36809a19aa97aff39a5d7cbca43ada44ff852f398eb5811fde54157de1d0c22eeb9500b8
2024-06-21 12:16:35 +02:00
Richard Lyons
f195d98bfb
Fix search_url building.
2024-06-20 06:30:00 +02:00
Markus Heiser
acf3f109b2
[doc] hostname plugin: improve online documentation
...
The data types (list & map) should be made clearer, as these sometimes lead to
misunderstandings.
[1] https://github.com/searxng/searxng/issues/3558#issuecomment-2175058128
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-18 12:06:06 +02:00
Sandro Jäckel
accc1c1032
[fix] setup.py - packaging for 'answerers' to build a valid package
...
Fix installing answerers when installing SearXNG through a wheel [1]. These
files have been missed in commit d72fa99bhttps://github.com/searxng/searxng/pull/3045#issuecomment-1961767861
2024-06-17 15:07:07 +02:00
Jeff Alyanak
efd69c4ca9
[feat] plugin Self Information: improve keyword matching
...
This change does the following things:
- the `ip` keyword is now case-insensitive
- if the query includes `my ip` it will now also match
In order to avoid too many false matches, the `ip` keyword alone matches only if
it's the _only_ word, but the inclusion of `my` loosens that to be inclusive of
users type a phrase (eg, "what is my ip", "tell me my ip", "my IP address",
etc).
Better answer context
Previously this plugin simply dumped your IP or user-agent string as an answer.
This tiny change just adds some text to contextualize those answers (eg, "Your
IP is: 1.2.3.4" instead of just "1.2.3.4").
2024-06-17 14:12:37 +02:00
Allen
13eec44b65
[fix] \!goi irrelevant results AND display more results
2024-06-16 16:45:03 +02:00
Bnyro
e9f8412a6e
[perf] torrents.html, files.html: don't parse and re-format filesize
2024-06-15 15:42:29 +02:00
Bnyro
df15c21b35
[feat] mozhi: fix crash, support synonyms and definition
2024-06-15 11:33:09 +02:00
Bnyro
1fe13d0ba4
[refactor] duckduckgo: use extr helper function in get_vqd
2024-06-15 11:24:05 +02:00
holysoles
7be468d213
[feat] docker: add env vars for common public instance settings
2024-06-14 14:58:02 +02:00
searxng-bot
63b7d558b6
[l10n] update translations from Weblate
...
351fcdf8d4ab6400d88f1bb9a0cfa147559d3beab11c352f450636c61f2cb8b7c74be3d3b5aace1defc187ae6ecf3a8d3f5bfc316b9da27e1586d6bd0bf14d9b2b3aa3641716759a08c9fef67dd2555fe2e69dc5dc6a3503130da2a2f072535b9d1be7d53560df258c3c041fd7847aa9d3a114bf441f2fc0ff217a78625f6e8bdfd99
2024-06-14 09:27:29 +02:00
Bnyro
f5eb56b63f
[refactor] hostnames plugin: add fallback for old hostname_replace plugin
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-07 14:42:52 +02:00
Markus Heiser
845a0b678d
[doc] add 'hostnames' plugin to the online documentation
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-07 14:42:52 +02:00
Bnyro
aa59bfbf60
[feat] hostname replace plugin: support for external list file
2024-06-07 14:42:52 +02:00
Bnyro
3bec04079c
[feat] hostname replace plugin: possibility to prioritize certain websites
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-07 14:42:52 +02:00
Bnyro
46c5309888
[feat] mojeek: implement dedicated module
2024-06-07 11:31:05 +02:00
Markus Heiser
32a2175f38
[feat] add engines for discourse forums (python, caddy, pi-hole)
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-06-07 10:16:09 +02:00
allendema_searxng_pi
ee146dbc07
[enh] Add engine for discourse forums
2024-06-07 10:16:09 +02:00
searxng-bot
91882aedf1
[l10n] update translations from Weblate
...
00cfc653da89cbc458b58008c902c92cadcb2d159a175a9ab96e6e2488cff0922626a0f2
2024-06-07 10:14:03 +02:00
