Markus Heiser
949a73103f
[mod] hex engine: normalize (some of) the linked terms
...
The names of the links are rather tags than real names, and they sometimes vary
greatly in their spelling:
- GitHub: github, Github
- Source code: Repository, SCM, Project Source Code
- Documentation: docs, Documentation
It was standardized to terms such as 'Source code' and 'Documentation', as
translations already exist for these terms.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-15 12:50:35 +02:00
Daniel Kukula
cc8b537e34
[mod] package.html template: additional links (a python dict)
...
- Closes: https://github.com/searxng/searxng/issues/3456
2024-05-15 12:50:35 +02:00
Bnyro
645a840d82
[refactor] codeberg: use gitea engine
2024-05-15 07:23:57 +02:00
Bnyro
82b6c0d05f
[feat] engine: implementation of gitea
2024-05-15 07:23:57 +02:00
Bnyro
60a373ad89
[fix] chefkoch: use German words in content field
2024-05-12 18:36:49 +02:00
Markus Heiser
ffb1001f80
[fix] engine wikidata - WIKIDATA_UNITS has been changed in #3378
...
This patch is a leftover from [1] in which the WIKIDATA_UNITS values has become
a dictionary.
[1] https://github.com/searxng/searxng/pull/3378
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-10 16:04:27 +02:00
Markus Heiser
901819359c
[update] make pygments.less
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-10 10:00:31 +02:00
searxng-bot
4b6eebd312
[l10n] update translations from Weblate
...
9487de41b20d3b115860cf6e36d0a8e99dff4055cd1c377f2c8d9abeb16006a54b5123e24f372ab44fa9b9aae8
2024-05-10 09:29:22 +02:00
Bnyro
383d873597
[fix] unit converter plugin: can't be disabled in settings
2024-05-09 17:40:37 +02:00
Markus Heiser
fb32425d78
[mod] yacy engine: pick base_url randomly from a list of instances
...
Inspired by post [1] in the disscussion we had, while yacy.searchlab.eu was
broken.
[1] https://github.com/searxng/searxng/issues/3428#issuecomment-2101080101
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-09 17:29:15 +02:00
Bnyro
72be98e12f
[feat] plugins: new calculator plugin
2024-05-09 17:23:38 +02:00
Markus Heiser
742303d030
[mod] improve unit converter plugin
...
- l10n support: parse and format decimal numbers by babel
- ability to add additional units
- improved unit detection (symbols are not unique)
- support for alias units (0,010C to F --> 32,018 °F)
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-09 17:16:31 +02:00
Alexandre Flament
ac430a9eaf
Drop pytomlpp dependency for Python >= 3.11
...
Rely on tomllib for Python >= 3.11
2024-05-05 17:35:29 +02:00
Markus Heiser
dbed8da284
[fix] startpage engine: XPath expressions adapted for new HTML layout
...
Startpage has changed its HTML layout, classes like ``w-gl__result__main`` do no
longer exists and the result items have been slightly changed in their
structure.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-04 19:45:52 +02:00
Yaksh Bariya
d577817646
[fix] respect user preferences to open links in new tab for short answers
...
Previously only result urls were set to open in new tab by default, this should
make the behaviour consistent.
Also adds the missing rel="noreferrer" to the anchor tag. Although this should
not be needed as long as the `referrer-policy: no-referrer` header is set, it's
always nice to play safer than to have to say sorry. For example some reverse
proxy configurations might strip off unwhitelisted headers in which case it's
nice to have this set.
2024-05-04 06:55:37 +02:00
Bnyro
78077126f2
[feat] wikimedia commons: support for videos, audio and other files
2024-05-04 06:23:04 +02:00
Daniel Kukula
46d7a8289b
[feat] engine: implementation of https://hex.pm
...
The package manager for the Erlang ecosystem Find packages.
Co-authored-by: Bnyro <82752168+Bnyro@users.noreply.github.com>
2024-05-03 21:37:37 +02:00
searxng-bot
8225f88404
[l10n] update translations from Weblate
...
377c34a74079ba625bfe48c8a08e04560acc2fb6a2cfab374205ccd284cdd1d87edf2cb3f6971a077f88e23f2cc7e8506c1795e14ddd143bc6cf05d96b3d53b2cc8a6cd
2024-05-03 09:15:13 +02:00
Markus Heiser
11fe88bb40
[fix] update wikidata units - remove URL prefix from Q-name
...
Sometimes the URL prefix switches from a http to a https, this patch harden the
code that removes the URL prefix from wikidata Q-name, issue has been reported
in [1].
[1] https://github.com/searxng/searxng/pull/3437#issuecomment-2082121730
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-05-01 18:58:28 +02:00
Austin-Olacsi
c8d0b6529b
[feat] engine: implementation of searchmysite
2024-04-30 05:47:18 +02:00
Markus Heiser
f8bdf61976
[fix] yep engine: invcrease timeout from defaul 3sec to 5sec
...
In the "Engines" tab on searx.space [1] nearly all engines report a
TimeoutException: yep engine
As documented in issue #2444 [2], this problem can be fixed by increasing the
timeout. Note: on a local instance (`make run`) the timeout of 3sec was
sufficient / at least in my local test, but the balance of searx.space leads me
to believe that this tight timeout is usually not sufficient.
[1] https://searx.space/
[2] https://github.com/searxng/searxng/issues/2444
Closes https://github.com/searxng/searxng/issues/3421
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-30 05:46:15 +02:00
return42
e45a7cc063
[data] update searx.data - update_engine_traits.py
2024-04-29 10:02:48 +02:00
return42
c0b6c26eea
[data] update searx.data - update_firefox_version.py
2024-04-29 10:02:16 +02:00
return42
0ec406cb7e
[data] update searx.data - update_ahmia_blacklist.py
2024-04-29 10:01:52 +02:00
return42
ea585d4e77
[data] update searx.data - update_currencies.py
2024-04-29 09:48:56 +02:00
return42
d4e98c03a0
[data] update searx.data - update_engine_descriptions.py
2024-04-29 09:46:26 +02:00
Markus Heiser
e6c345f890
[fix] ccc_media engine: filter video formats and ignore audio & SubRip
...
CCC media serves several recording formats, to name a few:
- application/x-subrip
- video/mp4
- video/webm
- audio/mpeg
- audio/opus
- audio/mpeg
not all of them are suitable for a video frame. If available we should prefer
video/mp4 due to its minimal data rates.
Closes: https://github.com/searxng/searxng/issues/3431
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-28 08:42:18 +02:00
Jinyuan Huang
ecee56533c
improve "search existing issues from github" link
2024-04-27 20:01:27 +02:00
Markus Heiser
11fdc2f56a
[fix] drop broken azlyrics XPath engine
...
Unfortunately, azlyrics has a bot blocker that makes it impossible to implement
an XPath engine for it [1][2].
[1] https://github.com/searxng/searxng/pull/3302#issuecomment-2013529271
[2] https://github.com/searxng/searxng/issues/3280
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-27 18:43:14 +02:00
Markus Heiser
648f43be1d
[build] /static
2024-04-27 18:26:23 +02:00
Bnyro
3ea278aff4
[feat] preferences: button to enable/disable all engines
2024-04-27 18:26:23 +02:00
Bnyro
46efb2f36d
[feat] plugins: new unit converter plugin
2024-04-27 18:11:33 +02:00
Bnyro
b3b1258e4e
[data] wikidata: update wikidata_units.json
2024-04-27 18:11:33 +02:00
Markus Heiser
d593055888
[fix] ionic.io/ionicons - add back missing class="ionicon"
...
Seems to me svg2jinja added the class in the past .. but no longer in new builds
/ this patch adds the class back by using addAttributesToSVGElement [1].
To test this patch use:
$ ./manage themes.simple
$ cat searx/templates/simple/icons.html
and check `class="ionicon"` is in the outer `<svg ..>` tags.
[1] https://svgo.dev/docs/plugins/add-attributes-to-svg-elements/
[2] https://ionic.io/ionicons
Closes: https://github.com/searxng/searxng/issues/3383
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-27 09:33:20 +02:00
Bnyro
42b58eb448
[feat] media.ccc.de: implement module with pagination and iframe
2024-04-27 08:55:26 +02:00
searxng-bot
41f415aabf
[l10n] update translations from Weblate
...
f4861e2c3
2024-04-26 09:14:03 +02:00
Markus Heiser
ddaa6ed759
[fix] add missing localizable (gettext) messages to searxng.msg
...
To test this patch I used .. and checked the diff of the `messages.pot` file::
$ ./manage pyenv.cmd pybabel extract -F babel.cfg \
-o ./searx/translations/messages.pot searx/
$ git diff ./searx/translations/messages.pot
----
hint from @dalf: f-string are not supported [1] but there is no error [2].
[1] python-babel/babel#594
[2] python-babel/babel#715
Closes: https://github.com/searxng/searxng/issues/3412
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-26 07:34:32 +02:00
Bnyro
0a4280a137
[refactor] translation engines: add translate category
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-26 07:33:28 +02:00
Bnyro
91522f3801
[feat] engine: implementation of LibreTranslate
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-26 07:33:28 +02:00
searxng-bot
af3be2b12b
[l10n] update translations from Weblate
...
b58f1136643b6019505cac16eaf88b5396d5515161ddc7f8e70b10247777e501b0c91d0ff7f160fd062cc9ce67131bec469bceb0dbec51330ae1879a2eb668b3c2827e5ba46f8672b58a3eff13a9c022ea424ea8188
2024-04-21 11:16:40 +02:00
Bnyro
644ae51417
[fix] yahoo: result titles are getting mixed together
2024-04-20 17:00:17 +02:00
mrpaulblack
5e4ab964b7
[feat] template: add apple-touch-icon in html header
...
* this makes it possible to add SearXNG to iOS devices homescreen with a proper icon
2024-04-18 12:34:17 +02:00
singletail
1746eecf2b
[fix] engine: youtube_api - ignore channels / prevent exceptions
...
`youtube_api.py` throws an exception if the search results contain a channel, as
channels have no videoId. This PR adds a keycheck for parsing the json response.
2024-04-13 08:41:00 +02:00
Austin-Olacsi
c92846dca8
[fix] dead URL in settings.yml
2024-04-13 07:03:45 +02:00
dependabot[bot]
c8dca20548
[upd] npm: Bump eslint in /searx/static/themes/simple
...
Bumps [eslint](https://github.com/eslint/eslint ) from 8.57.0 to 9.0.0.
- [Release notes](https://github.com/eslint/eslint/releases )
- [Changelog](https://github.com/eslint/eslint/blob/main/CHANGELOG.md )
- [Commits](https://github.com/eslint/eslint/compare/v8.57.0...v9.0.0 )
---
updated-dependencies:
- dependency-name: eslint
dependency-type: direct:development
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-04-12 18:11:42 +02:00
Diagonalo
6458490271
[mod] engine 'mwmbl: Update API URL
2024-04-10 06:51:28 +02:00
Markus Heiser
f1a148f53e
[fix] ddg engine: if no vqd value can be determined, don't save None
...
Closes: https://github.com/searxng/searxng/issues/3370
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-08 10:56:11 +02:00
Markus Heiser
bd6ff29f8f
[fix] remove usage of no longer existing names from lxml
...
In lxml 5.1.1 the private name `_ElementStringResult` in module `lxml.etree`
does no longer exists.
This code was written nearly a decade ago, its no longer clear what the
intention `_ElementStringResult` and `_ElementUnicodeResult` had been. It can be
assumed that these classes will no longer occur.
Closes: https://github.com/searxng/searxng/issues/3368
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-08 10:55:23 +02:00
Markus Heiser
26a92c1a8d
[fix] new builds of icons.html do miss class="ionicon"
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-08 09:38:18 +02:00
Markus Heiser
dddd628f48
[build] /static
2024-04-08 09:07:45 +02:00
Yaksh Bariya
9f5268b4a7
[enh] add keybindings for copying URLs
...
'y': for in Vim-mode (yank)
'c': for SearXNG-mode (copy)
This should help keyboard heavy users
2024-04-08 09:07:45 +02:00
Markus Heiser
4acb52f68f
[fix] even if limiter not activated, botdetection must be activated
...
Closes : #2975
Closes : #2995
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-04-08 07:53:04 +02:00
Austin-Olacsi
b6fe2cad71
[mod] Ask engine: remove tracking paramaters and set max page to 5
2024-04-08 07:50:14 +02:00
Bnyro
bf3845b093
[feat] engine: implementation of Open Meteo
2024-04-07 19:02:53 +02:00
return42
ad9537065a
[data] update searx.data - update_firefox_version.py
2024-03-29 08:44:18 +01:00
return42
531942ed16
[data] update searx.data - update_ahmia_blacklist.py
2024-03-29 08:43:50 +01:00
return42
433cfd868a
[data] update searx.data - update_currencies.py
2024-03-29 08:42:16 +01:00
return42
22d68aa2a7
[data] update searx.data - update_engine_traits.py
2024-03-29 08:41:44 +01:00
return42
cc124b8f14
[data] update searx.data - update_engine_descriptions.py
2024-03-29 08:41:00 +01:00
searxng-bot
550ca55778
[l10n] update translations from Weblate
...
cd974f62f98335c289986969118285674006
2024-03-29 08:23:44 +01:00
Mikkel Denker
b21aaa8907
Add user-agent to stract requests
2024-03-22 13:40:46 +01:00
searxng-bot
32bd55e268
[l10n] update translations from Weblate
...
522463f6a8ec374759ac6b5dff066b28f3e4a8e6cb73bcd153923a06110caf76bc307e8aeef184a70e5d537357d592adfb00645b3404da95a5907122a67a1f39a7e1553
2024-03-22 08:15:19 +01:00
searxng-bot
f78cf94507
[l10n] update translations from Weblate
...
5ab8a41238fdac20fdf904a2b41da78b59cbc3ee00845a1a4001e9b8ddc37d9257c6e52bde689997706f9a81ee0b916dcc02f78ef012098a448131bcbfb4b91c561b9ca44ab09c8b5b767a16c8dec572be28e8c648d77ce678451d044f989a10834f13eaa1cdd6eb49e3879af55b61fb74954e6e4933b08dc6658df517d4cee7ec3f0
2024-03-15 09:49:09 +01:00
Markus Heiser
542f7d0d7b
[mod] pylint all files with one profile / drop PYLINT_SEARXNG_DISABLE_OPTION
...
In the past, some files were tested with the standard profile, others with a
profile in which most of the messages were switched off ... some files were not
checked at all.
- ``PYLINT_SEARXNG_DISABLE_OPTION`` has been abolished
- the distinction ``# lint: pylint`` is no longer necessary
- the pylint tasks have been reduced from three to two
1. ./searx/engines -> lint engines with additional builtins
2. ./searx ./searxng_extra ./tests -> lint all other python files
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-11 14:55:38 +01:00
Markus Heiser
8205f170ff
[mod] pylint all engines without PYLINT_SEARXNG_DISABLE_OPTION
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-11 14:55:38 +01:00
Markus Heiser
707d6270c8
[doc] engine: mullvad leta
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-10 18:20:07 +01:00
Grant Lanham
9d6896a771
[feat] engine: implementation of mullvad leta
2024-03-10 18:20:07 +01:00
Markus Heiser
3edaa26dae
[data] make data.all
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-10 15:56:50 +01:00
Markus Heiser
0ffec440b2
[doc] annas_archive: ctegs journal_article & book_any has been removed
...
In commit 8af181533https://github.com/searxng/searxng/pull/3321
the category `journal_article` has been removed, `book_any` has been removed
longer time ago.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-10 12:46:00 +01:00
return42
33b4ffee29
[data] update searx.data - update_engine_traits.py
2024-03-10 12:46:00 +01:00
return42
a5d36211a3
[data] update searx.data - update_ahmia_blacklist.py
2024-03-10 12:45:15 +01:00
return42
2cb389e9ce
[data] update searx.data - update_currencies.py
2024-03-10 12:44:44 +01:00
return42
4a8867e646
[data] update searx.data - update_engine_descriptions.py
2024-03-10 12:01:33 +01:00
return42
7bbcf1be9a
[data] update searx.data - update_external_bangs.py
2024-03-10 12:01:00 +01:00
Markus Heiser
e97e1f9110
[fix] duckduckgo.fetch_traist - URL of region definitions has changed
...
- https://duckduckgo.com/dist/util/u.7669f071a13a7daa57cb.js
updated from u661.js to u.7669f071a13a7daa57cb / should be updated
automatically? The last change was on March 23rd in dba8977b09https://github.com/searxng/searxng/pull/2269
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-10 10:32:54 +01:00
Markus Heiser
33c099022b
[drop] engine framalibre - sarch URL is no longer supported
...
Closes: https://github.com/searxng/searxng/issues/3286
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-09 18:00:45 +01:00
Alexandre Flament
42515d98f7
engine npm use the packages.html template
2024-03-09 10:24:49 +01:00
Bnyro
6dd07b88a4
[feat] lib.rs: use packages.html template
2024-03-09 10:17:16 +01:00
Markus Heiser
50d5a9ff60
[fix] issues reported by pylint 3.1.0
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-09 09:28:13 +01:00
Markus Heiser
a7b51f023e
[black] upgrade black 22.12.0 --> 24.2.0
...
The issue discussed in [1] has been solved since [2] has been merged into black
/ now we can upgrade without touching 69 files as it was needed with black
23.1.0 [3].
[1] https://github.com/searxng/searxng/pull/2159#issuecomment-1425723977
[2] https://github.com/psf/black/pull/4060
[3] https://github.com/searxng/searxng/pull/2159/files
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-09 08:15:50 +01:00
Bnyro
44decaa524
[feat] pkg.go.dev: use packages.html template
2024-03-08 17:18:54 +01:00
centralscrutinizer21
fbea0dd3ce
[l10n] Italian translation of infopages
2024-03-08 17:18:29 +01:00
searxng-bot
9c08a0cddd
[translations] update from Weblate
...
184c000d87a107e46cf02911c4be4e8977cc4a9923cee05e7bb2f84b466efdc
2024-03-08 08:21:21 +01:00
Markus Heiser
fba8371396
[fix] XPath engine hoogle - hoogle.haskell.org has no paging support
...
Search on hoogle.haskell.org does no longer have pages.
Closes: https://github.com/searxng/searxng/issues/3278
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-07 17:31:25 +01:00
Markus Heiser
a5b81e2555
[fix] nyaa engine - paging support & filesize (GiB)
...
BTW: pylint engine
Closes: https://github.com/searxng/searxng/issues/3290
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-07 07:38:31 +01:00
Markus Heiser
3179993847
[fix] XPath engine lobste.rs - argument utf8 is no longer needed
...
Closes: https://github.com/searxng/searxng/issues/3279
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-06 13:24:50 +01:00
Markus Heiser
3529f0af50
[fix] engine searchcode.com - paging is broken in searchcode.com's API
...
paging is broken in searchcode.com's API .. not sure it will ever been fixed /
this commit disables paging in the engine and BTW pylint `searchcode_code.py`.
Closes: https://github.com/searxng/searxng/issues/3287
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-06 12:33:29 +01:00
Markus Heiser
76b18545e4
[fix] XPath engine naver - content selector needed an update
...
Closes: https://github.com/searxng/searxng/issues/3282
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-06 11:11:31 +01:00
Markus Heiser
5602f0bf96
[fix] engine pinterest - ignore result type 'story'
...
Close: https://github.com/searxng/searxng/issues/3289
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-06 07:33:43 +01:00
Markus Heiser
d97b84bea2
[fix] ddg engines (get_vqd) - the vqd value is no longer in the form
...
Closes: https://github.com/searxng/searxng/issues/3276
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-05 16:27:04 +01:00
Alexandre Flament
0e2566db68
internetarchivescholar engine: set timeout to 15 seconds
2024-03-03 20:16:32 +01:00
Alexandre Flament
7c5c11949b
Checker: tests for wikispecies
2024-03-03 20:00:46 +01:00
Alexandre Flament
8fed5798ab
Checker: tests for bahnhof
2024-03-03 20:00:46 +01:00
Yaksh Bariya
b1431e1670
[feat] engine: implementation of cppreference
2024-03-03 17:07:29 +01:00
Alexandre Flament
1a66bfa66c
checker: display results at the end
2024-03-03 11:18:43 +01:00
Alexandre Flament
38fdd2288a
Drop typing-extensions dependency ( #3265 )
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-03-02 13:10:31 +01:00
searxng-bot
1892a87fd2
[translations] update from Weblate
...
663d8815bf97823239480a0ec8d90521198110e90be9a3b803ba238bbaaa43e6950cdb97807c9891de16ca50cd85241d9ce
2024-03-02 09:37:52 +01:00
Bnyro
f3b4bf86a7
[feat] engine: implementation of void linux packages
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-29 13:12:40 +01:00
Alexandre Flament
d58760ef75
[mod] pypi engine: use packages.html
2024-02-29 07:48:44 +01:00
dalf
35873b5a1c
Update searx.data - update_ahmia_blacklist.py
2024-02-29 07:47:54 +01:00
dalf
df74b5b59b
Update searx.data - update_firefox_version.py
2024-02-29 07:47:01 +01:00
dalf
473b2dd42f
Update searx.data - update_wikidata_units.py
2024-02-29 07:46:27 +01:00
dalf
9a474715e8
Update searx.data - update_engine_descriptions.py
2024-02-29 07:46:02 +01:00
Markus Heiser
c0b97c6543
[fix] re-add opensearch_url / its used in based.html
...
The URL was accidentally deleted in a85907a98
2024-02-25 18:26:16 +01:00
templehasfallen
e8bd6c03bf
Update settings.yml
...
Changed value of "extra_proxy_timeout" from 10.0 to 10 as the variable expects an int.
Uncommenting this value with a non-int value will throw many errors and crash all engines.
2024-02-25 16:35:13 +01:00
Austin-Olacsi
9330a072eb
[feat] engine: implementation of pixiv
2024-02-25 16:29:57 +01:00
Bnyro
cf57914359
[build] /static
2024-02-25 16:22:37 +01:00
Bnyro
db1f9b31c9
[feat] images: show resolution inside the image and fix image details overflow
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-25 16:22:37 +01:00
Bnyro
e76ab1a4b3
[refactor] images: add resolution, image format and filesize fields
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-25 16:22:37 +01:00
Markus Heiser
b683aa63fb
[feat] github: use packages template
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-25 14:56:57 +01:00
Bnyro
1d6f475fbc
[feat] dockerhub: use packages template
2024-02-25 14:56:57 +01:00
Markus Heiser
34fa2b7cca
[build] /static
2024-02-25 14:56:57 +01:00
Bnyro
938391b050
[feat] templates: add package result template
...
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-25 14:56:57 +01:00
Markus Heiser
a85907a98f
[fix] opensearxh.xml: firefox v123 does not except self-URI (URL with param)
...
Before this patch we had a address in the rel-self-template with params [1]:
GET::
<Url method="GET"
rel="self"
template="/opensearch.xml?method=GET&autocomplete=google"
type="application/opensearchdescription+xml"/>
POST::
<Url method="POST"
rel="self"
template="/opensearch.xml?method=POST&autocomplete=google"
type="application/opensearchdescription+xml"/>
The first one (GET) is no longer accepted by firefox since v123, the latter one
was always been wrong (since it mixes GET params with a POST request).
Since Firefox v123 a template syntax [2] in the rel-self-template is no longer
supported / Firefox will report an error::
Firefox could not download the search plugin from:
http://127.0.0.1:8888//opensearch.xml?method=GET&autocomplete=google
This patch reduce the URL to::
template="http://127.0.0.1:8888/opensearch.xml "
[1] https://github.com/dewitt/opensearch/blob/master/opensearch-1-1-draft-6.md#url-rel-values
[2] https://github.com/dewitt/opensearch/blob/master/opensearch-1-1-draft-6.md#opensearch-url-template-syntax
Closes: https://github.com/searxng/searxng/issues/3227
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-25 07:33:04 +01:00
searxng-bot
671333081c
[translations] update from Weblate
...
946267db3
2024-02-23 08:14:58 +01:00
Bnyro
cfbe59b6b3
[feat] engine: implementation of mozhi
2024-02-23 07:50:48 +01:00
Xinos
3c42252c78
[feat] engine: implementation of yandex music
...
Access to music is limited to a few countries:
- https://yandex.com/support/music/access.html
2024-02-21 17:17:12 +01:00
micsthepick
fde21c8f99
[feat] engine: Add LiveSpace livestreams
2024-02-20 14:45:07 +01:00
searxng-bot
3b80f9fe03
[translations] update from Weblate
...
df7653397c62c03816a48235060445545961275a77e510772d9b4c
2024-02-20 12:33:32 +01:00
Markus Heiser
894f164869
[fix] sort RTL_LOCALES before written into locales.json
...
To avoid unnecessary changes to the file, the list should be sorted before it is
written to the file.
You can test it by calling multiple times::
make data.locales
and searx/data/locales.json should be unchanged.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-20 12:29:13 +01:00
Alexandre Flament
ed66ed758d
[mod] reduce memory footprint by not calling babel.Locale.parse at runtime
...
babel.Locale.parse loads more than 60MB in RAM. The only purpose is to get:
LOCALE_NAMES - searx.data.LOCALES["LOCALE_NAMES"]
RTL_LOCALES - searx.data.LOCALES["RTL_LOCALES"]
This commit calls babel.Locale.parse when the translations are update from
weblate and stored in::
searx/data/locales.json
This file can be build by::
./manage data.locales
By store these variables in searx.data when the translations are updated we save
round about 65MB (usually 4 worker = 260MB of RAM saved.
Suggested-by: https://github.com/searxng/searxng/discussions/2633#discussioncomment-8490494
Co-authored-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-20 10:43:20 +01:00
Markus Heiser
76845ea42c
[mod] engine ask.com - parse JS result to JSON
...
Parse the result list from ask.com given in the variable named
window.MESON.initialState::
<script nonce="..">
window.MESON = window.MESON || {};
window.MESON.initialState = {"siteConfig": ...
...}};
window.MESON.loadedLang = "en";
</script>
The result list is in field::
json_resp['search']['webResults']['results']
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-18 09:17:22 +01:00
Hackurei
3df53d6e50
[feat] engine: implementation of ask.com
2024-02-18 09:17:22 +01:00
searxng-bot
2aef3a556f
[translations] update from Weblate
...
be989636e0e3455cb8edc279680e0d3b7f9ff68fc5440980f3846c711618f3a1d12e762fab319100b9854a5a4aebfb23f13
2024-02-16 15:48:10 +01:00
Bnyro
11c0651ef4
[fix] lingva: redirect and parsing error
2024-02-11 11:28:47 +01:00
dalf
bffc4905ce
Update searx.data - update_currencies.py
2024-02-10 23:55:41 +01:00
Markus Heiser
bfcd41f04a
[clean] drop obsolete py3.7 compatibility
...
- https://github.com/searxng/searxng/discussions/2356
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-10 09:27:19 +01:00
Hackurei
b0fe0924a3
[feat] engine: implementation of brave goggles
2024-02-10 08:09:50 +01:00
Markus Heiser
53898b8c37
[mod] footer: i18n for the link names in the footer
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-10 08:03:43 +01:00
Bnyro
7e1b5f6cc8
[feat] footer: support for custom entries
2024-02-10 08:03:43 +01:00
searxng-bot
459389a2da
[translations] update from Weblate
...
2b940307ee7cdce39e171fae67dd6a7604668cc4c51a92e76559ba
2024-02-09 08:15:45 +01:00
Markus Heiser
df1a774003
[fix] KeyError: 'title' in results using key-value.html template
...
Since #2508 a title is required --> this is a bug when an engine uses the
key-value.html template [1], where no title is needed.
[1] https://github.com/searxng/searxng/blob/master/searx/templates/simple/result_templates/key-value.html
Closes: https://github.com/searxng/searxng/issues/3130
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-06 07:53:39 +01:00
searxng-bot
11f918296f
[translations] update from Weblate
...
a001549469f220b2aa71951ae12a2f344a700f2944179f0d42961fa5cc1c6d5c5a39252dfa01c975851a86de3d4a55d6d8d3bb8adf1f1b2e23dcb7589d6bbcc04d8739c
2024-02-02 08:18:01 +01:00
Markus Heiser
be0d756ad5
[fix] libgen.fun is down, switch to libgen.rs
...
Closes: https://github.com/searxng/searxng/issues/3178
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-02-01 20:32:10 +01:00
allixx
6d31ca28b5
[fix] remove missing link icon macro
2024-02-01 08:13:43 +01:00
Hermógenes Oliveira
100a150a33
Remove rtl exception
...
This right-to-left exception doesn't seem to be called for.
2024-01-31 20:03:10 +01:00
Hermógenes Oliveira
f9f0c2ec03
Fix media exposure toggle
...
Make initially hidden and the toggle button consistent.
2024-01-31 20:03:10 +01:00
Hermógenes Oliveira
fa7fef7d87
Provide template for results in file category
...
This is used, for instance, by the recoll engine.
2024-01-31 20:03:10 +01:00
Markus Heiser
ab8e5383fb
[mod] remove X-XSS-Protection headers
...
Deprecated header not used by browsers nowadays[1]:
"""In modern browsers, X-XSS-Protection has been deprecated in favor of the
Content-Security-Policy to disable the use of inline JavaScript. Its use can
introduce XSS vulnerabilities in otherwise safe websites. This should not be
used unless you need to support older web browsers that don’t yet support CSP.
It is thus recommended to set the header as X-XSS-Protection: 0."""[2]
[1] https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/X-XSS-Protection
[2] https://infosec.mozilla.org/guidelines/web_security#x-xss-protection
Closes: https://github.com/searxng/searxng/issues/3171
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-31 17:23:41 +01:00
allixx
dca78f920f
[build] /static
2024-01-31 17:22:03 +01:00
allixx
c85f706601
[fix] wrong engines padding
2024-01-31 17:22:03 +01:00
allixx
30dcaf1db6
[fix] equalize cached/proxied links left margin
2024-01-31 17:22:03 +01:00
allixx
1e03094dee
[fix] justify engines/cached/proxied vertically
2024-01-31 17:22:03 +01:00
Markus Heiser
c14b117121
[fix] brave.search - update result selectors to fit to new layout
...
Closes: https://github.com/searxng/searxng/issues/3167
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-31 16:21:56 +01:00
Bnyro
efbee96b1d
[feat] brave: fix empty content and parse published dates
2024-01-30 07:41:45 +01:00
Bnyro
90072eb6ff
[build] /static
2024-01-29 18:09:22 +01:00
Bnyro
a5decfb838
[feat] preferences: button to copy input to restore preferences hash
2024-01-29 18:09:22 +01:00
Bnyro
559b860618
[feat] engine: implementation of goodreads
2024-01-29 16:07:24 +01:00
searxng-bot
a962aab9b0
[translations] update from Weblate
...
c1a3532a2603c6894b2920c734264cc1168a21ec41823
2024-01-29 15:01:37 +01:00
dalf
62fa85287a
Update searx.data - update_wikidata_units.py
2024-01-29 14:04:24 +01:00
dalf
0ed7548d83
Update searx.data - update_firefox_version.py
2024-01-29 14:04:03 +01:00
dalf
d763934a7a
Update searx.data - update_ahmia_blacklist.py
2024-01-29 14:03:03 +01:00
dalf
14f73ef3d9
Update searx.data - update_engine_traits.py
2024-01-29 14:02:30 +01:00
dalf
a393341403
Update searx.data - update_engine_descriptions.py
2024-01-29 13:34:12 +01:00
allixx
e4cf0a7d4f
[fix] do highlight replacement at once
...
Highlights all search queries in search result in one go.
Fixes the case where search query contains word from highlight HTML code,
which causes broken HTML to appear in search results.
Closes #3057
2024-01-29 13:15:37 +01:00
Bnyro
8c73aa772b
[fix] semantic scholar: bad request
2024-01-25 06:12:08 +01:00
searxng-bot
ab5d2f32bb
[translations] update from Weblate
...
0f8246b81ce23e8ce91112731cb
2024-01-19 08:29:29 +01:00
Émilien (perso)
7c80807bb8
Block HeadlessChrome ( #3116 )
2024-01-17 09:14:36 +01:00
Jinyuan Huang
9c5f9735cf
[fix] engine: safesearch parameter in Google Videos engine ( #2762 )
...
Closes: https://github.com/searxng/searxng/issues/2762
2024-01-16 15:29:09 +01:00
Markus Heiser
8762863ebf
[mod] presearch: set WEB timeout to 4sec & single network for all request
...
timeout: 4.0
The timeout of presearch-WEB is left up from the default of 3sec to 4sec. The
engine has to send two HTTP requests, they often exceed the default timeout of
3sec. Since all other presearch categories (images, videos, news) also have a
timeout of 4 sec, the WEB search should also have the same timeout.
network: presearch
Place all HTTP requests in the same network, named ``presearch``.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 19:23:26 +01:00
Markus Heiser
e560d7e373
[mod] presearch: add language & region support
...
In Presearch there are languages for the UI and regions for narrowing down the
search. With this change the SearXNG engine supports a search by region. The
details can be found in the documentation of the source code.
To test, you can search terms like::
!presearch bmw :zh-TW
!presearch bmw :en-CA
1. You should get results corresponding to the region (Taiwan, Canada)
2. and in the language (Chinese, Englisch).
3. The context in info box content is in the same language.
Exceptions:
1. Region or language is not supported by Presearch or
2. SearXNG user did not selected a region tag, example::
!presearch bmw :en
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 19:23:26 +01:00
Markus Heiser
a2c269bbac
[mod] presearch: hardening engine's response against KeyErrors
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 19:23:26 +01:00
Bnyro
0a78f59aba
[fix] presearch: safesearch, time ranges, crash when no result found
2024-01-15 19:23:26 +01:00
Markus Heiser
87f18b98ec
[fix] SyntaxWarning: invalid escape sequence '\>'
...
This patch fixes issue reported by ``make test.unit``::
searx/search/checker/impl.py:39: SyntaxWarning: invalid escape sequence '\>'
rep = ['<' + tag + '[^\>]*>' for tag in HTML_TAGS]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-15 18:27:21 +01:00
searxng-bot
b0b2efdc8d
[translations] update from Weblate
...
3dafa37f3a641db83fa3d2b083fb6dec1f75eb76d8b8d
2024-01-13 09:33:41 +01:00
Markus Heiser
f9c5727ddc
[mod] get rid of ./utils/brand.env and its workflow
...
All the environments defined in ./utils/brand.env are generated on the fly, so
there is no longer a need to define the brand environment in this file and all
the workflows to handle this file.
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2024-01-09 16:31:19 +01:00
Bnyro
3dea7e609b
[feat] autocompleter: implementation of stract (beta)
2024-01-07 11:18:16 +01:00
Bnyro
621e1313af
[feat] engine: implementation of stract (beta)
2024-01-07 11:18:16 +01:00
searxng-bot
c90dc201fc
[translations] update from Weblate
...
a04e3b59ca4d38784780521c1b3e909528152debd5992c4d54c3e51a0c9c025dc99d1390477e0114965dacdd306a20c8853
2024-01-06 16:20:13 +01:00
Émilien (perso)
3535377c9a
Searx to SearXNG change error message
2023-12-31 16:19:14 +01:00
searxng-bot
27e26b3d65
[translations] update from Weblate
...
966bbd849d4680cb39b2cf5fbaffa8654087fc759fe0bcf9b03bfd03bd7340088ffa01ec736c44d3fdd3a15279fd68404ee941e6023241dfd42d71ca048b0b
2023-12-29 08:48:24 +01:00
dalf
4647981419
Update searx.data - update_wikidata_units.py
2023-12-29 06:09:04 +01:00
dalf
a8cc101c35
Update searx.data - update_ahmia_blacklist.py
2023-12-29 06:08:35 +01:00
dalf
59a67f30c8
Update searx.data - update_firefox_version.py
2023-12-29 06:07:46 +01:00
dalf
81e8638de0
Update searx.data - update_currencies.py
2023-12-29 06:06:51 +01:00
Markus Heiser
d676ae8ab3
[build] /static
2023-12-28 19:15:04 +01:00
Jinyuan Huang
f6d797ef43
[fix] fix a display problem in the image detail preview.
2023-12-28 19:15:04 +01:00
Markus Heiser
0d47322ac8
[build] /static
2023-12-28 18:59:14 +01:00
ahmad-alkadri
07e846e91a
Prevent default browser behavior on click event
2023-12-28 18:59:14 +01:00
Markus Heiser
8dfc1dbc5c
[fix] engine - offical URL moved to https://lingva.thedaviddelta.com/
...
The ML top-level domain has been removed from Freenom ... moved the official
instance to https://lingva.thedaviddelta.com [1]
To test use translation syntax:
!lv en-de Alternative front-end for Google Translate
[1] https://fosstodon.org/@thedaviddelta/111376540936289966
Closes: https://github.com/searxng/searxng/issues/2718
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-25 09:57:35 +01:00
Markus Heiser
2863b0f6da
Update searx.data - update_engine_traits.py
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-24 08:28:32 +01:00
Markus Heiser
6df922b9da
[fix] fetch_traits of google and zlibrary
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-24 08:28:32 +01:00
Bnyro
d6ac2b5a55
[feat] engine: implementation of bahnhof.de
2023-12-23 17:38:38 +01:00
Markus Heiser
6129b16165
[mod] simplify no results on pages > 1 to "There are no more results."
...
BTW: remove not needed whitespaces in the generated HTML
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-23 09:50:39 +01:00
obfuscated-loop
2179a418c4
[mod] Change no results error message based on page number
2023-12-23 09:50:39 +01:00
Jay
b4de72a96f
[mod] Capitalize theme names/styles in theme.html view file
2023-12-23 09:07:08 +01:00
dependabot[bot]
26737fda1b
Bump sharp from 0.32.6 to 0.33.0 in /searx/static/themes/simple
...
Bumps [sharp](https://github.com/lovell/sharp ) from 0.32.6 to 0.33.0.
- [Release notes](https://github.com/lovell/sharp/releases )
- [Changelog](https://github.com/lovell/sharp/blob/main/docs/changelog.md )
- [Commits](https://github.com/lovell/sharp/compare/v0.32.6...v0.33.0 )
---
updated-dependencies:
- dependency-name: sharp
dependency-type: direct:development
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
2023-12-23 07:49:03 +01:00
Markus Heiser
3665b32aff
Revert "[fix] update user agent"
...
This reverts commit 3c6549a17fhttps://github.com/searxng/searxng/pull/2826
2023-12-23 07:48:38 +01:00
searxng-bot
518dd97c89
[translations] update from Weblate
...
fc2dfc1083938cfbac7b7286fba1d066d218
2023-12-23 07:40:02 +01:00
Bnyro
8a4104b992
[feat] engine: implementation of rotten tomatoes
2023-12-11 18:59:36 +01:00
Bnyro
dda74fc9c9
[feat] engine: implementation of mdn
2023-12-11 18:57:40 +01:00
Bnyro
b5b81c9806
[feat] engine: implementation of fyyd
2023-12-11 18:56:32 +01:00
Bnyro
527e13ab46
[feat] engine: implementation of podcastindex.org
2023-12-11 18:55:16 +01:00
Bnyro
3bc85c511c
[mod] tootfinder: implement python module
2023-12-11 18:54:24 +01:00
Brock Vojkovic
0bcff32dd7
[fix] update check.searx.space IP addresses
2023-12-11 15:21:02 +01:00
searxng-bot
574ed29d3e
[translations] update from Weblate
...
fa2970d07f19144327110f1b4dbc791e0c811f45cc83a5f93c2a390d735b7aa9cad06b0997554eaa22f4e19946d1dac8b5b5c57f6eb54e3908a204d2b58e4043a40da4d89f08502e
2023-12-08 08:42:24 +01:00
Markus Heiser
3829c253ff
[mod] add option max_page to bing, brave, qwant, startpage & mojeek
...
[1] https://github.com/searxng/searxng/issues/2982#issuecomment-1808975780
Reported-by: @Damaj301damaj-lol [1]
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-03 13:47:17 +01:00
Markus Heiser
2274d55d5a
[mod] add option max_page
...
Related: https://github.com/searxng/searxng/issues/2982
Closes: https://github.com/searxng/searxng/issues/2972
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-12-03 13:47:17 +01:00
dalf
5a72977efa
Update searx.data - update_currencies.py
2023-11-29 06:34:25 +01:00
dalf
b18bef17a7
Update searx.data - update_engine_descriptions.py
2023-11-29 06:24:03 +01:00
dalf
a136b0b44d
Update searx.data - update_ahmia_blacklist.py
2023-11-29 06:18:21 +01:00
dalf
3ca84cb8d7
Update searx.data - update_wikidata_units.py
2023-11-29 06:17:32 +01:00
Bnyro
bf75a8c2a0
[feat] engine: implementation of bpb
2023-11-27 16:46:41 +01:00
Bnyro
04cfce2eb8
[feat] yep: support for images and news (and safesearch)
2023-11-27 15:07:26 +01:00
Markus Heiser
ee2675c999
[update] make pygments.less
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-27 14:43:43 +01:00
Markus Heiser
44392bd436
[mod] improve implementation of presearch engine
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-27 14:16:42 +01:00
Bnyro
23582aac5c
[feat] implementation of presearch engine
2023-11-27 14:16:42 +01:00
obfuscated-loop
99fb565b39
[mod] Retain page numbers even when there are no results
2023-11-27 14:07:04 +01:00
Bnyro
c3cc24be12
[feat] engine: implementation of destatis
2023-11-27 13:54:48 +01:00
searxng-bot
a36eae1d68
[translations] update from Weblate
...
d0511fe50e5d09a011111634b3329df37609bb415aca14b05dce9f2f730019b389a46a052620f6911716d7001d30f17f24cb7c4062e27ba200bc5
2023-11-27 07:32:05 +01:00
obfuscated-loop
cc6058057d
[build] /static
2023-11-23 07:30:56 +01:00
obfuscated-loop
355d2dc678
[fix] Remove anchor tag outline in image results
2023-11-23 07:30:56 +01:00
searxng-bot
e99ebb3dec
[translations] update from Weblate
...
e245d1bd08ee33fca31c8c1557c925c63f4115908183bdd57115ef9db7544d823ce4d1f2902b8bafd2350f4a0510e6293fd477881443556b2f6113133818f8
2023-11-22 09:43:45 +01:00
Jinyuan Huang
3601badd84
[build] /static
2023-11-14 13:34:44 +01:00
Jinyuan Huang
903449e0b5
[fix] Images cannot be clicked anymore #3006
...
URL in sidedbar only exists in HTTP POST requests. On HTTP GET requests the
selector ``#search_url button#copy_url`` results in a ``null`` type and a
``.style.display`` raises::
Uncaught TypeError: d.querySelector(...) is null
As a result, the initialization of the event handler is no longer carried out.
Closes: https://github.com/searxng/searxng/issues/3003
Suggested-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-14 13:28:50 +01:00
searxng-bot
79db70f2b7
[translations] update from Weblate
...
2b7f195db411951c72878199f48512f9981aadcaeb0c6acc01d46d32f1dd13caafe161aac910601c9
2023-11-12 20:54:35 +01:00
Jinyuan Huang
727de1c4ef
[build] /static
2023-11-10 13:28:28 +00:00
Jinyuan Huang
8adc7b0433
add a "copy" button to the "search-url" sidebar
2023-11-10 13:28:04 +00:00
searxng-bot
96ccec1aa6
[translations] update from Weblate
...
acdcdace831a1602a9a1d1070d3
2023-11-03 10:01:28 +01:00
Markus Heiser
b5a8ddfec8
Revert "[fix] limit maximum page number of a search query to page 50." ( #2979 )
...
This reverts commit 7e2e335dd1
2023-11-01 16:55:20 +00:00
Markus Heiser
d13a8f6453
[mod] document server:public_instance & remove it out of the botdetection
...
- the option server:public_instance lacks some documentation
- the processing of this option belongs in the limiter and not
in botdetection module
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-01 06:44:56 +01:00
Markus Heiser
fd814aac86
[mod] isolation of botdetection from the limiter
...
This patch was inspired by the discussion around PR-2882 [2]. The goals of this
patch are:
1. Convert plugin searx.plugin.limiter to normal code [1]
2. isolation of botdetection from the limiter [2]
3. searx/{tools => botdetection}/config.py and drop searx.tools
4. in URL /config, 'limiter.enabled' is true only if the limiter is really
enabled (Redis is available).
This patch moves all the code that belongs to botdetection into namespace
searx.botdetection and code that belongs to limiter is placed in namespace
searx.limiter.
Tthe limiter used to be a plugin at some point botdetection was added, it was
not a plugin. The modularization of these two components was long overdue.
With the clear modularization, the documentation could then also be organized
according to the architecture.
[1] https://github.com/searxng/searxng/pull/2882
[2] https://github.com/searxng/searxng/pull/2882#issuecomment-1741716891
To test:
- check the app works without the limiter, check `/config`
- check the app works with the limiter and with the token, check `/config`
- make docs.live .. and read
- http://0.0.0.0:8000/admin/searx.limiter.html
- http://0.0.0.0:8000/src/searx.botdetection.html#botdetection
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-11-01 06:44:56 +01:00
sev
b05a15540e
Check public_instance in simple theme
...
Fix #2975
2023-10-31 10:40:19 +01:00
Markus Heiser
7e2e335dd1
[fix] limit maximum page number of a search query to page 50.
...
To test this PR run a local instance and try to query page 51:
http://127.0.0.1:8888/search?q=foo&pageno=51
A parameter exception will be raised:
searx.exceptions.SearxParameterException: Invalid value "51" for parameter pageno
And the client will receive a HTTP 400 (Bad request).
Closes https://github.com/searxng/searxng/issues/2972
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-29 16:17:25 +01:00
dalf
b63841f0a1
Update searx.data - update_engine_traits.py
2023-10-29 09:04:24 +01:00
dalf
a9d778ee0f
Update searx.data - update_wikidata_units.py
2023-10-29 08:45:15 +01:00
dalf
92efb941d8
Update searx.data - update_firefox_version.py
2023-10-29 08:44:59 +01:00
dalf
fa494b9be3
Update searx.data - update_currencies.py
2023-10-29 08:44:35 +01:00
dalf
1b92ea4e70
Update searx.data - update_engine_descriptions.py
2023-10-29 08:44:17 +01:00
dalf
55e7cb3e33
Update searx.data - update_ahmia_blacklist.py
2023-10-29 08:17:29 +01:00
searxng-bot
6af8644ead
[translations] update from Weblate
...
4e5e5db44e1a8d350884bddfb89d67a4114d62fe8e3286e37ab9752cdab3247cf7ea72340ea31389322151e440e4eaf42b6
2023-10-27 09:23:23 +02:00
Markus Heiser
ef56e1d684
[fix] HTMLParser: undocumented not implemented method
...
In python versions <py3.10 there is an issue with an undocumented method
HTMLParser.error() [1][2] that was deprecated in Python 3.4 and removed
in Python 3.5.
To be compatible to higher versions (>=py3.10) an error method is implemented
which throws an AssertionError exception like the higher Python versions do [3].
[1] https://github.com/python/cpython/issues/76025
[2] https://bugs.python.org/issue31844
[3] https://github.com/python/cpython/pull/8562
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-22 10:35:02 +02:00
searxng-bot
01b5b9cb8e
[translations] update from Weblate
...
2325f15835090c6a8e3a38219d894a9f4164bdbeb4b30f9b483f487f1ca1997c5a701dc4
2023-10-20 10:44:11 +02:00
Markus Heiser
b013cbb4cc
[build] /static
2023-10-13 12:56:29 +02:00
Bnyro
df2e41c150
[fix] search.js: crash on homepage when setting form listeners
2023-10-13 12:56:29 +02:00
Émilien (perso)
4280318fc5
fixing results parsing brave
2023-10-13 11:47:30 +02:00
searxng-bot
ac82daf58d
[translations] update from Weblate
...
74e401e68897dd8db16ed046a90815ecb33665d9a0c2f3ec249ef953dc6c108
2023-10-13 09:20:54 +02:00
Hackurei
efada7cba2
[fix] hackernews keyerror problem
2023-10-13 08:16:47 +02:00
Hackurei
af071121de
[fix] imgur - incorrect wikidata id
2023-10-12 09:14:00 +02:00
Markus Heiser
14323d683f
[fix] ddg-lite & ddg-extra: don't send empty vqd value
...
DDG's bot detection is sensitive to the vqd value. For some search terms (such
as extremely long search terms that are often sent by bots), no vqd value can be
determined.
If SearXNG cannot determine a vqd value, then no request should go out to
DDG (WEB): a request with a wrong vqd value leads to DDG temporarily putting
SearXNG's IP on a block list.
Requests from IPs in this block list run into timeouts.
Not sure, but it seems the block list is a sliding window: to get my IP rid from
the bot list I had to cool down my IP for 1h (send no requests from that IP to
DDG).
Since such issues can't reproduce in a local instance I tested this patch 24h on
my public SearXNG instance: There are still errors (rare), but the reliability
is still 100%.
Related:
- https://github.com/searxng/searxng/pull/2922
- https://github.com/searxng/searxng/pull/2923
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-12 08:52:28 +02:00
Markus Heiser
3388441917
[fix] ddg-lite vqd value: some search terms do not have a vqd value
...
Some search terms do not have results and therefore no vqd value
BTW: remove a leftover from 9197efa
2023-10-10 09:12:30 +02:00
Markus Heiser
9197efa2a7
[fix] duckduckgo lite engine: set HTTP header 'Referer'
...
We have had problems with this before, the bot protection from ddg-lite seems to
have included this referer in the rating [1][2].
From reverse engineering:
- The Referer ``https://google.com/ `` was set in commt 257dc7d6c4https://github.com/searxng/searxng/pull/2161
[2] https://github.com/searxng/searxng/pull/2081
Closes: https://github.com/searxng/searxng/issues/2796
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2023-10-10 08:40:53 +02:00
Bnyro
fa5b2a7948
[mod] yacy: use official instance by default and fix crashes
2023-10-09 20:50:24 +02:00
Alex Balgavy
5d53aac20f
[mod] add hotkeys option to settings.yml
...
The change in the hotkey mechanism introduced in 317db5b04Closes : #2898
2023-10-09 18:13:00 +02:00
Hackurei
ff78b1a902
[feat] implement hackernews engine - news.ycombinator.com
2023-10-09 14:00:04 +02:00
Aine
213cb74378
[fix] matrixrooms add proper MRS integration
...
Related:
- https://github.com/searxng/searxng/issues/2918
2023-10-09 13:25:13 +02:00
Bnyro
48cb58bd2e
[feat] duckduckgo: support for videos and news
2023-10-09 06:53:43 +02:00
Bnyro
c3ab49cd90
[fix] kickass: crash when no results
2023-10-07 11:48:23 +02:00
Bnyro
f22daf8b47
[mod] piped: always show video length if available
2023-10-07 11:45:46 +02:00
Bnyro
ce270961e8
[feat] engine: implementation of mastodon
2023-10-06 10:58:23 +02:00
