Léon Tiekötter
94b3656b4a
[fix] google engine: results XPath
...
Seems google rolls out changes first on the `google.com` domain and later on the
"language" domains. By example: yesterday [1] `google.com` did not work but
`google.de` and `google.fr` did work, today they do not work any longer and this
fix is needed on all domains.
Closes: https://github.com/searxng/searxng/issues/1628
[1] https://github.com/searxng/searxng/issues/1628#issuecomment-1208191816
2022-08-09 06:23:59 +02:00
Markus Heiser
925f3ff487
Merge pull request #1627 from allendema/add-marginalia
...
[enh] Initial Marginalia.nu support (foss)
2022-08-08 06:53:02 +02:00
Markus Heiser
58f630d312
Merge pull request #1623 from return42/mod-yep.com
...
[mod] engine yep.com: show all 100 results yep.com has
2022-08-08 06:52:15 +02:00
Allen
5b815b3966
[enh] initial Marginalia.nu support (foss)
...
Currently it uses a public api_key `/public/` [1]
The 'index' parameter selects the search index, corresponding to the drop down
next to the search field in the main GUI.
0: popular
1: blogs
2: big_sites
3: default
4: experimental
'experimental' is more up to date and does not exclude other sites, which is the
case with 'big sites' or 'blogs'.
[1] https://api.marginalia.nu/
[2] https://git.marginalia.nu/marginalia/marginalia.nu
[3] https://news.ycombinator.com/item?id=31536626
Closes: https://github.com/searxng/searxng/issues/1620
2022-08-08 06:31:04 +02:00
Markus Heiser
8b58cd1167
[fix] typo in uWSGI cache: searxcache --> searxngcache
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-07 12:31:09 +02:00
Markus Heiser
647e6187d7
[mod] engine yep.com: show all 100 results yep.com has
...
yep.com is still in beta, the api.yep.com does not have paging support. There
is only a 'limit' argument with a maximum of 100 results.
yep.com seems fast; there is nor need for a timeout of 12 sec.
The API returns JSON nevertheless what the HTTP header is, the "show more"
button on yep.com's web site does not set a special HTTP Accept header.
FYI: The index does not support languages, the WEB UI does not offer a language
selection of the results and the entire index seems in English.
Closes: https://github.com/searxng/searxng/issues/1619
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-06 13:21:28 +02:00
searxng-bot
0f02fcc836
[translations] update from Weblate
...
acf8bd394ad75b6eee8cbee687c19313cbe0de3245029a176eec3795f8d8f31fb3fb365faaeabbc96c71c501f7b5ba19850e7fa00cb696fc04c3785fb500f2ad0b576b830adeb6e20b025f17
2022-08-05 07:18:24 +00:00
Allen
58369e41d6
[wip] brave time range support
2022-08-04 04:47:25 +02:00
Markus Heiser
8df1f0c47e
[mod] add 'Accept-Language' HTTP header to online processores
...
Most engines that support languages (and regions) use the Accept-Language from
the WEB browser to build a response that fits to the language (and region).
- add new engine option: send_accept_language_header
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-01 17:01:59 +02:00
Markus Heiser
a2badb4fe4
[doc] add description of method EngineProcessor.get_params()
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-08-01 16:42:33 +02:00
Alexandre Flament
2babf59adc
[fix] pyright repported errors
...
The errors make pyright usage useless since a new error won't be seen [1].
[1] https://github.com/searxng/searxng/pull/1569
```
searx/compat.py:11:27 - error: Expression of type "Type[cached_property[_T@cached_property]]" cannot be assigned to declared type "Type[cached_property]"
"Type[cached_property[_T@cached_property]]" is incompatible with "Type[cached_property]"
Type "Type[cached_property[_T@cached_property]]" cannot be assigned to type "Type[cached_property]" (reportGeneralTypeIssues)
searx/utils.py:69:36 - error: Expression of type "None" cannot be assigned to parameter of type "str"
Type "None" cannot be assigned to type "str" (reportGeneralTypeIssues)
searx/utils.py:573:85 - error: Expression of type "None" cannot be assigned to parameter of type "int"
Type "None" cannot be assigned to type "int" (reportGeneralTypeIssues)
searx/webapp.py:1306:22 - error: Argument of type "str" cannot be assigned to parameter "__a" of type "BytesPath" in function "join"
Type "str" cannot be assigned to type "BytesPath"
"str" is incompatible with "bytes"
"str" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:68 - error: Argument of type "Literal['themes']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "Literal['themes']" cannot be assigned to type "BytesPath"
"Literal['themes']" is incompatible with "bytes"
"Literal['themes']" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:78 - error: Argument of type "str | Any | None" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "str | Any | None" cannot be assigned to type "BytesPath"
Type "str" cannot be assigned to type "BytesPath"
"str" is incompatible with "bytes"
"str" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/webapp.py:1306:85 - error: Argument of type "Literal['img']" cannot be assigned to parameter "paths" of type "BytesPath" in function "join"
Type "Literal['img']" cannot be assigned to type "BytesPath"
"Literal['img']" is incompatible with "bytes"
"Literal['img']" is incompatible with protocol "PathLike[bytes]"
"__fspath__" is not present (reportGeneralTypeIssues)
searx/engines/mongodb.py:8:6 - warning: Import "pymongo" could not be resolved (reportMissingImports)
searx/engines/mysql_server.py:9:8 - warning: Import "mysql.connector" could not be resolved (reportMissingImports)
searx/engines/postgresql.py:9:8 - warning: Import "psycopg2" could not be resolved from source (reportMissingModuleSource)
searx/engines/xpath.py:187:28 - warning: "categories" is not defined (reportUndefinedVariable)
searx/search/__init__.py:184:82 - warning: "flask" is not defined (reportUndefinedVariable)
searx/search/checker/background.py:19:26 - error: Type of "schedule" is partially unknown
Type of "schedule" is "(delay: Any, func: Any, *args: Any) -> Literal[True]" (reportUnknownVariableType)
searx/shared/__init__.py:8:12 - warning: Import "uwsgi" could not be resolved (reportMissingImports)
searx/shared/shared_uwsgi.py:5:8 - warning: Import "uwsgi" could not be resolved (reportMissingImports)
```
2022-07-30 18:04:44 +02:00
Markus Heiser
782f73540e
[utils/searxng.sh] implement new script to install SearXNG
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-30 13:39:35 +02:00
searxng-bot
953aaec6a3
[translations] update from Weblate
...
c0c9107c5b48bce679669e65520e92847cf52ff59d3ebe722d03c097388af012a4bcf09893fd0b728f68b2069007c99caeec96f269084863b48190abb6bbc0a51a503806c960cb938a2bd34b1064cea06742304556c87fda36a64f1c
2022-07-29 07:17:55 +00:00
Markus Heiser
14085cc0a7
Merge pull request #1580 from searxng/update_data_update_engine_descriptions.py
...
Update searx.data - update_engine_descriptions.py
2022-07-29 07:23:02 +02:00
Markus Heiser
7602c23d71
Merge pull request #1579 from searxng/update_data_update_currencies.py
...
Update searx.data - update_currencies.py
2022-07-29 07:22:12 +02:00
Markus Heiser
0bad4fb931
Merge pull request #1578 from searxng/update_data_update_firefox_version.py
...
Update searx.data - update_firefox_version.py
2022-07-29 07:21:06 +02:00
Markus Heiser
7dd75ae080
Merge pull request #1576 from searxng/update_data_update_languages.py
...
Update searx.data - update_languages.py
2022-07-29 07:20:28 +02:00
dalf
2bdb367e8c
Update searx.data - update_engine_descriptions.py
2022-07-29 02:13:07 +00:00
dalf
fc019fb296
Update searx.data - update_currencies.py
2022-07-29 02:01:30 +00:00
dalf
c2662ec3c8
Update searx.data - update_firefox_version.py
2022-07-29 02:01:08 +00:00
dalf
385542e6c5
Update searx.data - update_ahmia_blacklist.py
2022-07-29 02:01:04 +00:00
dalf
90068b3d0b
Update searx.data - update_languages.py
2022-07-29 02:00:53 +00:00
Markus Heiser
c72d70d45c
Revert "Quick fix for google engine for EU countries"
...
This reverts commit 747cf1a246
2022-07-26 06:39:44 +02:00
Léon Tiekötter
950f036c03
[fix] google engine: results XPath
2022-07-26 00:24:15 +02:00
Émilien Devos
747cf1a246
Quick fix for google engine for EU countries
...
This revert part of the commit of 5fb2071cb2
2022-07-25 20:48:50 +00:00
Markus Heiser
0be0e63117
[fix] demo_online.py - fixed typo
...
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-25 20:04:00 +02:00
Emilien Devos
5fb2071cb2
[fix] google & youtube - set EU consent cookie
...
This change the previous bypass method for Google consent using
``ucbcb=1`` (6face215b8https://www.google.com/search?q=time&tbm=isch " \
-A "Mozilla/5.0 (X11; Linux i686; rv:102.0) Gecko/20100101 Firefox/102.0" \
| grep -i consent
...
location: https://consent.google.com/m?continue=https://www.google.com/search?q%3Dtime%26tbm%3Disch&gl=DE&m=0&pc=irp&uxe=eomtm&hl=en-US&src=1
set-cookie: CONSENT=PENDING+936; expires=Wed, 24-Jul-2024 11:26:20 GMT; path=/; domain=.google.com; Secure
...
PENDING & YES [2]:
Google change the way for consent about YouTube cookies agreement in EU
countries. Instead of showing a popup in the website, YouTube redirects the
user to a new webpage at consent.youtube.com domain ... Fix for this is to
put a cookie CONSENT with YES+ value for every YouTube request
[1] https://github.com/iv-org/invidious/pull/2207
[2] https://github.com/TeamNewPipe/NewPipeExtractor/issues/592
Closes: https://github.com/searxng/searxng/issues/1432
2022-07-25 13:27:06 +02:00
Markus Heiser
4231a5770b
[fix] sjp engine - convert enginename to a latin1 compliance name
...
The engine name is not only a *name* its also a identifier that is used in
logs, HTTP headers and more. Unicode characters in the name of an engine could
cause various issues.
Closes: https://github.com/searxng/searxng/issues/1544
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-24 21:10:55 +02:00
james-still
2516e21c58
[fix] emojipedia - update XPath to be relative
2022-07-24 19:14:26 +02:00
Markus Heiser
1540891561
[fix] engine tineye: handle 422 response of not supported img format
...
Closes: https://github.com/searxng/searxng/issues/1449
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-23 16:00:58 +02:00
searxng-bot
561433b12b
[translations] update from Weblate
...
cf6e9482918c1bfe4e65ecf6a54be8fecad6cb2fa6bd11709d0e8754
2022-07-22 07:20:00 +00:00
Solirs
6d646129c3
[mod] add tor_check plugin - convenient tor checking trough searxng
2022-07-19 07:34:54 +02:00
Léon Tiekötter
d339e97727
[fix] preferences: missing option value
...
Fix missing option value "0".
2022-07-17 19:51:12 +02:00
Markus Heiser
7bf4e8d12d
Merge pull request #1512 from searxng/translations_update
...
Update translations
2022-07-15 09:45:03 +02:00
Markus Heiser
4e05197444
Merge pull request #1475 from return42/Emojipedia
...
[mod] Add engine for Emojipedia
2022-07-15 09:30:40 +02:00
Markus Heiser
445cba7c02
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-15 09:26:44 +02:00
Jay
10edcbe3c2
[mod] Add engine for Emojipedia
...
Emojipedia is an emoji reference website which documents the meaning and
common usage of emoji characters in the Unicode Standard. It is owned by Zedge
since 2021. Emojipedia is a voting member of The Unicode Consortium.[1]
Cherry picked from @james-still [2[3] and slightly modified to fit SearXNG's
quality gates.
[1] https://en.wikipedia.org/wiki/Emojipedia
[2] 2fc01eb20fhttps://github.com/searx/searx/pull/3278
2022-07-15 09:26:44 +02:00
searxng-bot
f84e9f8154
[translations] update from Weblate
...
e78584e1eb3f21409160b6d118d569b8c9137f9e14d8b61fc11e318d4d53b3bb613117bfe5e383052bea37fa5ab1588132794ad3830b01f9b4d431e5c6d9841e686926568cba6d36fe45788695e7d403f02673b17d49be29fbe6e4da
2022-07-15 07:19:07 +00:00
Léon Tiekötter
8e509941b9
[mod] allow brand.issue_url to overwrite the step1 url
2022-07-10 18:43:53 +02:00
Alexandre Flament
44f2eb50a5
Merge pull request #1219 from dalf/follow_bing_redirect
...
bing.py: remove redirection links
2022-07-10 18:06:22 +02:00
Emilien Devos
6face215b8
bypass google consent with ucbcb=1
2022-07-09 21:33:24 +00:00
Brock Vojković
84e2a3bd3f
Add infinite scroll as a setting in settings.yml
2022-07-09 17:33:25 +00:00
Alexandre Flament
a1e8af0796
bing.py: resolve bing.com/ck/a redirections
...
add a new function searx.network.multi_requests to send multiple HTTP requests at once
2022-07-08 22:02:21 +02:00
Alexandre Flament
7e695c6644
Merge pull request #1478 from dalf/submit_bug_workflow
...
Engine error log: Submit a new issue button: ask the user to check if there are some existing issues.
2022-07-08 20:24:00 +02:00
Alexandre Flament
f90aed7ef9
locales.py: add support for Papiamento
2022-07-08 10:00:20 +02:00
searxng-bot
cb3a31c04d
[translations] update from Weblate
...
b1809ae3cf09e8b25a854ba3e35864339465ae781e1799d056429ebbe1e040b1d04f51ef1a09e45afab4f6de782eac5c73f6dde9eb3bf7a45c3376168511391a816ec36424adf82f25e13dcff2008c3679b9b12a1f2f61c8e7a1cd6efc02ccbf3d1afa8895c871d2f8825dd1a781c97c7290ce9c0a1286c5baa49eef3d3fbc15a1eb8798a08b01a6356344468d1fe456805da3b0c6f02ceecd8246136a4b41ee53eb448a7012f64351ea1d58744d130ce92d37cd4576e883da7a9b10f20a317fcab15b1512d6021cc86a37389c6d05e22b6ca75155e9663c49fac625
2022-07-08 07:18:05 +00:00
Alexandre Flament
be3ecf6e31
[build] /static
2022-07-08 09:04:57 +02:00
Alexandre Flament
eb489c45ea
Submit GH bug: ask the user to do some checks before submitting a new issue
2022-07-08 09:04:57 +02:00
Markus Heiser
81e8c7370f
Update searx.data - update_engine_descriptions.py
...
./manage pyenv.cmd python ./searxng_extra/update/update_engine_descriptions.py
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2022-07-07 17:16:41 +02:00
Markus Heiser
c63fab6928
Merge pull request #1443 from return42/fix-online_dictionary
...
[fix] online_dictionary: regular expression
2022-07-07 16:25:10 +02:00
