kamp/searxng
1
0
Fork 0
mirror of https://github.com/searxng/searxng.git synced 2024-11-05 12:50:11 +01:00
Code
6,723 Commits 7 Branches 17 Tags 128 MiB
3cade9a7eb
Commit Graph

619 Commits

Author SHA1 Message Date
Markus Heiser
25b5797a0c
Merge pull request #103 from searxng/add-sqlite-engine2 
[enh] add offline engine for sqlite database
 2021-05-27 14:06:42 +00:00
Alexandre Flament
2ea34a3c36 [enh] add offline engine for sqlite database 
To test & demonstrate this implementation download:

  https://liste.mediathekview.de/filmliste-v2.db.bz2

and unpack into searx/data/filmliste-v2.db, in your settings.yml define a sqlite
engine named "demo"::

    - name : demo
      engine : sqlite
      shortcut: demo
      categories: general
      result_template: default.html
      database : searx/data/filmliste-v2.db
      query_str :  >-
        SELECT title || ' (' || time(duration, 'unixepoch') || ')' AS title,
               COALESCE( NULLIF(url_video_hd,''), NULLIF(url_video_sd,''), url_video) AS url,
               description AS content
          FROM film
         WHERE title LIKE :wildcard OR description LIKE :wildcard
         ORDER BY duration DESC
      disabled : False

Query to test: "!demo concert"

This is a rewrite of the implementation from commit [1]

[1] searx/searx@8e90a21

Suggested-by: @virtadpt searx/searx#2808
 2021-05-27 14:27:11 +02:00
Markus Heiser
97d173eda0 [mod] unsplash engine - activated by default 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-05-25 17:41:10 +02:00
Markus Heiser
57cdf180fe [fix] engine archive is - search_url has been changed 
BTW: set soft_max_redirects from *archive is* by 1, to prevent logging::

    DEBUG:httpx._client:HTTP Request: GET https://archive.is/search/?q=www.python.org "HTTP/2 302 Found"
    DEBUG:httpx._client:HTTP Request: GET https://archive.is/www.python.org "HTTP/2 200 OK"
    DEBUG:searx:archive is: ErrorContext('searx/search/processors/online.py', 110, 'count_error(self.engine_name,', None, '1 redirects, maximum: 0', ('200', 'OK', 'archive.is')) True

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-05-17 15:21:53 +02:00
Markus Heiser
5253df946b
[mod] option to enable or disable "proxy" button next to each result (#54) 
* [mod] option to enable or disable "proxy" button next to each result

Closes: https://github.com/searxng/searxng/issues/51
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
Co-authored-by: Alexandre Flament <alex@al-f.net>
 2021-05-04 11:57:14 +02:00
Alexandre Flament
51494849fc
Merge pull request #23 from searxng/metrics-stats-engines 
Metrics stats engines
 2021-04-25 14:31:52 +02:00
Alexandre Flament
df41b77121 [mod] /stats : detail per engine 
allow to submit a github issue including the technical details
(exceptions, errors, warning, checker result)
 2021-04-25 14:28:06 +02:00
Markus Heiser
28b25185c5 [brand] searxng -- fix links to issue tracker & WEB-GUI 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-04-25 14:25:08 +02:00
Markus Heiser
c6a5cc019a [brand] searxng is a fork from searx 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-04-25 11:42:42 +02:00
Markus Heiser
6d41255eb1 [fix] Springer-Nature & core.ac need API key to work 
It is the whole engine definition that should be comment out : without the
api_key nothing works.

Signed-off-by: Markus Heiser <markus@darmarit.de>
 2021-04-24 09:00:53 +02:00
spongebob33
7528e38c8a add core.ac.uk engine 2021-04-24 08:55:45 +02:00
Alexandre Flament
3755cf2eba More branding 2021-04-22 21:10:22 +02:00
Alexandre Flament
9d84025e4f searxng brand 2021-04-22 19:57:02 +02:00
Alexandre Flament
d01741c9a2
Merge pull request #15 from return42/add-springer 
Add a search engine for Springer Nature
 2021-04-22 13:23:31 +02:00
Pierre Chevalier
a80bf1ba97 [enh] Add Springer Nature engine 
Springer Nature is a global publisher dedicated to providing service to research
community [1] with official API [2].

To test this PR, first get your API key following this page:

   https://dev.springernature.com/signup

In searx/engines/springer.py at line 24, add this API key.  I left my own key,
commented out in the line aboce.  Feel free to use it, if needed.

[1] https://www.springernature.com/
[2] https://dev.springernature.com/
 2021-04-22 12:35:25 +02:00
habsinn
41a2e3785e [enh] add engine using API from "The Art Institute of Chicago" 2021-04-22 12:25:43 +02:00
Markus Heiser
9a05ad4c73 [enh] add DOI resolver from sci-hub / replace default DOI 
The new sci-hub URLs are comming from @aurora-vasiliev [1].

[1] https://github.com/searx/searx/pull/2706

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-04-22 12:13:01 +02:00
Alexandre Flament
48720e20a8 Merge remote-tracking branch 'searx/master' 2021-04-19 09:35:12 +02:00
Noémi Ványi
8362257b9a
Merge pull request #2736 from plague-doctor/sjp 
Add new engine: SJP - Słownik języka polskiego
 2021-04-16 17:30:14 +02:00
Kyle Anthony Williams
4d3c399ee9 [feat] add bandcamp engine 2021-04-15 08:52:11 +02:00
Alexandre Flament
d14994dc73 [httpx] replace searx.poolrequests by searx.network 
settings.yml:

* outgoing.networks:
   * can contains network definition
   * propertiers: enable_http, verify, http2, max_connections, max_keepalive_connections,
     keepalive_expiry, local_addresses, support_ipv4, support_ipv6, proxies, max_redirects, retries
   * retries: 0 by default, number of times searx retries to send the HTTP request (using different IP & proxy each time)
   * local_addresses can be "192.168.0.1/24" (it supports IPv6)
   * support_ipv4 & support_ipv6: both True by default
     see https://github.com/searx/searx/pull/1034
* each engine can define a "network" section:
   * either a full network description
   * either reference an existing network

* all HTTP requests of engine use the same HTTP configuration (it was not the case before, see proxy configuration in master)
 2021-04-12 17:25:56 +02:00
Alexandre Flament
eaa694fb7d [enh] replace requests by httpx 2021-04-10 15:38:33 +02:00
Plague Doctor
599ff39ddf Fix conflicts 2021-04-09 06:54:03 +10:00
Plague Doctor
6631f11305 Add new engine: SJP 2021-04-08 10:21:54 +10:00
Plague Doctor
7035bed4ee Add new engine: Wordnik.com 2021-04-08 09:58:00 +10:00
Noémi Ványi
07f5edce3d Add Meilisearch engine 
Website: https://www.meilisearch.com/
 2021-04-06 21:57:05 +02:00
Markus Heiser
ebfd0eb2b7 [fix] default_doi_resolver in preferences 
Instead of a hard-coded `oadoi.org` default, use the default value from
`settings.yml`.

Fix an issue in the themes: The replacement 'current_doi_resolver' contains the
doi_resolver_url, not the name of the DOI resolver.  Compare return value of::

    searx.plugins.oa_doi_rewrite.get_doi_resolver(...)

Fix a typo in `get_doi_resolver(..)`:  suggested by @kvch:

  *L32 should set doi_resolver not doi_resolvers*

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-04-04 13:36:33 +02:00
Noémi Ványi
f596f5767b fix Semantic Scholar engine 2021-03-27 16:54:01 +01:00
Adam Tauber
06b754ad67 [mod] increase lobste.rs engine timeout to avoid timeouts most of the time 2021-03-25 01:22:36 +01:00
Adam Tauber
6255b33c9d [fix] rewrite hoogle to use html/xpath instead of json 
the json response has been changed and it contains html chunks which is
not compatible with our json engine, so we have to switch to html/xpath
parsing
 2021-03-25 01:13:24 +01:00
Adam Tauber
45f0e1a859 [fix] update geektimes.ru url - it redirects to habr.com 2021-03-25 01:02:19 +01:00
Adam Tauber
50ba2b9e87 [fix] update google play movies xpath 2021-03-25 00:55:53 +01:00
Adam Tauber
88657fe9c2 [fix] update google play apps xpath 2021-03-25 00:55:43 +01:00
James Higginbotham
ce6eb81a71
Update settings.yml to enable HTTP for yacy 
Added a line to the yacy entry to enable HTTP if the local yacy instance isn't using HTTPS. Otherwise, an error will be thrown in the logs: "No connection adapters were found for 'http://localhost:8090/yacysearch.json...'". This is likely related to ticket #2641 that forces HTTPS by default.
 2021-03-19 15:06:25 -06:00
Adam Tauber
dd34ac396c
Merge pull request #2652 from kvch/solr-engine 
Add Apache Solr engine
 2021-03-15 15:39:39 +01:00
Alexandre Flament
5b176b3496
Merge pull request #2659 from MarcAbonce/onions-http-fix 
Fix HTTP error in onion engines
 2021-03-15 08:33:38 +01:00
Marc Abonce Seguin
f4a0a4d756 fix HTTP error in onion engines 
regression from https://github.com/searx/searx/pull/2641
most onion websites only serve HTTP, so it must be enabled
 2021-03-14 20:23:07 -07:00
Markus Heiser
3703ebb22a [drop] Acgsou engine - www.acgsou.com no longer exists 
- https://www.acgsou.com/ acgsou.com is redirected to 36dm.club
- @rinpatch do not plan on maintaining the engine [1]

[1] https://github.com/searx/searx/pull/1283#issuecomment-798783585

Signed-off-by: Markus Heiser <markus@darmarit.de>
 2021-03-14 11:49:18 +01:00
Noémi Ványi
ff527e2681 Add Solr engine 2021-03-13 21:18:09 +01:00
Alexandre Flament
92dd5e245e
Merge pull request #2626 from mikeri/solidtorrents 
Add Solid Torrents engine
 2021-03-12 19:45:22 +01:00
Alexandre Flament
99e0651cea [mod] by default allow only HTTPS, not HTTP 
Related to https://github.com/searx/searx/pull/2373
 2021-03-08 11:35:08 +01:00
Michael Ilsaas
5549d58de3 Add Solid Torrents engine 2021-03-07 18:14:30 +01:00
Markus Heiser
d48e2e7b0b [enh] google scholar - python implementation of the engine 
The old xpath configuration for google scholar did not work and is replaced by a
python implementation.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-03-01 15:16:37 +01:00
GazoilKerozen
5f6ac3afa2
Add Freesound engine (#2596) 
Add freesound engine with player.

Co-authored-by: Gazoil <maildeguzel@gmail.com>
 2021-03-01 08:52:36 +01:00
datagram1
1d0a32a2c5 Added rumble.com video search engine. TODO video embedding. 
Update rumble.py

some lines too long.

Disable Rumble engine

disabled : True

PEP8 fix

change line spacing
 2021-02-20 12:48:56 +00:00
Emilien Devos
4b37e10dd9 fix yggtorrent url + add it back 2021-02-15 13:38:34 +01:00
Alexandre Flament
45027765e3
Merge pull request #2566 from dalf/remove-yandex 
[remove] yandex engine
 2021-02-12 17:12:07 +01:00
Alexandre Flament
d76660463b
Merge pull request #2562 from dalf/mod-json-engine 
[mod] json_engine: add content_html_to_text and title_html_to_text
 2021-02-12 10:58:28 +01:00
Alexandre Flament
2b60d0d243
Merge pull request #2564 from dalf/fix-seznam 
[fix] fix seznam engine
 2021-02-12 10:56:53 +01:00
Alexandre Flament
74c8b5606f
Merge pull request #2541 from return42/mediathekviewweb 
[enh] add engine MediathekViewWeb (API)
 2021-02-11 15:11:26 +01:00
Alexandre Flament
5d9db6c2f7 [remove] yandex engine 2021-02-11 14:28:06 +01:00
Alexandre Flament
35dd069402 [fix] fix seznam engine 
no paging support
 2021-02-11 12:53:19 +01:00
Alexandre Flament
ff84a1af35 [mod] json_engine: add content_html_to_text and title_html_to_text 
Some JSON API returns HTML in either in the HTML or the content.
This commit adds two new parameters to the json_engine:
content_html_to_text and title_html_to_text, False by default.

If True, then the searx.utils.html_to_text removes the HTML tags.

Update crossref, openairedatasets and openairepublications engines
 2021-02-10 16:42:11 +01:00
Alexandre Flament
436d366448
Merge pull request #2544 from mrwormo/congresslibrary 
[Engine] Add Library of Congress engine
 2021-02-10 10:13:46 +01:00
Markus Heiser
bc1be3f0e9 [enh] add engine MediathekViewWeb (API) 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-02-09 13:08:01 +01:00
mrwormo
051da88328 Add Library of Congress engine 2021-02-09 12:45:39 +01:00
Alexandre Flament
9211cdfe9b [upd] remove google_play_music engine 
Google Play Music has been replaced by Youtube music.
 2021-02-09 11:38:50 +01:00
Noémi Ványi
ac309f5b8d Fix naver engine 
Closes #2540
 2021-02-07 18:58:13 +01:00
Markus Heiser
41c03cf011 [drop] metager - xpath engine won't work anymore 
The new version of MetaGer needs to reload the reults (into a iframe) with a
unique tag (see HTML response below).

Implementing a dedicated metager-engine for searx makes no sense to me. The
great days of MetaGer seems to be ended.  I remember the good old days this
project started in the 90's of the last century.  But in the last few years it
becomes more and more crap.  As the name suggested, MetaGer was made for
germans in the first place.  They have added a english and spain translation but
the i18n is very poor compared to what searx offers.

It's a pity, lets drop MetaGer.

This is the first response, the id (b82679980656899ba5a17ffd02a56846) is unique
for each query:

    $ curl "https://metager.org/meta/meta.ger3?eingabe=foo&submit-query=&focus=web"
    <!DOCTYPE html>
    <html lang="en">
    <head>
        <meta charset="UTF-8">
        <link rel="stylesheet" href="/index.css?id=b82679980656899ba5a17ffd02a56846">
        <script src="/index.js?id=b82679980656899ba5a17ffd02a56846"></script>
    <title>foo - MetaGer</title>
    <meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1" />
    </head>
    <body>
        <iframe id="mg-framed" src="https://metager.org/meta/meta.ger3?eingabe=foo&amp;submit-query=&amp;focus=web&amp;mgv=b82679980656899ba5a17ffd02a56846" autofocus="true" onload="this.contentWindow.focus();"></iframe>
     </body>

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-02-07 14:55:21 +01:00
mrwormo
c4c1636b18 Add Creative Commons search engine 2021-02-04 11:31:35 +01:00
Markus Heiser
e436287385 [mod] checker: add some additional tests 
BTW: fix indentation by 2 spaces

The additional tests has been commented out in the google engines to not release
any CAPTCHA issues.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-01-28 10:08:50 +01:00
Alexandre Flament
73c86f9bf2 [mod] checker: disable by default 2021-01-19 21:44:48 +01:00
Alexandre Flament
80d7411f2c
Merge pull request #2452 from kvch/add-wilby-engine 
Add wiby.me engine
 2021-01-16 22:36:31 +01:00
Alexandre Flament
b405646749
Merge pull request #2451 from mrwormo/invidious-engine 
[Fix] Invidious Engine
 2021-01-16 19:25:45 +01:00
Alexandre Flament
a4dcfa025c [enh] engines: add about variable 
move meta information from comment to the about variable
so the preferences, the documentation can show these information
 2021-01-14 20:57:17 +01:00
mrwormo
2dff3887f0 [fix] Invidious engine by enabling requests by randomly picking amongst working instances 2021-01-14 12:12:56 +01:00
Alexandre Flament
3a9f513521 [enh] checker: background check 
See settings.yml for the options
SIGUSR1 signal starts the checker.
The result is available at /stats/checker
 2021-01-12 11:47:17 +01:00
Alexandre Flament
ca0889d488 [enh] checker: wikidata & ddd: add specific tests 2021-01-12 11:47:17 +01:00
Alexandre Flament
16a889dd8f [enh] checker: add rosebud test 2021-01-12 11:47:17 +01:00
Alexandre Flament
424e6abc7e [mod] settings.yml: move brand settings to a dedicated section 2021-01-11 22:59:52 +01:00
Markus Heiser
9485179064 [mod] move brand options from Makefile to settings.yml 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-01-11 22:12:38 +01:00
Noémi Ványi
a6dd1de4a8 Add wiby.me engine 
Closes #2339
 2021-01-08 23:11:18 +01:00
Markus Heiser
b0bb0a3a0f [fix] Library Genesis links shifted by 1 #1998 
Fixes: #1998
Suggested-by: @linuxmue
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-01-07 14:47:34 +01:00
Émilien Devos
fc6cfc3b58
Remove voat due to its shutdown 
Voat shutted down on December 25th, 2020 at 12 noon PST: https://voat.co/host/voat/static/inactive.min.html?ReturnUrl=/
 2021-01-06 10:45:02 +00:00
Alexandre Flament
36600118fb
Merge pull request #2372 from dalf/remove-broken-engines 
[remove] remove searchcode_doc and twitter
 2020-12-13 17:11:05 +01:00
Alexandre Flament
d703119d3a [enh] add raise_for_httperror 
check HTTP response:
* detect some comme CAPTCHA challenge (no solving). In this case the engine is suspended for long a time.
* otherwise raise HTTPError as before

the check is done in poolrequests.py (was before in search.py).

update qwant, wikipedia, wikidata to use raise_for_httperror instead of raise_for_status
 2020-12-11 14:37:08 +01:00
Alexandre Flament
1c9e7cef50 [remove] remove searchcode_doc and twitter 
* twitter: the API has changed. the engine needs to rewritten.
* searchcode_doc: the API about documentation doesn't exist anymore.
 2020-12-09 13:14:31 +01:00
Alexandre Flament
42a194898b
Merge pull request #2360 from dalf/update-libgen 
[mod] libgen: update the URL to http://libgen.rs/
 2020-12-08 20:33:53 +01:00
Alexandre Flament
bd4869ecd0
Merge pull request #2366 from dalf/remove-seedpeer 
[remove] seedpeer engine
 2020-12-08 20:33:23 +01:00
Alexandre Flament
56c64d6b64 [remove] seedpeer engine 
the website is offline.
 2020-12-07 21:02:29 +01:00
Alexandre Flament
4ec810749b [fix] 1x engine 2020-12-07 15:46:00 +01:00
Alexandre Flament
b3032cf953 [mod] libgen: update the URL to http://libgen.rs/ 
https://libgen.is actually redirect to http://libgen.rs/

It seems there is no HTTPS version:
* https://www.wikidata.org/wiki/Q22017206
* https://librarygenesis.net/
 2020-12-07 10:19:34 +01:00
mrwormo
2b153db74c Disable Invidious engine by default 2020-12-02 21:56:11 +01:00
Noémi Ványi
4a36a3044d
Add recoll engine (#2325) 
recoll is a local search engine based on Xapian:
http://www.lesbonscomptes.com/recoll/

By itself recoll does not offer web or API access,
this can be achieved using recoll-webui:
https://framagit.org/medoc92/recollwebui.git

This engine uses a custom 'files' result template

set `base_url` to the location where recoll-webui can be reached
set `dl_prefix` to a location where the file hierarchy as indexed by recoll can be reached
set `search_dir` to the part of the indexed file hierarchy to be searched, use an empty string to search the entire search domain
 2020-11-30 08:35:15 +01:00
Alexandre Flament
3786920df9 [enh] Add multiple outgoing proxies 
credits go to @bauruine see https://github.com/searx/searx/pull/1958
 2020-11-20 15:29:21 +01:00
Noémi Ványi
43e697681e New engine: Elasticsearch 2020-11-10 19:53:38 +01:00
Adam Tauber
063260d090 [enh] add default http headers - closes #715 2020-11-05 16:14:23 +01:00
a01200356
c3daa08537 [enh] Add onions category with Ahmia, Not Evil and Torch 
Xpath engine and results template changed to account for the fact that
archive.org doesn't cache .onions, though some onion engines migth have
their own cache.

Disabled by default. Can be enabled by setting the SOCKS proxies to
wherever Tor is listening and setting using_tor_proxy as True.

Requires Tor and updating packages.

To avoid manually adding the timeout on each engine, you can set
extra_proxy_timeout to account for Tor's (or whatever proxy used) extra
time.
 2020-10-25 17:59:05 -07:00
Noémi Ványi
33e139cae6 Let admins lock user preferences 2020-10-25 18:06:18 +01:00
Nicholas Kegler
8e15d3e4c1 Open Semantic Search Engine 2020-10-25 17:50:00 +01:00
Adam Tauber
a05c660e30 [enh] add ability to set enabled plugins from settings - closes #1613 #778 2020-10-09 14:12:31 +02:00
Noémi Ványi
ce000a9fef Fix XPATH of lobste.rs engine && add timeout 2020-10-09 12:56:37 +02:00
Noémi Ványi
f0278d41fc add ebay enginte to shopping category 2020-10-08 13:20:55 +02:00
Finn
53c8d945b4
[enh] Add SepiaSearch engine (#2227) 
supported_languages values: see https://framagit.org/framasoft/peertube/search-index/-/blob/master/client/src/views/Search.vue#L618-641
 2020-10-03 13:00:10 +02:00
Alexandre Flament
f204e4903d [fix] migration from github.com/asciimoo/searx to github.com/searx/searx : fix URLs 2020-09-28 16:44:14 +02:00
Noémi Ványi
f0ca1c3483
[enh] Add command line engines: git grep, find, etc. (#2128) 
A new "base" engine called command is introduced. It is the foundation for all command line engines for now.
You can use this engine to create your own command line engine.

Add some engines (commented out to make sure no one enables anything accidentally):
* git grep: This engine lets you grep in the searx repo.
* locate: If locate is installed and initialized, you can search on the FS.
* find: You can find files with a specific name from where you started searx.
* pattern search in files: This engine utilizes the command fgrep.
* regex search in files: This engine runs `grep` to find a file based on its contents.
 2020-09-08 09:51:53 +02:00
Scott Wallace
8bcba31e31 Add key to settings.yml for opening result links in a new tab 
Closes #1552
Closes #444
 2020-09-01 18:10:24 +01:00
Singustromo
315cdfee09
Added metager-search (#2139) 
* Added metager-search
 2020-08-31 18:42:51 +02:00
Émilien Devos
27d74826f1
[enh] add yggtorrent engine (#2135) 2020-08-18 18:02:41 +02:00
Emilien Devos
52d78d8418 [fix] piratebay engine 2020-08-10 20:26:59 +02:00
Mohamad Safadieh
8dff74dd1b
Make default query submission method configurable 
Sending queries through POST, while better for privacy, breaks functionality
with certain extensions (e.g. Firefox containers). Since Firefox does
not send cookies when requesting `/opensearch.xml`, users cannot easily
switch to GET on the client side unless they make a custom search
engine. This commit allows admins to modify the default method on their
side so they can set it to GET if needed.
 2020-08-09 17:04:47 -04:00
Michael Ilsaas
a1ce141c99
add peertube engine (#2109) 2020-08-08 19:22:53 +02:00
Lynda Lopez
b06fc31942
DOI improvements: enable HTTPS, update URL of doai.io (#1718) 
- enabling HTTPS for sci-hub.tw by default
- making sci-hub the default DOI resolver as it has the largest collection of scientific articles.
- replaced doai.io with dissem.in, as it redirects to this new domain.

Co-authored-by: Aurora of Earth <auroraofearth@ya.ru>
 2020-07-29 22:31:48 +02:00
Noémi Ványi
157fa1adb3 add Gitea engine 
Closes #1448
Closes #1447
 2020-07-28 22:37:37 +02:00
Venca24
d3bc171a15
[add] naver engine 
It adds new search engine for users from the South Korea (and therefore it is disabled by default). Closes #1553
 2020-07-28 21:42:48 +02:00
Adam Tauber
1f2dc6c647 [enh] add external plugin support 2020-07-28 13:10:40 +02:00
Noémi Ványi
640da73a9e make category order configurable using ui.categories_order 2020-06-03 21:33:14 +02:00
Sion Kazama
74e6f5d724 Revise outdated URLs 2020-05-19 20:47:35 +08:00
HLFH
3a26093c46
Remove discontinued faroo engine 2020-04-15 16:46:15 +01:00
Noémi Ványi
7878176bb0
Merge branch 'master' into wikimedia-projects 2020-04-12 21:35:37 +02:00
Splinter Suidman
83fa88cbec
fix: Change Wikiversity and Wikivoyage shortcuts to wv and wy. 
Suggested by @Venca24 <https://github.com/asciimoo/searx/pull/1914#issuecomment-610194209>.
 2020-04-07 11:05:35 +02:00
Splinter Suidman
87fba9c12d
fix: Remove unnecessary query parameter for Wikimedia projects. 2020-04-06 15:59:00 +02:00
Splinter Suidman
c37544e6be
fix: Spelling of Wiktionary. 2020-04-06 12:31:32 +02:00
Splinter Suidman
2b453cb226
fix: Change Wikinews category to news. 2020-04-06 12:31:00 +02:00
Splinter Suidman
536eb2b8dd
Add Wikimedia projects. 
A list of the added projects:
- Wikibooks
- Wikinews
- Wikiquote
- Wikisource
- Wiktionary
- Wikiversity
- Wikivoyage
 2020-04-05 19:27:44 +02:00
Venca24
5cb9d9e56a [add] rubygems engine 2020-04-03 17:31:59 +02:00
Markus Heiser
b7105da2af Add missing autocomplete backends to settings.yml comment 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2020-02-23 15:41:08 +01:00
Markus Heiser
98322ac15c
Merge branch 'master' into engine-etools 2020-02-23 11:47:49 +00:00
Marc Abonce Seguin
c0006cadf7 fix default locale and language issues 2020-02-23 02:03:42 -07:00
piplongrun
e1b60106b7
Add etools engine to the list 2020-02-12 23:59:18 +01:00
Markus Heiser
7c79eb9b1b Merge commit 'refs/pull/1621/head' of https://github.com/asciimoo/searx 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2020-02-08 15:08:33 +01:00
Adam Tauber
b6a2aff94a [enh] update translations 2020-01-30 11:16:15 +01:00
Adam Tauber
a1b85571a2 [fix] tmp suspend insecure engines 2020-01-02 22:28:18 +01:00
Markus Heiser
36e72a4619
Merge branch 'master' into fix-engine-spotify 2019-12-29 09:47:06 +01:00
Markus Heiser
fb668e2075
Merge branch 'master' into libgen 2019-12-24 13:33:07 +01:00
Vipul
f407dd8ef4
Switch to https for some domains 2019-12-22 13:39:00 +00:00
Vipul
ee6781d777
[Fix] Libgen engine 
Libgen has switched to new domain (i.e https://libgen.is) with TLS
support and older domain (i.e. http://libgen.io) is no longer
accessible. See, https://en.wikipedia.org/wiki/Library_Genesis, for more
information.

Resolves: #1693
 2019-12-22 13:04:46 +00:00
Adam Tauber
20da8f2cbf
Merge pull request #1754 from MarcAbonce/seedpeer 
Add Seedpeer again
 2019-12-02 13:09:09 +00:00
Adam Tauber
8721be2f7d
Merge pull request #1682 from Venca24/devel_mojeek 
[fix] mojeek engine
 2019-11-28 19:33:08 +00:00
Marc Abonce Seguin
9299355570 add seedpeer again 2019-11-24 22:01:44 -07:00
Adam Tauber
3c34e0c3a7 [mod] remove cloudflare protected digbt from engines list 2019-10-16 15:35:12 +02:00
Adam Tauber
07a0a50e0d [fix] update voat xpaths - closes #1581 2019-10-14 14:25:49 +02:00
Venca24
07d0250241 [fix] mojeek engine 2019-08-20 16:10:25 +02:00
Dalf
9a378ca8c6 [fix] etymonline, voat engines 2019-08-05 15:44:22 +02:00
Alexandre Flament
72029d27de
[enh] Add timeout limit per request (#1640) 
The new url parameter "timeout_limit" set timeout limit defined in second.
Example "timeout_limit=1.5" means the timeout limit is 1.5 seconds.

In addition, the query can start with <[number] to set the timeout limit.

For number between 0 and 99, the unit is the second :
Example: "<30 searx" means the timeout limit is 3 seconds

For number above 100, the unit is the millisecond:
Example: "<850 searx" means the timeout is 850 milliseconds.

In addition, there is a new optional setting: outgoing.max_request_timeout.
If not set, the user timeout can't go above searx configuration (as before: the max timeout of selected engine for a query).

If the value is set, the user can set a timeout between 0 and max_request_timeout using
<[number] or timeout_limit query parameter.

Related to #1077
Updated version of PR #1413 from @isj-privacore
 2019-08-02 13:50:51 +02:00
cy8aer
4dc792e1e2 [enh] add invidious engine. (#1657) 
closes #1372
 2019-08-02 13:25:25 +02:00
0xhtml
ae3eeedb14 Require Spotify API credentials in settings 2019-07-31 20:51:01 +02:00
Marc Abonce Seguin
59b1370824 [fix] small fixes in preferences view's text 2019-07-27 22:53:46 -07:00
Dalf
8645ef717e [fix] settings.yml: make sure all engine names are lower case 2019-07-27 08:52:30 +02:00
Alexandre Flament
f34b5cedb1
[fix] fixes google play engines (#1651) 
update commit 87baa74a86
 2019-07-25 09:31:47 +02:00
Jonas Zohren
cac8e7c6b8 [enh] add npm search engine (#1510) 2019-07-25 08:54:26 +02:00
volth
eb182df132 [mod] restore btdigg engine as btdig.com (#1515) 2019-07-25 08:40:48 +02:00
Venca24
87baa74a86 [fix] fixes google play engines and adds thumbnails to their results (#1612) 
fix google play apps, google play apps, google play music engines

xpath engine: thumbnail_xpath can define an optional thumbnail
 2019-07-25 07:46:41 +02:00
Alexandre Flament
cfcbc3a5c3
[mod] settings.yml: update comments about the morty key. (#1639) 
Fix #1310
Since commit af77ec35d9bd28facdab645a3d57ae340d2b501c Morty accepts base64 encoded key.
 2019-07-17 10:29:28 +02:00
Marc Abonce Seguin
a3368c07a7 [enh] Add Interlingua locale (requires requirements update) 2019-07-15 13:38:51 -05:00
Nicolas Gelot
373a66be30 Fix locale and search language 
Locale and search language was always defined with english value.

This patch inits the locale on `pre_request` in order to define the
default value of locale and language preferences.

Plus the `best_match` function provided by flask babel library did not
work as expected. So the function `match_language` provided
by searx is used to detect that the language from Accepted-Language
header can be used in searx project.
 2019-06-17 23:19:15 +02:00
Dalf
ffe0972f91 Remove some engines : subtitleseeker, seedpeer, swisscows 
http://www.subtitleseeker.com and http://www.seedpeer.eu don't exist anymore.
https://swisscows.ch/ has change : the engine needs to be updated
 2019-05-28 04:06:35 +02:00
Venca24
c66a019478 [fix] seznam engine 2019-05-21 14:27:30 +02:00
Elias Ojala
8039a577a8
Use HTTPS for crossref 2019-03-12 12:30:47 +00:00
Noémi Ványi
6cadbf9269
Merge branch 'master' into devel_google_scholar 2019-02-22 21:05:07 +01:00
Jonas Zohren
f7bdd827c4 [enh] adds apkmirror search engine 2019-02-13 00:37:29 +01:00
Venca24
05a73019b1 [fix] google scholar suggestions 2019-02-04 16:31:17 +01:00
Léo Bourrel
bf4a38ad66 Remove asksteem 2019-01-28 11:02:43 +01:00
d-tux
329172f66e
Merge branch 'master' into engines/unsplash 2019-01-08 09:24:45 +01:00
Noémi Ványi
62690f623d pull translations from Transifex 2019-01-06 21:49:42 +01:00
Venca24
8567cc7433 [add] mojeek engine 2019-01-06 10:47:09 +01:00
d-tux
4a127b19de
Merge branch 'master' into engines/unsplash 2018-12-14 07:06:19 +01:00
dimqua
0823b13ae1 remove Ixquick engine 2018-12-11 20:25:52 +03:00
dimqua
442772a6c5 remove findx engine (#1452) 2018-12-02 22:39:04 +01:00
Venca24
64df38da56 [add] seznam engine 2018-11-20 13:55:29 +01:00
Denis Wernert
cd7849ffc8 Adds the Unsplash image engine 2018-10-08 09:18:42 +02:00
Adam Tauber
052a71d05a
Merge pull request #1368 from aliceinwire/gentoo_engine 
Add Gentoo wiki search engine
 2018-08-21 16:24:34 +02:00
Adam Tauber
f7bb45e891 [enh] admin configurable suspend time of errored engines - closes #1266 2018-08-19 15:30:12 +02:00
Adam Tauber
69d1dd3f86 [enh] configurable default oscar style 2018-08-19 15:28:43 +02:00
Adam Tauber
baacfac32b [fix] remove publicly unavailable 500px engine - #1338 2018-08-19 15:06:59 +02:00
Adam Tauber
3126660be5
Merge pull request #1374 from dadosch/master 
[WIP] [engine] Duden.de (German dictionary)
 2018-08-19 13:29:06 +02:00
Adam Tauber
19f18a2638
Merge pull request #1360 from Popolon/master 
get_doi_resolver return doi resolver url instead of doi resolver name
 2018-08-19 13:14:53 +02:00
dadosch
b575f898c0 duden.de engine 2018-08-18 19:24:02 +02:00
LiquidLemon
2190e2f35d Change the local name of the Polish language 2018-08-12 19:01:58 +02:00
Alice Ferrazzi
b7886bb15c gentoo engine test 2018-08-12 23:00:57 +09:00
Popolon
8b7783e703
Merge branch 'master' into master 2018-08-11 22:23:09 +02:00
Noémi Ványi
5eeb3f2f01 follow up changes in etymonline XPATH engine 2018-08-10 19:03:46 +02:00
Popolon
34af9a0141 add http://sci-hub.tw/ as doi resolvers #1216 2018-08-06 01:03:40 +02:00
Venca24
4f4df6273b [fix] google scholar engine 2018-05-31 19:45:00 +02:00
rinpatch
3ec35a06f7
Added Engine 2018-04-26 22:42:31 +03:00
Marc Abonce Seguin
b12857a70d [fix] make search requests on wikidata more accurate 2018-04-08 21:17:00 -05:00
Noémi Ványi
d04e471ce5 add findx engine for general, images and videos 2018-03-22 10:02:37 +01:00
Adam Tauber
b8543bcf3a [enh] update translations ++ add polish - closes #1239 2018-03-16 00:21:11 +01:00
Adam Tauber
b70ce84eb6 [enh] update translations - add taiwanese and filipino 2018-02-19 00:22:39 +01:00
Adam Tauber
b4c657d227 [enh] add asksteem engine - closes #1163 2018-02-18 22:42:32 +01:00
Noémi Ványi
988cf38196 fix Microsoft Academic engine 2018-02-17 21:39:49 +01:00
marc
4d1770398a remove 'all' option from search languages 2017-12-06 01:20:15 -06:00
Adam Tauber
400e77b7fe [enh] update translations 2017-11-13 21:16:36 +01:00
Adam Tauber
00a7041daa
Merge pull request #1068 from Apply55gx/genius 
Continuation of PR #1004 (seems abandoned)
 2017-11-03 20:21:25 +01:00
jibe-b
b7eb80122e
[fix] update openairepublications 2017-11-02 00:10:08 +01:00
jibe-b
3e9cc1474f
[add] OpenAIRE publication engine 
and modifies OpenAIRE datasets engine
 2017-11-01 22:26:33 +01:00
Noémi Ványi
d20bba6dc7 minor fixes of pubmed engine 
Closes #1045
 2017-11-01 17:02:38 +01:00
jibe-b
df0d915806 [add] pubmed engine 2017-11-01 17:02:38 +01:00
jibe-b
575159b194 [enh] oa_doi_rewrite plugin broadens doai_rewrite 2017-11-01 14:22:26 +01:00
Noémi Ványi
7de8b43eb2 add OpenAIRE engine as a json engine 
This is the continuation of #1048 created by @jibe-b.

Closes #1048
 2017-11-01 14:22:22 +01:00
jibe-b
3e3672e079 [add] arxiv engine 2017-11-01 11:54:16 +01:00
Adam Tauber
6d28e9d694 [enh] update translations 2017-11-01 11:03:22 +01:00
Apply55gx
d800e3fcfa Merge pull request #1 from asciimoo/master 
-
 2017-10-25 10:44:28 +02:00
Adam Tauber
e2afc1cdba [mod] disable yahoo by default 
closes #869
closes #1055
 2017-10-06 20:16:03 +02:00
Adam Tauber
eddc162f2c [fix] remove duplicated german translation - closes #937 2017-09-27 00:20:16 +02:00
misnyo
043143c898 [fix] voat.co search xpath and url fixed 2017-09-04 20:36:27 +02:00
Adam Tauber
688801076d Merge pull request #1017 from misnyo/geektimes 
[fix] geektimes.ru xpath fix
 2017-09-03 23:10:05 +02:00
misnyo
9b6307a365 [fix] gitlab search fixed for proper api usage 2017-08-31 21:59:41 +02:00
misnyo
bf1ca2ccd3 [fix] habrahabr.ru xpath fix 2017-08-31 18:26:46 +02:00
misnyo
9711795876 [fix] geektimes.ru xpath fix 2017-08-31 15:41:08 +02:00
Adam Tauber
e74aaa781e Merge pull request #1016 from misnyo/blekko 
[mod]blekko images removed
 2017-08-30 21:48:36 +02:00
misnyo
0607b167f8 [fix] faroo json api and image layout fixed 2017-08-30 21:09:03 +02:00
misnyo
f139f9cfdb [mod]blekko images removed 2017-08-30 16:47:56 +02:00
misnyo
d14e2781b2 [fix]torrentz search engine fixed for new version 2017-08-25 00:52:35 +02:00
woorst
2434c29dc5 New engine: Genius (lyrics) 2017-08-19 19:05:17 -05:00
marc
3ca9cad927 add bing videos engine 2017-08-05 20:35:57 -05:00
marc
856dfc3018 add google videos 2017-07-26 15:49:16 +02:00
marc
c65a409f0d add duckduckgo images engine 2017-05-23 20:07:09 +02:00
Noémi Ványi
2a9339f4b7 [fix] add more description on possible search tpyes 2017-05-18 22:04:31 +02:00
Noémi Ványi
87f117d50e [enh] add free software directory engine 2017-05-18 21:39:32 +02:00
Alexandre Flament
ee080feaed [mod] the static and templates directories can be defined in the settings.yml 2017-05-15 21:23:13 +02:00
François Revol
45d15bd6f0 Add framalibre engine 
framalibre.org is a catalogue of Free Software, edited by Framasoft.

For now we pass the thumbnail as img_src as it doesn't seem to be used
for IT...
 2017-03-22 00:18:23 +01:00
Noémi Ványi
4a4975d7fc [enh] update translation files 
New languages: German (Germany), Finnish, Slovak, Ukrainian
Updated: Bulgarian, German, Esperanto, Italian, Japanese, Dutch,
Portuguese (Brazil), Russian, Swedish
 2017-03-18 23:49:00 +01:00
maxigas
4ebde2b2af add library genesis engine 2017-02-05 16:32:28 +01:00
David A Roberts
7814d4b796 Semantic Scholar 2017-01-17 21:15:53 +10:00
jcherqui
4776abd1ac Remove categories 2017-01-15 16:13:23 +01:00
jcherqui
0549fb40d2 Add 1337x.to engine 2017-01-15 16:13:23 +01:00
Adam Tauber
261015002e [enh] update translations 2017-01-05 15:24:45 +01:00
Adam Tauber
a98bbefbcf [enh] configurable listening http protocol version 2016-12-25 23:05:01 +01:00
Stefan Antoni
89914e52e3 Update settings.yml 2016-12-25 22:04:45 +01:00
Stefan Antoni
e6d69b082f Merge branch 'master' into add_ccctv_to_settings 2016-12-25 14:59:52 +01:00
Adam Tauber
07448e15e4 [fix] disable etymonline by default - closes #789 2016-12-25 09:34:17 +01:00
Adam Tauber
b6fc154616 [enh] add searx engine 2016-12-24 22:23:36 +01:00
Stefan Antoni
96c8d36e7b Add ccctv engine to settings.yml 2016-12-24 16:44:12 +01:00
Adam Tauber
4b225eb7ef Merge pull request #661 from davidar/et 
Online Etymology Dictionary
 2016-12-23 12:54:02 +01:00
Noémi Ványi
9c8ec209e1 [mod] add timeout to gigablast 2016-12-11 11:58:49 +01:00
Noémi Ványi
85f363774c fix habrahabr xpath 2016-12-11 11:58:49 +01:00
Noémi Ványi
c6ed0dae6c fix google play movies xpath 2016-12-11 11:58:49 +01:00
Noémi Ványi
3007e4e451 add voat.co engine 2016-12-02 20:34:00 +01:00
Noémi Ványi
299c882304 search: make language configurable from settings.yml 2016-11-14 23:32:19 +01:00
Noémi Ványi
c7906555a0 add lobste.rs xpath engine 2016-11-06 01:17:30 +01:00
dalf
972f32d973 [fix] ixquick : fetch results from ixquick.eu instead of ixquick.com, close #727 2016-10-22 20:56:18 +02:00
Noémi Ványi
53c9fde992 fix kickass torrents engine 2016-10-22 05:27:18 +02:00
Adam Tauber
1be6e72d51 [enh] add result proxy support - #707 2016-10-17 00:23:15 +02:00
Alexander Minges
3c5883408c initial commit of pdbe engine 
Adds support for queries to the Protein Data Bank Europe (PDBe).
 2016-10-13 00:40:38 +02:00
Pydo
01844b6f04 Set default categories for seedpeer provider 2016-10-01 19:22:36 -04:00
Pydo
55a5b686ed Merge branch 'master' of https://github.com/asciimoo/searx into feature/seedpeer-engine-integration 
Resolved conflict searx/settings.yml
 2016-10-01 10:46:18 -04:00
Pydo
6f87bf2a1c Disabled seepeer.eu by default since it does not support https 2016-10-01 10:28:01 -04:00
Adam Tauber
86daef2063 [fix] do not allow underscore in engine names - closes #708 2016-09-28 22:30:05 +02:00
firebovine
baeb3ff911 fix xpath expressions for urban dictionary 2016-09-10 17:08:34 -04:00
potato
5ed9846bbf [fix] revert the port change 2016-09-06 16:35:12 +02:00
potato
8c72a22757 [enh] api_key usage, disable the engine by default 2016-09-06 16:12:34 +02:00
potato
ab471fd13b [enh] mymemory translated engine added for multi-word translations 2016-09-06 15:40:07 +02:00
potato
5416f0f248 [enh] dictionary engine renamed to dictzone 2016-09-06 12:50:56 +02:00
potato
9d08c81f47 Merge branch 'master' of https://github.com/asciimoo/searx 2016-09-06 11:47:34 +02:00
potato
f4525880ed [enh] dictionary engine added 2016-09-06 11:47:27 +02:00
Adam Tauber
b27f07af23 [enh] socks proxy support 2016-09-05 22:35:54 +02:00
Pydo
2c2123b2e8 Added seepeer to config and added seepeer search parser 2016-09-05 14:51:02 -04:00
Adam Tauber
b72aec0a9b [fix] remove btdigg - see https://torrentfreak.com/btdigg-shut-down-due-to-torrent-spam-for-now-160711/ 2016-08-16 13:52:55 +02:00
Adam Tauber
32604be790 [fix] piratebay engine - using pirateproxy.red - see https://proxybay.tv/ 2016-08-16 10:44:00 +02:00