Dalf
45702b77ca
embedded iframe (youtube, dailymotion, vimeo): use https
2019-07-13 15:49:59 +02:00
Emilien Devos
cbd1ebdce8
[fix] Force Google old UI ( #1597 )
2019-05-29 10:05:57 +09:00
Frank de Lange
4b7332286a
Use string formatter to create source and img_format labels ( #1566 )
...
google_images : use JSON embedded in HTML (engine expected pure JSON)
2019-05-28 12:33:31 +09:00
Dalf
ffe0972f91
Remove some engines : subtitleseeker, seedpeer, swisscows
...
http://www.subtitleseeker.com and http://www.seedpeer.eu don't exist anymore.
https://swisscows.ch/ has change : the engine needs to be updated
2019-05-28 04:06:35 +02:00
Alexandre Flament
df2b9a76f7
Merge branch 'master' into ne/fix-google-image-search
2019-04-14 13:55:00 +02:00
Nick Espig
1c6ab79b9f
Fix google image search
...
- Because there is not full image url in the dom, we replace "image_url" with the same url as the "url" (url of source).
See example HTML https://gist.github.com/Nachtalb/2dea8a4d2c723c49226ad9645838121f
- Remove unused import
- Fix google image search title
- Keep google image safe value up to date
2019-04-14 12:03:25 +02:00
Marc Abonce Seguin
3e1c2153f7
[fix] duckduckgo images requests
2019-04-13 00:38:37 -05:00
Marc Abonce Seguin
f2d49a6971
[fix] get youtube results from js object
...
Results are not appearing in the html document anymore,
instead they are found inside an object embedded in a script.
2019-03-26 21:09:15 -06:00
Jonas Zohren
f7bdd827c4
[enh] adds apkmirror search engine
2019-02-13 00:37:29 +01:00
Léo Bourrel
bf4a38ad66
Remove asksteem
2019-01-28 11:02:43 +01:00
d-tux
f1814079f0
Merge branch 'master' into engines/unsplash
2019-01-14 13:40:57 +01:00
Marc Abonce Seguin
626a8e9ac9
[fix] unicode error with WolframAlpha API engine
2019-01-08 21:02:23 -06:00
d-tux
329172f66e
Merge branch 'master' into engines/unsplash
2019-01-08 09:24:45 +01:00
Noémi Ványi
97351a2c72
fix after rebase
2019-01-07 21:28:58 +01:00
Noémi Ványi
b63d645a52
Revert "remove 'all' option from search languages"
...
This reverts commit 4d1770398a
2019-01-07 21:19:00 +01:00
Marc Abonce Seguin
0169b63e84
[fix] fetch google's supported languages
2019-01-06 21:31:45 -06:00
Marc Abonce Seguin
51111c2594
[fix] always set langauge_aliases even if it's empty
2019-01-06 20:49:56 -06:00
Marc Abonce Seguin
5568f24d6c
[fix] check language aliases when setting search language
2019-01-06 20:31:57 -06:00
Venca24
2456b8f571
[mod] google videos
2019-01-05 12:12:09 +01:00
Noémi Ványi
1ea56576dc
Merge branch 'master' into devel_google_videos
2019-01-04 22:27:05 +01:00
Noémi Ványi
aeb6dab187
Merge branch 'master' into master
2019-01-04 22:14:40 +01:00
Noémi Ványi
5b81f7c2cc
Merge branch 'master' into bugfix_startpage
2019-01-04 22:03:00 +01:00
Venca24
cf26aba93b
[FIX] google videos thumbnails
2019-01-04 15:48:22 +01:00
Léo Bourrel
73ec2ba74e
Update bing image engine with new image json format
2018-12-19 11:12:25 +01:00
Michael Pfitzner
44ce51f0c5
restore startpage search results
2018-12-14 21:38:48 +01:00
d-tux
4a127b19de
Merge branch 'master' into engines/unsplash
2018-12-14 07:06:19 +01:00
dimqua
0d86ed9c7e
update startpage.py
2018-12-11 21:45:47 +03:00
dimqua
442772a6c5
remove findx engine ( #1452 )
2018-12-02 22:39:04 +01:00
Venca24
0bdf090ed7
[fix] google videos engine
2018-11-22 13:00:34 +01:00
Denis Wernert
b9ada93b3a
Removes what looks like tracking parameters
2018-10-08 14:56:20 +02:00
Denis Wernert
72d063d27d
Uses the raw url for the image result, rather than the full
...
size result.
2018-10-08 14:01:35 +02:00
Denis Wernert
cd7849ffc8
Adds the Unsplash image engine
2018-10-08 09:18:42 +02:00
Adam Tauber
052a71d05a
Merge pull request #1368 from aliceinwire/gentoo_engine
...
Add Gentoo wiki search engine
2018-08-21 16:24:34 +02:00
Alice Ferrazzi
d24c58cf4e
Fix pep8 errors
2018-08-21 22:55:51 +09:00
Alice Ferrazzi
ff2eac9f6b
Fix choosing languges function
...
Searching for english is now giving all pages results.
Instead searching for a specific language different from english
is correctly returning only translated pages for the selected language.
2018-08-21 22:55:39 +09:00
Adam Tauber
baacfac32b
[fix] remove publicly unavailable 500px engine - #1338
2018-08-19 15:06:59 +02:00
dadosch
b575f898c0
duden.de engine
2018-08-18 19:24:02 +02:00
Adam Tauber
845ba79e75
[fix] update qwant search url
...
thx to @dalf for the fix (#1365 )
2018-08-13 12:38:19 +02:00
Alice Ferrazzi
5f0888b8f4
added languages to Gentoo engine
2018-08-12 23:00:57 +09:00
Alice Ferrazzi
b7886bb15c
gentoo engine test
2018-08-12 23:00:57 +09:00
Adam Tauber
d51732c0e5
Merge pull request #1303 from MarcAbonce/bing
...
Fix bing "garbage" results
2018-07-09 11:00:37 +02:00
Léo Bourrel
7a474db61b
Fix formatting
2018-07-06 10:31:01 +02:00
Léo Bourrel
acaef6600e
Update path to wikidata image
2018-07-05 10:11:45 +02:00
Adam Tauber
f82ead3e30
[fix] add py3 compatibility to base engine - closes #1319
2018-06-14 11:50:03 +02:00
Adam Tauber
57e7e9da98
[fix] use html result page in google images (previous endpoint stopped working)
2018-06-14 11:40:39 +02:00
Noémi Ványi
16915116e0
fix piratebay url
...
Closes #1229
2018-05-21 16:58:39 +02:00
Marc Abonce Seguin
75b276f408
fix bing "garbage" results (issue #1275 )
2018-05-20 18:13:32 -05:00
Noémi Ványi
b843c1351a
add missing parameter to gigablast search url
...
Closes #1293
2018-05-16 22:26:32 +02:00
rinpatch
059c2ccb95
Fix acgsou encoding error on python2 and add unicode characters to unit testt
2018-05-05 23:41:13 +03:00
rinpatch
3b89ce9bfa
Switch acgsou to http
2018-05-03 08:34:21 +03:00
Adam Tauber
1a1f9852f1
Merge pull request #1283 from rinpatch/acgsou-engine
...
[Feature] Acgsou as a searchable engine
2018-04-28 22:42:35 +02:00
rinpatch
f6695cea59
Fix nyaa to use https
2018-04-27 17:55:42 +03:00
rinpatch
f17e54a396
Forgot to remove print command used for debugging
2018-04-27 15:40:42 +03:00
rinpatch
dcc9fdb47f
Added unit test
2018-04-27 15:36:15 +03:00
rinpatch
e3bd2670d7
Traling whitespace
2018-04-27 08:36:11 +03:00
rinpatch
86f47689fe
Hopefully fix code style errors(again)(again)
2018-04-27 08:32:43 +03:00
rinpatch
b8b23d8006
Hopefully fix code style errors(again)
2018-04-27 08:29:17 +03:00
rinpatch
fb364ffae7
Hopefully fix code style errors
2018-04-27 08:23:58 +03:00
rinpatch
3ec35a06f7
Added Engine
2018-04-26 22:42:31 +03:00
rinpatch
cd1374d2f2
added whitespaces
2018-04-22 14:12:32 +03:00
rinpatch
a305dae9d8
switched currency convert to duckduckgo and added Bitcoin to currency list
2018-04-22 13:46:13 +03:00
Noémi Ványi
25b48143ea
fix findx engine
2018-04-21 20:02:52 +02:00
Marc Abonce Seguin
f7f9c50393
[fix] force English results in Google when using en-US
2018-04-18 23:29:48 -05:00
Marc Abonce Seguin
b12857a70d
[fix] make search requests on wikidata more accurate
2018-04-08 21:17:00 -05:00
Marc Abonce Seguin
835d1edd58
[fix] google news xpath
2018-04-08 20:56:05 -05:00
Marc Abonce Seguin
343e555ee9
[fix] append http if no scheme is provided in xpath's extact_url
...
This solves a bug with Yahoo where some results don't specify
a protocol.
2018-04-08 20:35:34 -05:00
Adam Tauber
283f6c9053
Merge pull request #1252 from MarcAbonce/search-languages
...
[mod] Refactor engine's search language handling
2018-04-05 17:27:07 +02:00
Marc Abonce Seguin
772c048d01
refactor engine's search language handling
...
Add match_language function in utils to match any user given
language code with a list of engine's supported languages.
Also add language_aliases dict on each engine to translate
standard language codes into the custom codes used by the engine.
2018-03-27 00:08:03 -06:00
Noémi Ványi
8cc529e9a3
forward category to engine without highlighting on the ui
2018-03-22 11:02:24 +01:00
Noémi Ványi
d04e471ce5
add findx engine for general, images and videos
2018-03-22 10:02:37 +01:00
Marc Abonce Seguin
d1eae9359f
fix fetch_langauges to be more accurate
...
Add languages supported by either all default general engines or 10 engines.
2018-03-20 17:58:20 -06:00
Marc Abonce Seguin
216716db70
[fix] change duckduckgo url to avoid error response
2018-03-14 23:18:42 -06:00
Adam Tauber
03d7a8f065
[fix] pep8
2018-02-18 23:24:59 +01:00
Adam Tauber
b4c657d227
[enh] add asksteem engine - closes #1163
2018-02-18 22:42:32 +01:00
Noémi Ványi
988cf38196
fix Microsoft Academic engine
2018-02-17 21:39:49 +01:00
Adam Tauber
2f69eaeb2f
[fix] fix engine initialization
2018-02-17 14:30:06 +01:00
Noémi Ványi
c645915171
fix bing videos engine
2018-02-10 19:44:07 +01:00
Marc Abonce Seguin
829032f306
[fix] read utf-8 files (settings, languages, currency) with python3.5
...
Related to discussion in #1124
The io.open import is necessary for python2
2018-01-16 23:26:10 -06:00
Adam Tauber
8511e64f35
Merge pull request #1124 from JosephKiranBabu/python3-unicode-support
...
Make Python 3 able to read settings files with Unicode characters
2018-01-12 10:58:23 +01:00
Noémi Ványi
f3aa5ea47d
fix yacy result url
...
Closes #1064
2018-01-06 14:52:14 +01:00
Joseph Nuthalapati
bdc803e185
Make Python 3 able to read settings files with Unicode characters
...
SearX currently doesn't start up when run with Python 3 as it tries to parse the
settings.yml file with ASCII codecs.
There are similar problems with engines_languages.json and currencies.json
Python 3 requires that files with Unicode characters be read with a 'b' flag.
This also works with Python 2 and hence can be integrated into the main source
code.
Tested with the latest Python 3.6.4rc1 on Debian unstable.
Signed-off-by: Joseph Nuthalapati <njoseph@thoughtworks.com>
2017-12-21 17:33:19 +05:30
Noémi Ványi
2d5eed9b59
send constant cookie with query to Google
2017-12-18 21:38:52 +01:00
Adam Tauber
7752b0a807
[fix] gigablast url parameter change - fixes #1107
2017-12-09 21:00:08 +01:00
marc
4d1770398a
remove 'all' option from search languages
2017-12-06 01:20:15 -06:00
Adam Tauber
1613c6319e
[fix] handle /sorry redirects
2017-12-05 20:38:34 +01:00
Adam Tauber
1088c2a75d
[fix] do not crash if publication date is missing in pubmed engine
2017-12-01 20:54:12 +01:00
Adam Tauber
801b5a56ad
[fix] multiple fixes in pdbe engine
2017-12-01 20:54:12 +01:00
Adam Tauber
0969e50c5b
[fix] convert json engine result attributes to string - closes #1006
2017-12-01 20:54:12 +01:00
Adam Tauber
6eb9503896
[fix] use english in google engine if no language was set - this prevents guessing the language by the IP of the instance
2017-11-22 22:56:47 +01:00
Adam Tauber
6fdb6640d9
[fix] revert language changes to prevent CAPTCHAs
2017-11-22 22:50:48 +01:00
Adam Tauber
9ab8536479
[fix] fix language support of google
2017-11-21 16:28:53 +01:00
pyrrh0n1c
4340c0b16c
Fixed typos.
2017-11-07 14:14:20 +00:00
pyrrh0n1c
2231b02add
Fixed the currency_convert engine.
2017-11-07 13:29:17 +00:00
Adam Tauber
00a7041daa
Merge pull request #1068 from Apply55gx/genius
...
Continuation of PR #1004 (seems abandoned)
2017-11-03 20:21:25 +01:00
Adam Tauber
7a9b18e9e9
[mod] add more error handling to json engine II.
2017-11-02 01:08:15 +01:00
Adam Tauber
181f1c6305
[mod] add more error handling to json engine
2017-11-02 00:43:29 +01:00
Noémi Ványi
5954a8e16a
minor fix of BASE engine
2017-11-01 17:02:38 +01:00
Noémi Ványi
d20bba6dc7
minor fixes of pubmed engine
...
Closes #1045
2017-11-01 17:02:38 +01:00
jibe-b
df0d915806
[add] pubmed engine
2017-11-01 17:02:38 +01:00
Noémi Ványi
9c2b7a82f0
minor fixes of arxiv
...
Closes #1050
2017-11-01 14:22:22 +01:00
jibe-b
e391b2d970
[fix] remove .encode for python3 compatibility
2017-11-01 11:54:55 +01:00
jibe-b
5278fa666c
[enh] use format to concatenate strings
2017-11-01 11:54:38 +01:00
jibe-b
3e3672e079
[add] arxiv engine
2017-11-01 11:54:16 +01:00
Apply55gx
d800e3fcfa
Merge pull request #1 from asciimoo/master
...
-
2017-10-25 10:44:28 +02:00
Apply55gx
18a4e7035f
removed unused indicies array
2017-10-25 10:42:37 +02:00
marc
44085e31d0
update engines_languages.json and languages.py
...
Also, fix fetch_languages.py so it can run on python3.
2017-10-10 16:53:28 -05:00
marc
a524dbb823
[fix] language support for bing images and videos
2017-10-10 16:49:49 -05:00
misnyo
33fd938016
[mod] int_or_zero refactored to searx_utils
2017-09-04 20:05:04 +02:00
misnyo
c3232b0e1a
Merge branch 'master' into nyaa
2017-09-04 17:48:25 +02:00
Adam Tauber
234366b900
Merge pull request #1018 from misnyo/generalfile
...
[mod]generalfile engine removed
2017-09-03 23:09:49 +02:00
Adam Tauber
c505c3c1ca
Merge pull request #1019 from misnyo/gigablast
...
[fix] gigablast api fix
2017-09-03 23:09:33 +02:00
misnyo
b91772eff1
[fix] gigablast pep8 fix
2017-08-31 21:49:19 +02:00
misnyo
01330f71cd
[fix] nyaa.si fixed
2017-08-31 21:32:30 +02:00
misnyo
1e2b60f380
[mod] tokyotoshokan dependecy to other engine removed
2017-08-31 21:31:40 +02:00
misnyo
3182ba7069
[fix] google news dom xpath fix
2017-08-31 17:48:07 +02:00
misnyo
8849606e5f
[fix] gigablast api fix
2017-08-31 16:57:57 +02:00
misnyo
2d66df0548
[mod]generalfile engine removed
2017-08-31 15:51:16 +02:00
Adam Tauber
e74aaa781e
Merge pull request #1016 from misnyo/blekko
...
[mod]blekko images removed
2017-08-30 21:48:36 +02:00
Adam Tauber
610117d054
Merge pull request #1015 from misnyo/digg
...
[fix] digg now requires cookie for search
2017-08-30 21:35:12 +02:00
misnyo
6e92fb383a
[fix] digg cookie characters created in module import
2017-08-30 21:14:12 +02:00
misnyo
20d2d4dab1
[fix] pep8 fix for faroo engine
2017-08-30 21:09:03 +02:00
misnyo
0607b167f8
[fix] faroo json api and image layout fixed
2017-08-30 21:09:03 +02:00
misnyo
a49cc18f9c
[fix] digg now requires cookie for search
2017-08-30 19:51:33 +02:00
misnyo
f139f9cfdb
[mod]blekko images removed
2017-08-30 16:47:56 +02:00
misnyo
d14e2781b2
[fix]torrentz search engine fixed for new version
2017-08-25 00:52:35 +02:00
woorst
2434c29dc5
New engine: Genius (lyrics)
2017-08-19 19:05:17 -05:00
marc
3ca9cad927
add bing videos engine
2017-08-05 20:35:57 -05:00
marc
856dfc3018
add google videos
2017-07-26 15:49:16 +02:00
Adam Tauber
077d8efed8
[fix] use poolrequests in ddg engines
2017-07-21 16:23:20 +02:00
Adam Tauber
0f6612bb40
[mod] separate engine load and initialization
2017-07-21 14:27:25 +02:00
Adam Tauber
1794f6a4d3
[enh] add "inactive" attribute to engines
...
This modification allows us to deactivate engines in settings.yml
without commenting them out
2017-07-20 13:32:20 +02:00
marc
405e5c8f24
[fix] duckduckgo images doesn't fail with countryless language
2017-07-10 18:41:50 +02:00
potato
9b82cb1908
[fix] is_valid_lang fixed for new languages.py + dictzone engine encoding
2017-06-25 18:29:19 +02:00
vache asatryan
5835ebf955
fix github url
2017-06-18 21:53:10 +04:00
Noémi Ványi
c361811cb5
[fix] fix xpath of google images
2017-06-13 19:47:56 +02:00
Adam Tauber
343ac7197d
[fix] pep8
2017-06-06 23:37:42 +02:00
Adam Tauber
78365ffb8a
[enh] add init function to engines which loads parallel
2017-06-06 22:20:20 +02:00
marc
3b950929b1
[fix] fix duckduckgo's offset
...
First page now starts with 0 offset,
rather than starting on the 30th result.
DuckDuckGo returns 30 results on each page.
2017-05-27 21:12:39 -05:00
marc
c65a409f0d
add duckduckgo images engine
2017-05-23 20:07:09 +02:00
Adam Tauber
1972a044a3
[fix] produce valid urls if scheme is missing
2017-05-22 15:48:37 +02:00
Adam Tauber
8db527c1d2
[fix] use raw response with etree.parsefromstring - Unicode strings with encoding declaration are not supported
2017-05-22 15:36:52 +02:00
Adam Tauber
a4f7046b8f
[fix] pep8
2017-05-18 22:19:44 +02:00
Noémi Ványi
2a9339f4b7
[fix] add more description on possible search tpyes
2017-05-18 22:04:31 +02:00
Noémi Ványi
2db807368c
[enh] make search type of mediawiki configurable
2017-05-18 21:34:54 +02:00
marc
9ee8e552da
[fix] bing images
2017-05-17 15:45:55 +02:00
Dalf
c233bf0df9
[fix] framalibre : remove result['thumbnail'] (not used)
2017-05-15 17:28:21 +02:00
Alexandre Flament
f5128c7cb9
[mod] add/modify image fetching for bing_news, qwant and twitter engines
2017-05-15 17:28:21 +02:00
Adam Tauber
52e615dede
[enh] py3 compatibility
2017-05-15 12:02:30 +02:00
Adam Tauber
46a2c63f8e
[fix] yahoo news date parsing
2017-04-08 19:45:04 +02:00
Alexandre Flament
12d91c1d67
[mod] searx doesn't crash at startup when an engine can't be loaded (see #884 )
2017-04-08 17:38:46 +02:00
