29 Commits

Author	SHA1	Message	Date
Dalf	1022228d95	Drop Python 2 (1/n): remove unicode string and url_utils	2020-09-10 10:39:04 +02:00
xywei	1d4657b714	Fix relative urls that do not start with '/'	2020-07-23 11:12:19 -05:00
Dalf	85b3723345	[mod] speed optimization ... compile XPath only once avoid redundant call to urlparse get_locale(webapp.py): avoid useless call to request.accept_languages.best_match	2019-11-15 09:33:15 +01:00
Alexandre Flament	f34b5cedb1	[fix] fixes google play engines (#1651) ... update commit 87baa74a86	2019-07-25 09:31:47 +02:00
Venca24	87baa74a86	[fix] fixes google play engines and adds thumbnails to their results (#1612) ... fix google play apps, google play apps, google play music engines xpath engine: thumbnail_xpath can define an optional thumbnail	2019-07-25 07:46:41 +02:00
Marc Abonce Seguin	343e555ee9	[fix] append http if no scheme is provided in xpath's extact_url ... This solves a bug with Yahoo where some results don't specify a protocol.	2018-04-08 20:35:34 -05:00
Adam Tauber	1972a044a3	[fix] produce valid urls if scheme is missing	2017-05-22 15:48:37 +02:00
Adam Tauber	52e615dede	[enh] py3 compatibility	2017-05-15 12:02:30 +02:00
David A Roberts	7492997c51	[fix] allow empty content	2017-01-17 21:14:33 +10:00
Alexandre Flament	90e1db3e5c	[fix] extract_text: use html.tostring instead html_to_text. Fix #711	2016-12-31 13:56:09 +01:00
David A Roberts	1e9dab08e6	[fix] behaviour for page_size>1 and first_page_num>0 ... eg. pageno=1,21,41,... instead of 20,40,60,...	2016-08-14 22:10:25 +10:00
Kirill Isakov	bacc9a3df1	Add paging support to XPath & Erowid engines	2016-03-28 19:15:03 +06:00
Adam Tauber	bd22e9a336	[fix] pep8 compatibilty	2016-01-18 12:47:31 +01:00
Cqoicebordel	44c9216c49	Sanitize extract_text	2015-01-25 20:04:44 +01:00
potato	6f535b6fae	[fix] error when xpath_results in extraxt_text is _ElementUnicodeResult instead of _ElementStringResult	2014-03-04 19:43:41 +01:00
asciimoo	c1d7d30b8e	[mod] len() removed from conditions	2014-02-11 13:13:51 +01:00
asciimoo	b647244abf	[fix] function parameters	2014-01-30 03:10:20 +01:00
asciimoo	3dcb835910	[fix] function parameters	2014-01-30 02:36:05 +01:00
asciimoo	fe82637eac	[enh] importable url extractor	2014-01-30 02:32:58 +01:00
asciimoo	59eeeaab87	[fix] html tag removal	2014-01-23 11:08:08 +01:00
asciimoo	b2492c94f4	[fix] pep/flake8 compatibility	2014-01-20 02:31:20 +01:00
asciimoo	060ea4d2f5	[fix] whitespaces removed	2014-01-12 18:48:38 +01:00
Dalf	3dc3fc7770	[mod][fix] xpath engine simplified, yahoo engine never returns truncated urls	2014-01-05 14:06:52 +01:00
dalf	664c039b38	xpath engine: bug fix	2013-12-30 22:34:35 +01:00
asciimoo	e50a72b0e3	[enh] suggestion support for xpath engine	2013-11-13 19:33:09 +01:00
asciimoo	17bf00ee42	[enh] removing result html tags	2013-11-09 18:39:20 +01:00
asciimoo	7965da55a7	[fix] urlparsing fix	2013-10-27 12:01:03 +01:00
asciimoo	5d764f95cf	[enh] xpath engine absolute xpath support	2013-10-26 13:45:43 +02:00
asciimoo	badd988545	[enh] xpath engine added	2013-10-26 02:22:20 +02:00