5990 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Hans-Christoph Steiner	1153ac24fd	import: overhaul URL validation to use urllib.parse ... Python provides us a lovely URL parser with some level of validation built in. The parsed URL is then much easier to validate.	2020-02-13 13:51:52 +01:00
Hans-Christoph Steiner	e9a6c84efd	import: split URL parsing from code cloning ... This makes things testable and easier to follow.	2020-02-13 13:51:52 +01:00
Hans-Christoph Steiner	bfe587979d	import: make it work most of the time with git repos ... This includes real tests too.	2020-02-13 13:51:52 +01:00
Hans-Christoph Steiner	e049a120f8	Merge branch 'gradlew_no_eol' into 'master' ... gradlew-fdroid: support parsing files with no EOL before EOF See merge request fdroid/fdroidserver!707	2020-02-13 09:47:07 +00:00
Hans-Christoph Steiner	697a0641f1	fix sudo syntax from 7a1fa6e857 ... fdroid/fdroidserver!713	2020-02-11 19:44:18 +01:00
Hans-Christoph Steiner	5a6422f4f3	jenkins-setup-build-environment: require 9GB RAM for 8GB VM ... [skip ci] since this isn't used in gitlab-ci at all	2020-02-11 14:56:48 +01:00
Hans-Christoph Steiner	bfe8f05de6	fix syntax error from ae86dc3d38 ... fdroid/fdroidserver!713 [skip ci]	2020-02-11 12:48:42 +01:00
Hans-Christoph Steiner	e9ca4a17bc	Merge branch 'buildserver-fixes' into 'master' ... random buildserver fixes Closes #636 and #624 See merge request fdroid/fdroidserver!713	2020-02-10 16:37:50 +00:00
Hans-Christoph Steiner	a746917022	provision-gradle: disable daemon and block HTTP repos ... closes #624 #712	2020-02-05 20:36:25 +01:00
Hans-Christoph Steiner	7a1fa6e857	build: keep DEBIAN_FRONTEND env var when running sudo: script ... closes #636	2020-02-05 20:36:25 +01:00
Hans-Christoph Steiner	ae86dc3d38	buildserver: set quiet options to stop apt-get spamming build logs ... https://gitlab.com/fdroid/fdroidserver/issues/636#note_266483988	2020-02-05 20:36:25 +01:00
Hans-Christoph Steiner	6b03f995be	deploy: check if file is on androidobservatory before uploading ... Check if file is on androidobservatory before uploading. androidobservatory.org redirects to a GET request after the POST, and this seems to partially fail with requests. The checking code was broken.	2020-02-05 20:34:03 +01:00
Hans-Christoph Steiner	5fb368916f	index: fix no JAR test case that fails on example.org ... http://example.org/index-v1.jar now returns the HTTP header "Content-Encoding: gzip" but then the reply is plain HTML. That triggers a ContentDecodingError instead of an HTTPError, so this changes the test to success on any RequestsException.	2020-02-05 20:33:40 +01:00
Marcus Hoffmann	25de42055e	gradlew-fdroid: update avaiable gradle versions and min versions	2020-02-05 20:21:33 +01:00
Hans-Christoph Steiner	77efdac41b	add Gradle 6.1.1 to gradlew-fdroid ... https://gitlab.com/fdroid/fdroidserver/-/merge_requests/710#note_282313001 missing from 84c7f4db9b [skip ci]	2020-02-05 20:18:39 +01:00
Hans-Christoph Steiner	140bd29c94	Merge branch 'random-bag-of-fies' into 'master' ... random bag of fixes Closes #719 See merge request fdroid/fdroidserver!710	2020-02-05 19:12:19 +00:00
Hans-Christoph Steiner	a086d0dd3a	Merge branch 'msappcenter' into 'master' ... Add Microsoft Appcenter SDK to forbidden list See merge request fdroid/fdroidserver!712	2020-02-04 09:40:13 +00:00
licaon-kter	135c92f3d0	Add Microsoft Appcenter SDK to forbidden list	2020-02-02 03:50:54 +02:00
Hans-Christoph Steiner	427856b5fd	tests: use same mirrors order in all tests ... This makes it so running `../fdroid update --nosign --pretty` in tests/ no longer creates a diff in the tests/*/index* files. It matches the order set in tests/run-tests.	2020-01-31 15:38:10 +01:00
Hans-Christoph Steiner	84c7f4db9b	Add Gradle 6.1.1, replacing Gradle 6.1	2020-01-31 15:38:08 +01:00
Hans-Christoph Steiner	e6b2134d2e	makebuildserver: ensure vagrant share block symlinks to the host ... * https://phoenhex.re/2018-03-25/not-a-vagrant-bug * https://github.com/hashicorp/vagrant/pull/10792/files	2020-01-31 15:38:07 +01:00
Hans-Christoph Steiner	0fa1f91a23	gitlab-ci: long timeout and many retries for pip installs	2020-01-31 15:38:05 +01:00
Hans-Christoph Steiner	e5d8479033	only do bash completion on .yml files ... closes #719	2020-01-31 15:38:04 +01:00
Hans-Christoph Steiner	5c82956561	mirror: make .asc downloading opt-in with --pgp-signatures ... Lots of third party repos do not use .asc PGP signatures at all, so having this optional prevents tons of 404 Not Found errors.	2020-01-31 15:38:02 +01:00
Hans-Christoph Steiner	82a4817e8a	fix field name errors in examples/template.yml	2020-01-31 15:38:01 +01:00
Hans-Christoph Steiner	6ce22bff56	update: strip newlines from name/summary/video entries ... These entries are hardcoded as a single line in all the app stores, so newlines should be stripped to get the data simple to use. This is in contrast with the on-disk format for Fastlane and Triple-T, which includes a newline in the title.txt and short_description.txt files. I think all files in those systems are normalized to end in a newline.	2020-01-31 15:37:59 +01:00
Hans-Christoph Steiner	3b5e3a62a3	move getappname+getcvname to checkupdates, the only place they're used	2020-01-31 15:37:57 +01:00
Hans-Christoph Steiner	fdede914cd	tests: properly name CheckupdatesTest class	2020-01-31 15:37:32 +01:00
Hans-Christoph Steiner	3df276cc3c	fix all bandit B310 urllib_urlopen ... "Audit url open for permitted schemes. Allowing use of ‘file:’’ or custom schemes is often unexpected." https://bandit.readthedocs.io/en/latest/blacklists/blacklist_calls.html#b310-urllib-urlopen	2020-01-31 15:37:30 +01:00
Hans-Christoph Steiner	d8f3d94997	gitlab-ci: remove dscanner exclusions from bandit	2020-01-31 15:37:28 +01:00
Hans-Christoph Steiner	28aa404c24	Merge branch 'remove_drozer' into 'master' ... remove dscanner subcommand See merge request fdroid/fdroidserver!711	2020-01-31 13:50:07 +00:00
Marcus Hoffmann	8961485125	remove dscanner subcommand ... It's unused and unmaintained. It could potentially be revived as a plugin at a later point.	2020-01-31 14:17:12 +01:00
Hans-Christoph Steiner	da24a45e83	Merge branch 'main-script-tests' into 'master' ... Main script tests See merge request fdroid/fdroidserver!708	2020-01-28 11:03:07 +00:00
Michael Pöhn	f2a80ffa3d	fix tests on old python version	2020-01-28 11:43:09 +01:00
Michael Pöhn	b25eeb66a1	fix code style	2020-01-28 11:43:09 +01:00
Michael Pöhn	69fc38c668	repair fdroid --version	2020-01-28 11:43:09 +01:00
Michael Pöhn	f21481ca81	add some simple tests for main	2020-01-28 11:43:09 +01:00
Michael Pöhn	7a4254efa2	make main script pythonic	2020-01-28 11:43:09 +01:00
Marcus Hoffmann	09db493557	gradlew-fdroid: support parsing files with no EOL before EOF ... Fixes cases like: https://gitlab.com/fdroid/fdroiddata/merge_requests/6216#note_273985937	2020-01-21 11:15:51 +01:00
Marcus	7683179e84	Merge branch 'gradle61' into 'master' ... Add Gradle 6.1 Closes #730 See merge request fdroid/fdroidserver!706	2020-01-19 18:46:52 +00:00
Licaon_Kter	33ddf944f3	Add Gradle 6.1	2020-01-19 18:46:52 +00:00
Marcus Hoffmann	fdcb1ad23f	Revert "Revert "Merge branch 'ndk21' into 'master'"" ... This reverts commit 999b15a909.	2020-01-15 22:48:40 +01:00
Marcus Hoffmann	999b15a909	Revert "Merge branch 'ndk21' into 'master'" ... This reverts commit 9b4cb8b76a, reversing changes made to 3bdbbfd45b.	2020-01-15 22:09:41 +01:00
Marcus	9b4cb8b76a	Merge branch 'ndk21' into 'master' ... Add NDK21 See merge request fdroid/fdroidserver!705	2020-01-15 12:28:36 +00:00
Licaon_Kter	3c3b3dbcf2	Add NDK21	2020-01-15 12:28:36 +00:00
Marcus	3bdbbfd45b	Merge branch 'longer_titles' into 'master' ... bump title char_limit to 50 Closes fdroiddata#1906 and #726 See merge request fdroid/fdroidserver!702	2020-01-14 13:54:41 +00:00
Michael Pöhn	9a8718c189	Merge branch 'deploy-fixes' into 'master' ... `fdroid deploy` fixes See merge request fdroid/fdroidserver!703	2020-01-14 11:02:51 +00:00
Hans-Christoph Steiner	df7d7adf78	mirror: optionally fetch build logs and src tarballs	2020-01-14 11:36:11 +01:00
Hans-Christoph Steiner	e76a0c9d6a	git_mirror_size_limit config option to set max git mirror size ... GitHub and GitLab have some kinds of limits on how big a git repo can be, this makes that option configurable. This also is very useful for tests.	2020-01-14 11:36:08 +01:00
Hans-Christoph Steiner	4fa11ef4fc	deploy: detect virustotal size limits while uploading ... This prevents the size limits from blocking the whole deploy.	2020-01-14 11:19:02 +01:00