Hans-Christoph Steiner
372c8b418d
strip file extension from generated name for non-APKs
...
With a generic file, the file name is the only guaranteed name metadata
field. So if the name is not specified in the metadata, then the name
is set to the filename. This changes that so that the file extension is
stripped from that generated name.
2017-06-01 16:01:05 +02:00
Hans-Christoph Steiner
6105f8a184
use var naming scheme in KnownApks (apk --> apkName)
...
Everywhere else, the file name of the APK is called apkName.
2017-06-01 16:01:05 +02:00
Hans-Christoph Steiner
9471bf2731
regexs for getting packageName and versionCode from filenames
...
This is useful for parsing APK files, which can include packageName,
versionCode, and optionally 7 char signing key ID (i.e. <sig>).
This also can set the packageName and versionCoe for non APK files, so
that it is easy to assign them to metadata files, and to allow for
upgrades by setting the versionCode in the filename.
2017-06-01 16:01:05 +02:00
Hans-Christoph Steiner
ceac6d25cb
index.xml cannot handle APKs with the same packageName/versionCode
...
Really, it is the fdroidclient parser of index.xml that fails, due to the
hardcoded expectation that there will only ever be a single APK for any
given versionCode. We keep index.xml backwards compatible for old
clients, and use index-v1.json to support new things. Having multiple
APKs that have the same packageName and versionCode will break the client
v0.103.* since that version uses index-v1.json, but still has the hard-
coded database parsing stuff.
#153
2017-06-01 16:01:05 +02:00
Hans-Christoph Steiner
4053f03d77
update: add --rename-apks to force APK filenames to fdroid standard
...
uses the standard package.name_123.apk. If that exists, it appends the
shasum. If that exists, then its a duplicate, so its deleted. This should
help @SergeWinters with his 12,000 APKs.
2017-06-01 16:01:05 +02:00
Andrew Patrikalakis
5a0c201fab
Copy initial buildserver CPU/memory configuration to final box Vagrantfile
2017-06-01 09:53:33 -04:00
Hans-Christoph Steiner
0f4cbc7224
allow APKs with same packageName/versionCode but different signer
...
There are many APKs out in the wild that claim to be the same app and
version and each other, but they are signed by different keys. fdroid
should be able to index these, and work with them. This supports having
the developer's signature via reproducible builds, random collections of
APKs like repomaker, etc.
2017-06-01 10:30:41 +02:00
Hans-Christoph Steiner
2c6945dac7
gitlab-ci: add index v0 metadata parsing test
...
This test is very handy for making sure the old index.xml v0 format does
not inadvertantly change.
2017-05-30 21:13:49 +02:00
Hans-Christoph Steiner
afac1b2efd
add basic test for fdroid scanner
...
There was no test coverage at all for this command, this is a very basic
test that should prevent things like 2626858450
2017-05-30 21:13:49 +02:00
Hans-Christoph Steiner
63fd20fff0
Merge branch 'master' into 'master'
...
Add support for the new Bitbucket look
See merge request !278
2017-05-30 19:08:28 +00:00
Alexey Krasilnikov
a3a34cdbd3
Add support for the new Bitbucket look
2017-05-30 18:33:55 +03:00
Hans-Christoph Steiner
7a302cfb75
Merge branch 'makebs' into 'master'
...
makebs: update to ndk-r14b and build-tools-25.0.3
See merge request !277
2017-05-29 08:01:32 +00:00
Boris Kraut
1558d2ba91
Merge branch 'lint-for-newness' into 'master'
...
`fdroid lint` support for SPDX, l18n, dev signatures
Closes #234
See merge request !269
2017-05-26 21:38:35 +00:00
Boris Kraut
a57bff78d4
makebs: update to ndk-r14b and build-tools-25.0.3
2017-05-26 23:21:20 +02:00
Hans-Christoph Steiner
114d5dc8c6
make tests pass new lint rules
2017-05-26 21:03:38 +02:00
Hans-Christoph Steiner
4570d9dc8a
lint: use only license tags from https://spdx.org/license-list
...
closes #234
2017-05-26 21:03:38 +02:00
Hans-Christoph Steiner
1178d032f3
lint: support new per-package subdirs for l18n and dev signatures
...
Graphics and localized text can now be stored in the package folders,
always in a folder that is named for the locale. The upstream developer
signature is also now stored, so that the upstream APK can be reproduced
even if they remove their APKs.
#291
fdroiddata!2229
fdroiddata!2224
fdroidclient#15
fdroidserver#174
2017-05-26 21:03:38 +02:00
Hans-Christoph Steiner
3dbd74262f
lint: add popular URL shorteners to the banned list
2017-05-26 21:03:38 +02:00
Boris Kraut
c056b95fd5
scanner: allow google maven
2017-05-26 15:51:38 +02:00
Hans-Christoph Steiner
5a90443b0b
Merge branch 'master' into 'master'
...
Don't pass root_dir to scan_source
See merge request !276
2017-05-25 18:49:14 +00:00
mimi89999
2626858450
Don't pass root_dir to scan_source
2017-05-25 20:11:14 +02:00
Torsten Grote
fe2d65df73
Merge branch 'modernize-pylint' into 'master'
...
modernize pylint
See merge request !252
2017-05-25 14:00:36 +00:00
Hans-Christoph Steiner
39d25da3e9
Merge branch 'linphone-packages' into 'master'
...
Add required packages for linphone 3.1.0 build
See merge request !274
2017-05-24 10:57:21 +00:00
Andrew Patrikalakis
61553a8e93
Add required packages for linphone 3.1.0 build
2017-05-23 21:20:10 -07:00
Hans-Christoph Steiner
9ad457c16f
fix pylink 'dict' has no member 'keystore'
2017-05-23 22:34:16 +02:00
Hans-Christoph Steiner
17cd07f1a7
fix pylint unused-argument
2017-05-23 22:34:16 +02:00
Hans-Christoph Steiner
12c80f9062
update outdated pylint setup
...
The logilab-astng lib is dead, replaced by python-astroid. The crazy astng
plugin is no longer needed also.
#281
2017-05-23 22:34:16 +02:00
Hans-Christoph Steiner
361ce5ca41
Merge branch 'python-vagrant-copy-caches' into 'master'
...
complete staging buildserver setup on jenkins.debian.net using nested KVM instances
See merge request !176
2017-05-23 18:38:57 +00:00
Hans-Christoph Steiner
a01e302cde
makebuildserver: make config['domain'] local var where its needed
2017-05-23 20:08:29 +02:00
Michael Pöhn
c8234919df
refactored vm related code from build.py to vmtools.py
2017-05-23 20:08:29 +02:00
Michael Pöhn
fc660048eb
removed unused buildserver code
2017-05-23 20:08:08 +02:00
Hans-Christoph Steiner
9ef936c21a
leave VirtualBox vagrant package as it was originally
...
We only need Vagrantfile hacks for KVM.
2017-05-23 20:06:47 +02:00
Michael Pöhn
8f1fabfed6
restart builder vm when ssh connection fails
2017-05-23 20:06:47 +02:00
Hans-Christoph Steiner
6106b962a2
build: delete bad builder/ symlinks
...
If builder/ is a symlink but is not detected as a directory by
os.path.isdir(), then it is a broken symlink.
2017-05-23 20:06:06 +02:00
Michael Pöhn
4546929d7f
wait a sec after suspending
2017-05-23 20:06:06 +02:00
Michael Pöhn
48159f005a
reset buildserver vm if vagrant uuid not present
2017-05-23 20:06:06 +02:00
Michael Pöhn
510efaa024
makebuildserver vbox logmessage fix
2017-05-23 20:06:06 +02:00
Michael Pöhn
0ec5422952
use uuid for vbox snapshots again
2017-05-23 20:06:06 +02:00
Michael Pöhn
358b00d7aa
removed useless vm validity check; attempted to fix vbox support
2017-05-23 20:06:06 +02:00
Michael Pöhn
1b1d6b7d96
deal with outdated box images in libvirt storage pool
2017-05-23 20:06:06 +02:00
Michael Pöhn
b01d48a4fd
makebuildserver deal with apt cache lock
2017-05-23 20:06:06 +02:00
Hans-Christoph Steiner
acf25a3999
build server use up instead or resume; logging
2017-05-23 20:06:06 +02:00
Hans-Christoph Steiner
c749c68486
test script for vmtools
2017-05-23 20:06:06 +02:00
Michael Pöhn
3187d2cbcf
revised build server creation
2017-05-23 20:06:06 +02:00
Michael Pöhn
8abd3f1cbc
auto-lookup vm provider based on available executables; more fault tolerant vagrant package
2017-05-23 20:06:06 +02:00
Hans-Christoph Steiner
bba6b8ab0a
fixed reading libvirt box image size
2017-05-23 20:06:06 +02:00
Michael Pöhn
1bd51966b8
vmtools debug logging for check_output calls
2017-05-23 20:06:06 +02:00
Hans-Christoph Steiner
5dbcd0e9bd
added box handling to vmtools
2017-05-23 20:06:06 +02:00
Hans-Christoph Steiner
01b6473823
refactored kvm_package to vmtools
2017-05-23 20:06:06 +02:00
Hans-Christoph Steiner
5580a685db
added makebuildserver option for keeping vagrant box
...
This is very useful for debugging this process, and also for people
who might want to keep a working copy of the box.
2017-05-23 20:06:06 +02:00
