Torsten Grote
1fcd8e63a3
Replace sys.exit() in non-main functions by exceptions
...
Also move all exceptions into one module
2017-05-22 16:51:11 -03:00
Michael Pöhn
a8420817cb
fix calling vagrant global-status
2017-05-22 17:40:19 +02:00
Michael Pöhn
592a292847
use stable version of priv ext instead of latest when testing in makebuildserver
2017-05-22 16:04:30 +02:00
Hans-Christoph Steiner
84dc415837
jenkins-build-makebuildserver: retry git fetch until it works
...
It seems that gitlab gives 500 errors a bit too frequently, so keep
retrying the `git pull` until it works so that there isn't a error email
sent out over failed pulls.
2017-05-22 16:04:30 +02:00
Hans-Christoph Steiner
780b0e9502
Merge branch 'indexing-fixes' into 'master'
...
indexing fixes
Closes #303
See merge request !270
2017-05-22 09:32:39 +00:00
Hans-Christoph Steiner
0345d2c79f
update: find aapt when it is not in the PATH
...
This is some very messy logic built up since 2010. This will all go away
once we have a python3 version of androguard available.
The removed imports and `dir(APK)` is to silence pyflakes
closes #303
2017-05-18 17:21:05 +02:00
Hans-Christoph Steiner
c348186ad6
update: fix fastlane scraping, it uses a subdir called 'images'
...
https://commons.wikimedia.org/wiki/File:GetChromium_FeatureGraphic_1024x500.png
2017-05-18 16:13:17 +02:00
Hans-Christoph Steiner
77a65be9db
update: skip packages without metadata in index V1
...
If a package does not have a matching "app" metadata file, then it should
not be added to the index. index V0 already does this properly.
2017-05-18 16:13:17 +02:00
Hans-Christoph Steiner
a17b95a860
update: improved logging
...
the aapt warnings were very verbose, and the other now includes the
file name type for screenshots, rather than the filename twice.
2017-05-18 16:13:17 +02:00
Hans-Christoph Steiner
5d705452f5
update: allow repo files to use _ in the file names
...
_ is a valid character for Java package names, so it should also work in
the repo file naming scheme. This makes it so it only splits the file
name based on the last _.
2017-05-18 16:13:17 +02:00
Hans-Christoph Steiner
84bb41a91f
metadata: switch from deprecated cgi.escape to html.escape
...
cgi.escape is deprecated in Python 3.x and has security issues:
https://bugs.python.org/issue26398
html.escape() differs from cgi.escape() by its defaults to quote=True:
s = html.escape( """& < " ' >""" ) # s = '& < " ' >'
2017-05-18 16:13:17 +02:00
Torsten Grote
ee57285817
Merge branch 'cdn-git-mirror' into 'master'
...
Fix double pushing on remote git-mirror
See merge request !272
2017-05-17 22:47:56 +00:00
thez3ro
ec30d73f13
fix double pushing on remote
2017-05-17 23:08:25 +02:00
Hans-Christoph Steiner
87066bc1d5
Merge branch 'cdn-git-mirror' into 'master'
...
Use Gitlab Pages as mirror instead of Raw
Closes #293
See merge request !271
2017-05-17 20:29:33 +00:00
thez3ro
846f5422fd
Use gitlab pages as mirror
2017-05-17 21:08:34 +02:00
Hans-Christoph Steiner
b144029517
Merge branch 'hg39' into 'master'
...
buildserver: use hg 3.9 from backports
See merge request !266
2017-05-10 17:22:15 +00:00
Boris Kraut
fec2f677bf
buildserver: use hg 3.9 from backports
2017-05-10 18:55:38 +02:00
Hans-Christoph Steiner
eb49c9e8f3
Merge branch 'master' into 'master'
...
replace aapt with androguard
See merge request !234
2017-05-05 09:10:32 +00:00
Michael Pöhn
ff3baefbed
Merge branch 'yaml' into 'master'
...
basic support for YAMLin `fdroid rewritemeta`
Closes #285 and #169
See merge request !260
2017-05-05 08:35:44 +00:00
thez3ro
06598ae406
use androguard if aapt isn't found
2017-05-04 23:35:17 +02:00
Hans-Christoph Steiner
9607cdb621
Merge branch 'download-index-etag' into 'master'
...
Support ETag when downloading repository index
See merge request !264
2017-05-02 19:12:41 +00:00
Torsten Grote
8d424f19ec
Support ETag when downloading repository index
2017-05-02 15:37:02 -03:00
Hans-Christoph Steiner
4f758f5c78
fix white space trimming when writing .txt format
...
Some of the internal data format changes somehow broke the white space
trimming when writing out .txt.
closes #285
2017-05-02 14:55:23 +02:00
Hans-Christoph Steiner
0d00705aed
use pyyaml for rewriting .yml metadata files
...
This replaces the broken, custom code with the standard YAML lib.
In rewritemeta, do not call app.metadatapath since it will be deleted when
the dict is cleaned up for outputing. metadatapath is only used internally
and should not be written out.
closes #169
refs #290
2017-05-02 14:55:23 +02:00
Michael Pöhn
e7e97654b1
Merge branch 'libvirt-support' into 'master'
...
Check for libvirt specific shutoff message
See merge request !262
2017-05-02 07:39:51 +00:00
Torsten Grote
f758b5c205
Merge branch 'pre-0.103-alpha4-rename' into 'master'
...
downcase all 'localized' key names to match the rest of index-v1
See merge request !261
2017-05-01 17:59:59 +00:00
Andrew Patrikalakis
9ee96117d8
Check for libvirt specific shutoff message
2017-04-29 18:38:44 -07:00
Hans-Christoph Steiner
cdef5bcd92
downcase all 'localized' key names to match the rest of index-v1
...
This is a little omission. keys that are used in metadata/*.yml all start
with an UpperCase letter, but in fdroidserver, index-v1.json, and
fdroidclient, it is all camelCase with lowercase first letter. The keys
from the 'localized' section are currently never in metadata/*.yml, so
these keys never get downcase. This change will break fdroidclient
versions that do not also have this change, but since we're in alpha, that
should be fine.
If support for a 'localized' section is added to metadata/*.yml, then the
keys there should probably be UpperCase CamelCase to match the other keys.
2017-04-27 21:12:49 +02:00
Hans-Christoph Steiner
9f9f0d1a16
Merge branch 'git-identity-file' into 'master'
...
Make git server mirror upload honor config['identity_file'] option
See merge request !259
2017-04-24 21:24:07 +00:00
Torsten Grote
c137231d8b
Make git server mirror upload honor config['identity_file'] option
2017-04-24 16:22:33 -03:00
Hans-Christoph Steiner
591bfc4474
Merge branch '148-no-verify-logs-on-split-build-publish-infrastructure' into 'master'
...
compare apk with Binaries from metadata right after building
Closes #148
See merge request !247
2017-04-24 18:50:58 +00:00
Michael Pöhn
fc4e40255d
remove build output when not reproducible
2017-04-23 11:33:51 +02:00
Michael Pöhn
5b7209d882
unified method for naming build output
2017-04-22 12:04:32 +02:00
Michael Pöhn
62af9b8e3d
check meld config for manual apk diffs
2017-04-22 10:48:50 +02:00
Michael Pöhn
4044e06e7b
use verify_apks for checking build output
2017-04-22 10:48:50 +02:00
Michael Pöhn
f4a7c19043
fix java architecture in buildserver config
2017-04-22 10:48:50 +02:00
Michael Pöhn
a3e7eacc9b
compare apk with Binaries from metadata right after building
2017-04-22 10:48:50 +02:00
Hans-Christoph Steiner
1c25c516aa
Merge branch '273-invalid-apk-gets-through-to-publish-stage' into 'master'
...
throw proper error when download of apks fail
Closes #273
See merge request !258
2017-04-21 07:56:55 +00:00
Michael Pöhn
abe04272b1
throw proper error when download of apks fail
2017-04-20 17:48:38 +02:00
Daniel Martí
c7ae6bc826
Merge branch 'gradleplugin' into 'master'
...
bs: use only prefixes for gradle kv pairs
See merge request !257
2017-04-19 09:27:42 +00:00
Hans-Christoph Steiner
650b3c95b4
Merge branch 'full-app-store-metadata-scraping' into 'master'
...
Full app store metadata scraping
Closes #204 and #143
See merge request !253
2017-04-19 08:25:56 +00:00
Hans-Christoph Steiner
82095c7a9a
add basic test for Triple-T Gradle Play Publisher scraping
2017-04-19 10:05:24 +02:00
Hans-Christoph Steiner
fd21d68bc1
update: fix glob to actually match all locales
...
glob != regexp, [A-Z-.@] means one of those chars is required in that
position, so the glob pattern was requiring a least 3 chars. Locales are
usually just two lower case letters, e.g. vi, de, ar.
2017-04-19 10:05:24 +02:00
Hans-Christoph Steiner
cb49f57c06
support "Author Web Site" as metadata field
...
Fastlane Supply, Triple-T Gradle Play Publisher, and many app stores
include the possibility to specify a website for the author, as distinct
from the website for the app.
closes #204
2017-04-19 10:05:24 +02:00
Hans-Christoph Steiner
18f949c62b
include Author/Contact info from Triple-T Gradle Play Publisher
...
This is just the bare minimum, it adds it to the index, but AuthorPhone
and AuthorWebsite are not yet supported by fdroidclient. AuthorName is.
#204
2017-04-19 10:05:24 +02:00
Hans-Christoph Steiner
9589d13ef2
update: include "What's New" texts when they are available
...
This uses the "What's New" entry for the CurrentVersionCode and includes it
as the current WhatsNew metadata for the App class.
Things like fastlane supply and Google Play support a "What's New" entry
per-APK, but fdroidclient does not current use anything but the current
version of this data. Right now, it seems we probably only want to have
the latest WhatsNew in the index to save space.
In theory, we could make the WhatsNew data structure follow the structure
of fastlane/Play, but that would quite a bit of complexity for something
that might never be used.
fdroidclient#910
2017-04-19 10:05:24 +02:00
Hans-Christoph Steiner
822c2d3992
update: app store metadata from Triple-T gradle play publisher
...
Since f-droid.org has the source repos, `fdroid update` can just grab files
from the source repo. This makes `fdroid update` use the metadata that is
laid out in the Triple-T gradle play publisher filesystem layout:
https://github.com/Triple-T/gradle-play-publisher#upload-images
https://github.com/Triple-T/gradle-play-publisher#play-store-metadata
closes #143
2017-04-19 10:05:24 +02:00
Hans-Christoph Steiner
89c480181c
update: include localized app store metadata from fastlane
...
This includes all metadata from the app's source repo following the path
layout specified for the fastlane supply tool:
https://github.com/fastlane/fastlane/blob/1.109.0/supply/README.md#images-and-screenshots
refs #35
closes #143
2017-04-19 10:05:24 +02:00
Hans-Christoph Steiner
a7daec7c36
add char limits for text: Name=30, Video=256, WhatsNew=500
...
Since this info can come from automated sources, this prevents giant blobs
from being mistakenly stuck in these fields. It also brings it inline with
the standard lengths other popular app stores use.
https://support.google.com/googleplay/android-developer/answer/113469?hl=en
https://stackoverflow.com/a/20276565
2017-04-19 10:05:24 +02:00
Boris Kraut
58900744ea
bs: use only prefixes for gradle kv pairs
2017-04-18 23:36:01 +02:00
