kamp/fdroidserver
1
0
Fork 0
mirror of https://gitlab.com/fdroid/fdroidserver.git synced 2024-11-16 20:00:11 +01:00
Code Activity
8a752cdd9d
fdroidserver/buildserver/provision-apt-get-install

122 lines
2.4 KiB
Plaintext
Raw Normal View History

buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
#!/bin/bash
buildserver: make provision scripts output name to log
2016-07-04 14:20:42 +02:00
echo $0
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
set -e
set -x
debian_mirror=$1
buildserver: download apt package first to increase reliability This does not have the careful result rechecking that chef has, when it installs each package in the list one at a time. So to help with failures caused by a package failing to download, first try downloading all the package, then run the install. The install pass will try to download any missing packages. Really, this should use ansible or perhaps chef again since those include lots of tricks around this stuff.
2016-09-06 14:33:13 +02:00
printf 'APT::Install-Recommends "0";\nAPT::Install-Suggests "0";\n' \
> /etc/apt/apt.conf.d/99no-install-recommends
buildserver: retry apt-get downloads 20 times Try harder before failing the whole buildserver setup.
2016-09-15 11:12:49 +02:00
printf 'APT::Acquire::Retries "20";\n' \
> /etc/apt/apt.conf.d/99acquire-retries
buildserver: force no auto updates of package lists or upgrades
2018-01-17 21:04:08 +01:00
printf 'APT::Periodic::Update-Package-Lists "0";\nAPT::Periodic::Unattended-Upgrade "0";\n' \
> /etc/apt/apt.conf.d/99no-auto-updates
buildserver: support HTTPS Debian mirrors The ever troublesome gpjenkins box needs to use HTTPS mirrors. Plus it improves the security of the buildserver, since there have been CVEs that HTTPS would protect against: https://www.debian.org/security/2016/dsa-3733
2017-03-16 14:48:08 +01:00
if echo $debian_mirror | grep '^https' 2>&1 > /dev/null; then
apt-get -y update
apt-get -y install apt-transport-https
fi
sed -i "s,http://ftp.uk.debian.org/debian/,${debian_mirror},g" /etc/apt/sources.list
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
if grep --quiet jessie /etc/apt/sources.list; then
echo "deb $debian_mirror jessie-backports main" > /etc/apt/sources.list.d/backports.list
buildserver: support installing packages from Debian/testing Sometimes, a build process requires newer versions of build tools than are available in Debian/stable. Oftentimes, using the package straight from Debian/testing works fine when a package is not available as a backport. libtool 2.4.6 is needed for building VLC, so it is one example of this. The preferences file sets up the apt "pinning" so that all updates are not installed from testing, only the packages that are requested by adding "/testing" after then package name. closes #224
2017-01-10 10:54:21 +01:00
echo "deb $debian_mirror testing main" > /etc/apt/sources.list.d/testing.list
printf "Package: *\nPin: release o=Debian,a=testing\nPin-Priority: -300\n" > /etc/apt/preferences.d/debian-testing
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
fi
dpkg --add-architecture i386
apt-get -y update
buildserver: download apt package first to increase reliability This does not have the careful result rechecking that chef has, when it installs each package in the list one at a time. So to help with failures caused by a package failing to download, first try downloading all the package, then run the install. The install pass will try to download any missing packages. Really, this should use ansible or perhaps chef again since those include lots of tricks around this stuff.
2016-09-06 14:33:13 +02:00
apt-get -y upgrade --download-only
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
apt-get -y upgrade
packages="
ant
bs: add sqlite3 and asn1c
2016-07-23 19:14:28 +02:00
asn1c
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
ant-contrib
autoconf
autoconf2.13
buildserver: use automake and cmake from jessie-backports These should be reasonably backwards compatible, and there is already automake1.11 for those that need a version that old. As for cmake, there are five apps that seem to it: com.amaze.filemanager org.dolphinemu.dolphinemu org.navitproject.navit org.yabause.android org.videolan.vlc It looks like VLC is the only app that is currently building and using cmake in the most recent releases. Some of them used to use cmake, but no longer.
2017-02-07 10:47:20 +01:00
automake/testing
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
automake1.11
autopoint
bison
bzr
buildserver: add openjdk-8-jdk-headless depends from backports
2017-02-06 14:59:15 +01:00
ca-certificates-java/jessie-backports
buildserver: use automake and cmake from jessie-backports These should be reasonably backwards compatible, and there is already automake1.11 for those that need a version that old. As for cmake, there are five apps that seem to it: com.amaze.filemanager org.dolphinemu.dolphinemu org.navitproject.navit org.yabause.android org.videolan.vlc It looks like VLC is the only app that is currently building and using cmake in the most recent releases. Some of them used to use cmake, but no longer.
2017-02-07 10:47:20 +01:00
cmake/jessie-backports
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
curl
expect
faketime
flex
buildserver: install gettext from jessie-backports In order to install a package from jessie-backports, apt-get has to be told to get it from there rather than the main archive. It will not use jessie-backports by default even if it is added as an apt source. closes #224
2017-01-03 22:23:38 +01:00
gettext/jessie-backports
gettext-base/jessie-backports
buildserver: use git from jessie-backports to get better workflow A number of key features around username/password handling where added in 2.3, like GIT_SSH_COMMAND and GIT_TERMINAL_PROMPT.
2017-11-23 21:21:06 +01:00
git-core/jessie-backports
git-svn/jessie-backports
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
gperf
graphviz
imagemagick
inkscape
javacc
libarchive-zip-perl
libexpat1-dev
libgcc1:i386
libglib2.0-dev
Add required packages for linphone 3.1.0 build
2017-05-24 06:19:13 +02:00
liblwp-protocol-https-perl
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
liblzma-dev
libncurses5:i386
librsvg2-bin
libsaxonb-java
libssl-dev
libstdc++6:i386
buildserver: support installing packages from Debian/testing Sometimes, a build process requires newer versions of build tools than are available in Debian/stable. Oftentimes, using the package straight from Debian/testing works fine when a package is not available as a backport. libtool 2.4.6 is needed for building VLC, so it is one example of this. The preferences file sets up the apt "pinning" so that all updates are not installed from testing, only the packages that are requested by adding "/testing" after then package name. closes #224
2017-01-10 10:54:21 +01:00
libtool/testing
libtool-bin/testing
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
make
maven
buildserver: use hg 3.9 from backports
2017-05-10 18:55:38 +02:00
mercurial/jessie-backports
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
nasm
buildserver: install nodejs
2016-11-07 22:54:47 +01:00
nodejs
buildserver: add openjdk-8-jdk-headless depends from backports
2017-02-06 14:59:15 +01:00
openjdk-8-jre-headless
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
openjdk-8-jdk-headless
optipng
p7zip
pandoc
perlmagick
pkg-config
python-gnupg
Add buildserver lxml requirement for pEp
2016-08-28 14:47:12 +02:00
python-lxml
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python-magic
python-setuptools
buildserver: include python3-git for future use We should be replacing all our custom git shell commands with python3-git, since it is a common library for doing that. It will receive a lot more attention and maintenance than our code for doing it. For example, we should not ever use shell=True, since that opens up a lot of security risks.
2018-01-23 17:12:32 +01:00
python3-git/jessie-backports
python3-gitdb/jessie-backports
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python3-gnupg
provision missing pyasn1 dependency to build server
2017-04-13 00:44:53 +02:00
python3-pyasn1
python3-pyasn1-modules
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python3-requests
buildserver: include python3-git for future use We should be replacing all our custom git shell commands with python3-git, since it is a common library for doing that. It will receive a lot more attention and maintenance than our code for doing it. For example, we should not ever use shell=True, since that opens up a lot of security risks.
2018-01-23 17:12:32 +01:00
python3-smmap/jessie-backports
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python3-yaml
add ruamel yaml to buildserver depenencies
2017-05-09 13:15:28 +02:00
python3-ruamel.yaml
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
quilt
realpath
Add required packages for linphone 3.1.0 build
2017-05-24 06:19:13 +02:00
rsync
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
scons
bs: add sqlite3 and asn1c
2016-07-23 19:14:28 +02:00
sqlite3
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
subversion
swig
texinfo
transfig
unzip
vorbis-tools
xsltproc
yasm
zip
zlib1g:i386
"
buildserver: download apt package first to increase reliability This does not have the careful result rechecking that chef has, when it installs each package in the list one at a time. So to help with failures caused by a package failing to download, first try downloading all the package, then run the install. The install pass will try to download any missing packages. Really, this should use ansible or perhaps chef again since those include lots of tricks around this stuff.
2016-09-06 14:33:13 +02:00
apt-get install --yes $packages --download-only
apt-get install --yes $packages
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
highestjava=`update-java-alternatives --list | sort -n | tail -1 | cut -d ' ' -f 1`
update-java-alternatives --set $highestjava
Copy Permalink