kamp/fdroidserver
1
0
Fork 0
mirror of https://gitlab.com/fdroid/fdroidserver.git synced 2024-11-04 22:40:12 +01:00
Code Activity
3a75f81709
fdroidserver/buildserver/provision-apt-get-install

129 lines
2.5 KiB
Plaintext
Raw Normal View History

buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
#!/bin/bash
buildserver: make provision scripts output name to log
2016-07-04 14:20:42 +02:00
echo $0
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
set -e
set -x
debian_mirror=$1
buildserver: download apt package first to increase reliability This does not have the careful result rechecking that chef has, when it installs each package in the list one at a time. So to help with failures caused by a package failing to download, first try downloading all the package, then run the install. The install pass will try to download any missing packages. Really, this should use ansible or perhaps chef again since those include lots of tricks around this stuff.
2016-09-06 14:33:13 +02:00
printf 'APT::Install-Recommends "0";\nAPT::Install-Suggests "0";\n' \
> /etc/apt/apt.conf.d/99no-install-recommends
buildserver: retry apt-get downloads 20 times Try harder before failing the whole buildserver setup.
2016-09-15 11:12:49 +02:00
printf 'APT::Acquire::Retries "20";\n' \
> /etc/apt/apt.conf.d/99acquire-retries
buildserver: force no auto updates of package lists or upgrades
2018-01-17 21:04:08 +01:00
printf 'APT::Periodic::Update-Package-Lists "0";\nAPT::Periodic::Unattended-Upgrade "0";\n' \
> /etc/apt/apt.conf.d/99no-auto-updates
buildserver: support HTTPS Debian mirrors The ever troublesome gpjenkins box needs to use HTTPS mirrors. Plus it improves the security of the buildserver, since there have been CVEs that HTTPS would protect against: https://www.debian.org/security/2016/dsa-3733
2017-03-16 14:48:08 +01:00
if echo $debian_mirror | grep '^https' 2>&1 > /dev/null; then
provisioners: work around apt-get update problem
2018-10-24 13:06:27 +02:00
apt-get -y update || apt-get -y update
buildserver: apt-transport-https needs ca-certificates ca-certificates is set as Recommends: but for our use cases it is required since without it, standard CA-signed certs fail to validate.
2018-09-19 08:51:12 +02:00
apt-get -y install apt-transport-https ca-certificates
buildserver: support HTTPS Debian mirrors The ever troublesome gpjenkins box needs to use HTTPS mirrors. Plus it improves the security of the buildserver, since there have been CVEs that HTTPS would protect against: https://www.debian.org/security/2016/dsa-3733
2017-03-16 14:48:08 +01:00
fi
more general regex for updating debian repo urls in buildserver provisions
2018-06-26 11:25:07 +02:00
sed -Ei "s,^deb [a-z]+://\S+,deb ${debian_mirror}," /etc/apt/sources.list
buildserver: support HTTPS Debian mirrors The ever troublesome gpjenkins box needs to use HTTPS mirrors. Plus it improves the security of the buildserver, since there have been CVEs that HTTPS would protect against: https://www.debian.org/security/2016/dsa-3733
2017-03-16 14:48:08 +01:00
updated buildserver provisions to stretch
2018-06-26 10:53:42 +02:00
if grep --quiet stretch /etc/apt/sources.list; then
echo "deb $debian_mirror stretch-backports main" > /etc/apt/sources.list.d/stretch-backports.list
buildserver: support installing packages from Debian/testing Sometimes, a build process requires newer versions of build tools than are available in Debian/stable. Oftentimes, using the package straight from Debian/testing works fine when a package is not available as a backport. libtool 2.4.6 is needed for building VLC, so it is one example of this. The preferences file sets up the apt "pinning" so that all updates are not installed from testing, only the packages that are requested by adding "/testing" after then package name. closes #224
2017-01-10 10:54:21 +01:00
echo "deb $debian_mirror testing main" > /etc/apt/sources.list.d/testing.list
printf "Package: *\nPin: release o=Debian,a=testing\nPin-Priority: -300\n" > /etc/apt/preferences.d/debian-testing
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
fi
dpkg --add-architecture i386
provisioners: work around apt-get update problem
2018-10-24 13:06:27 +02:00
apt-get -y update || apt-get -y update
buildserver: download apt package first to increase reliability This does not have the careful result rechecking that chef has, when it installs each package in the list one at a time. So to help with failures caused by a package failing to download, first try downloading all the package, then run the install. The install pass will try to download any missing packages. Really, this should use ansible or perhaps chef again since those include lots of tricks around this stuff.
2016-09-06 14:33:13 +02:00
apt-get -y upgrade --download-only
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
apt-get -y upgrade
packages="
ant
bs: add sqlite3 and asn1c
2016-07-23 19:14:28 +02:00
asn1c
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
ant-contrib
autoconf
autoconf2.13
buildserver: use automake and cmake from jessie-backports These should be reasonably backwards compatible, and there is already automake1.11 for those that need a version that old. As for cmake, there are five apps that seem to it: com.amaze.filemanager org.dolphinemu.dolphinemu org.navitproject.navit org.yabause.android org.videolan.vlc It looks like VLC is the only app that is currently building and using cmake in the most recent releases. Some of them used to use cmake, but no longer.
2017-02-07 10:47:20 +01:00
automake/testing
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
automake1.11
autopoint
bison
bzr
updated buildserver provisions to stretch
2018-06-26 10:53:42 +02:00
ca-certificates-java
cmake
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
curl
expect
faketime
flex
updated buildserver provisions to stretch
2018-06-26 10:53:42 +02:00
gettext
gettext-base
git-core
git-svn
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
gperf
graphviz
imagemagick
inkscape
javacc
libarchive-zip-perl
libexpat1-dev
libgcc1:i386
libglib2.0-dev
Add required packages for linphone 3.1.0 build
2017-05-24 06:19:13 +02:00
liblwp-protocol-https-perl
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
liblzma-dev
libncurses5:i386
librsvg2-bin
libsaxonb-java
libssl-dev
libstdc++6:i386
buildserver: support installing packages from Debian/testing Sometimes, a build process requires newer versions of build tools than are available in Debian/stable. Oftentimes, using the package straight from Debian/testing works fine when a package is not available as a backport. libtool 2.4.6 is needed for building VLC, so it is one example of this. The preferences file sets up the apt "pinning" so that all updates are not installed from testing, only the packages that are requested by adding "/testing" after then package name. closes #224
2017-01-10 10:54:21 +01:00
libtool/testing
libtool-bin/testing
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
make
maven
updated buildserver provisions to stretch
2018-06-26 10:53:42 +02:00
mercurial
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
nasm
buildserver: install nodejs
2016-11-07 22:54:47 +01:00
nodejs
buildserver: add openjdk-8-jdk-headless depends from backports
2017-02-06 14:59:15 +01:00
openjdk-8-jre-headless
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
openjdk-8-jdk-headless
optipng
p7zip
pandoc
perlmagick
pkg-config
python-gnupg
Add buildserver lxml requirement for pEp
2016-08-28 14:47:12 +02:00
python-lxml
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python-magic
buildserver: include pip for both Python 2.x and 3.x `pip install` is a relatively common thing for app builds to use in sudo=, so it should be built into the buildserver. This then builds in the trust relationship to pypi, since it comes from Debian rather than some random pip download/install process.
2018-11-20 12:09:45 +01:00
python-pip
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python-setuptools
buildserver now needs python3-defusedxml 4d13a904f3877ff2502b619df3b9f8f714024698 means that defusedxml is required to be installed on the buildserver guest.
2018-09-03 22:42:31 +02:00
python3-defusedxml
updated buildserver provisions to stretch
2018-06-26 10:53:42 +02:00
python3-git
python3-gitdb
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python3-gnupg
buildserver: include pip for both Python 2.x and 3.x `pip install` is a relatively common thing for app builds to use in sudo=, so it should be built into the buildserver. This then builds in the trust relationship to pypi, since it comes from Debian rather than some random pip download/install process.
2018-11-20 12:09:45 +01:00
python3-pip
provision missing pyasn1 dependency to build server
2017-04-13 00:44:53 +02:00
python3-pyasn1
python3-pyasn1-modules
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python3-requests
buildserver: include pip for both Python 2.x and 3.x `pip install` is a relatively common thing for app builds to use in sudo=, so it should be built into the buildserver. This then builds in the trust relationship to pypi, since it comes from Debian rather than some random pip download/install process.
2018-11-20 12:09:45 +01:00
python3-setuptools
updated buildserver provisions to stretch
2018-06-26 10:53:42 +02:00
python3-smmap
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python3-yaml
add ruamel yaml to buildserver depenencies
2017-05-09 13:15:28 +02:00
python3-ruamel.yaml
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
quilt
realpath
Add required packages for linphone 3.1.0 build
2017-05-24 06:19:13 +02:00
rsync
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
scons
bs: add sqlite3 and asn1c
2016-07-23 19:14:28 +02:00
sqlite3
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
subversion
swig
texinfo
transfig
unzip
vorbis-tools
xsltproc
yasm
zip
zlib1g:i386
"
buildserver: download apt package first to increase reliability This does not have the careful result rechecking that chef has, when it installs each package in the list one at a time. So to help with failures caused by a package failing to download, first try downloading all the package, then run the install. The install pass will try to download any missing packages. Really, this should use ansible or perhaps chef again since those include lots of tricks around this stuff.
2016-09-06 14:33:13 +02:00
apt-get install --yes $packages --download-only
apt-get install --yes $packages
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
highestjava=`update-java-alternatives --list | sort -n | tail -1 | cut -d ' ' -f 1`
update-java-alternatives --set $highestjava
configure headless openjdk to run without gtk accessability dependencies
2018-08-21 12:55:31 +02:00
# configure headless openjdk to work without gtk accessability dependencies
sed -i -e 's@\(assistive_technologies=org.GNOME.Accessibility.AtkWrapper\)@#\1@' /etc/java-8-openjdk/accessibility.properties
Copy Permalink