kamp/fdroidserver
1
0
Fork 0
mirror of https://gitlab.com/fdroid/fdroidserver.git synced 2024-11-04 22:40:12 +01:00
Code Activity
330ca2319c
fdroidserver/buildserver/provision-apt-get-install

142 lines
2.9 KiB
Plaintext
Raw Normal View History

buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
#!/bin/bash
buildserver: make provision scripts output name to log
2016-07-04 14:20:42 +02:00
echo $0
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
set -e
set -x
debian_mirror=$1
buildserver: set quiet options to stop apt-get spamming build logs https://gitlab.com/fdroid/fdroidserver/issues/636#note_266483988
2020-01-14 23:14:45 +01:00
export DEBIAN_FRONTEND=noninteractive
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
buildserver: download apt package first to increase reliability This does not have the careful result rechecking that chef has, when it installs each package in the list one at a time. So to help with failures caused by a package failing to download, first try downloading all the package, then run the install. The install pass will try to download any missing packages. Really, this should use ansible or perhaps chef again since those include lots of tricks around this stuff.
2016-09-06 14:33:13 +02:00
printf 'APT::Install-Recommends "0";\nAPT::Install-Suggests "0";\n' \
> /etc/apt/apt.conf.d/99no-install-recommends
buildserver: retry apt-get downloads 20 times Try harder before failing the whole buildserver setup.
2016-09-15 11:12:49 +02:00
printf 'APT::Acquire::Retries "20";\n' \
> /etc/apt/apt.conf.d/99acquire-retries
buildserver: disable all automatic apt-get updates Prevents errors due to: dpkg: error: dpkg status database is locked by another process closes #437
2018-12-08 16:57:01 +01:00
cat <<EOF > /etc/apt/apt.conf.d/99no-auto-updates
APT::Periodic::Enable "0";
APT::Periodic::Update-Package-Lists "0";
APT::Periodic::Unattended-Upgrade "0";
EOF
buildserver: force no auto updates of package lists or upgrades
2018-01-17 21:04:08 +01:00
provision-apt: add assumeyes config closes #600
2018-11-27 18:13:33 +01:00
printf 'APT::Get::Assume-Yes "true";\n' \
> /etc/apt/apt.conf.d/99assumeyes
buildserver: set quiet options to stop apt-get spamming build logs https://gitlab.com/fdroid/fdroidserver/issues/636#note_266483988
2020-01-14 23:14:45 +01:00
cat <<EOF > /etc/apt/apt.conf.d/99quiet
fix syntax error from ae86dc3d38f5da315a27aa0b9847676f8530557e fdroid/fdroidserver!713 [skip ci]
2020-02-11 12:48:34 +01:00
Dpkg::Use-Pty "0";
quiet "1";
buildserver: set quiet options to stop apt-get spamming build logs https://gitlab.com/fdroid/fdroidserver/issues/636#note_266483988
2020-01-14 23:14:45 +01:00
EOF
provision-apt: add assumeyes config closes #600
2018-11-27 18:13:33 +01:00
buildserver: support HTTPS Debian mirrors The ever troublesome gpjenkins box needs to use HTTPS mirrors. Plus it improves the security of the buildserver, since there have been CVEs that HTTPS would protect against: https://www.debian.org/security/2016/dsa-3733
2017-03-16 14:48:08 +01:00
if echo $debian_mirror | grep '^https' 2>&1 > /dev/null; then
provision-apt: add assumeyes config closes #600
2018-11-27 18:13:33 +01:00
apt-get update || apt-get update
apt-get install apt-transport-https ca-certificates
buildserver: support HTTPS Debian mirrors The ever troublesome gpjenkins box needs to use HTTPS mirrors. Plus it improves the security of the buildserver, since there have been CVEs that HTTPS would protect against: https://www.debian.org/security/2016/dsa-3733
2017-03-16 14:48:08 +01:00
fi
simplify debian mirror setup
2018-11-27 14:07:19 +01:00
cat << EOF > /etc/apt/sources.list
deb ${debian_mirror} stretch main
deb http://security.debian.org/debian-security stretch/updates main
deb ${debian_mirror} stretch-updates main
EOF
echo "deb ${debian_mirror} stretch-backports main" > /etc/apt/sources.list.d/stretch-backports.list
Add stretch-backports-sloppy repo too
2020-03-30 13:10:51 +02:00
echo "deb ${debian_mirror} stretch-backports-sloppy main" > /etc/apt/sources.list.d/stretch-backports-sloppy.list
simplify debian mirror setup
2018-11-27 14:07:19 +01:00
echo "deb ${debian_mirror} testing main" > /etc/apt/sources.list.d/testing.list
printf "Package: *\nPin: release o=Debian,a=testing\nPin-Priority: -300\n" > /etc/apt/preferences.d/debian-testing
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
dpkg --add-architecture i386
provision-apt: add assumeyes config closes #600
2018-11-27 18:13:33 +01:00
apt-get update || apt-get update
apt-get upgrade --download-only
apt-get upgrade
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
packages="
purge common.use_androguard, it is now used by default Up until now, the buildserver has not included androguard. Since a good version of androguard (v3.3.3+) is included in stretch-backports and the buildserver is already setup to use stretch-backports, this sets up the buildserver with androguard. closes #627
2020-10-21 19:51:32 +02:00
androguard/stretch-backports
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
ant
bs: add sqlite3 and asn1c
2016-07-23 19:14:28 +02:00
asn1c
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
ant-contrib
autoconf
autoconf2.13
provision-apt: don't use automake/libtool from testing This was set up when running jessie and shouldn;t be requried for now.
2018-11-27 00:41:43 +01:00
automake
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
automake1.11
autopoint
bison
bzr
updated buildserver provisions to stretch
2018-06-26 10:53:42 +02:00
ca-certificates-java
cmake
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
curl
buildserver: include disorderfs to avoid sudo: in metadata Right now, the only thing that Briar needs in sudo: in order to be built reproducibly is `apt-get install disorderfs`. This includes it in the standard image to make it easy to spread that technique to many builds. @grote
2018-12-06 21:55:02 +01:00
disorderfs
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
expect
faketime
flex
updated buildserver provisions to stretch
2018-06-26 10:53:42 +02:00
gettext
gettext-base
git-core
git-svn
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
gperf
Use newer gpg from sloppy
2020-11-01 13:02:48 +01:00
gpg/stretch-backports-sloppy
provision-apt-get-install: fix gpg from stretch-backports-sloppy !822 The gpg dependencies are complicated. The previous setup was always failing with: The following information may help to resolve the situation: The following packages have unmet dependencies: gpg : Depends: gpgconf (= 2.2.20-1~bpo9+1) Depends: libassuan0 (>= 2.5.0) but 2.4.3-2 is to be installed Depends: libgpg-error0 (>= 1.35) but 1.26-2 is to be installed Thanks to @izzysoft to spotting this.
2020-11-09 14:37:33 +01:00
gpgconf/stretch-backports-sloppy
libassuan0/stretch-backports
libgpg-error0/stretch-backports
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
javacc
libarchive-zip-perl
libexpat1-dev
libgcc1:i386
libglib2.0-dev
liblzma-dev
libncurses5:i386
librsvg2-bin
libsaxonb-java
libssl-dev
libstdc++6:i386
provision-apt: don't use automake/libtool from testing This was set up when running jessie and shouldn;t be requried for now.
2018-11-27 00:41:43 +01:00
libtool
libtool-bin
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
make
maven
updated buildserver provisions to stretch
2018-06-26 10:53:42 +02:00
mercurial
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
nasm
buildserver: add openjdk-8-jdk-headless depends from backports
2017-02-06 14:59:15 +01:00
openjdk-8-jre-headless
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
openjdk-8-jdk-headless
optipng
p7zip
pkg-config
python-gnupg
Add buildserver lxml requirement for pEp
2016-08-28 14:47:12 +02:00
python-lxml
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python-magic
buildserver: include pip for both Python 2.x and 3.x `pip install` is a relatively common thing for app builds to use in sudo=, so it should be built into the buildserver. This then builds in the trust relationship to pypi, since it comes from Debian rather than some random pip download/install process.
2018-11-20 12:09:45 +01:00
python-pip
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python-setuptools
purge common.use_androguard, it is now used by default Up until now, the buildserver has not included androguard. Since a good version of androguard (v3.3.3+) is included in stretch-backports and the buildserver is already setup to use stretch-backports, this sets up the buildserver with androguard. closes #627
2020-10-21 19:51:32 +02:00
python3-asn1crypto/stretch-backports
buildserver now needs python3-defusedxml 4d13a904f3877ff2502b619df3b9f8f714024698 means that defusedxml is required to be installed on the buildserver guest.
2018-09-03 22:42:31 +02:00
python3-defusedxml
updated buildserver provisions to stretch
2018-06-26 10:53:42 +02:00
python3-git
python3-gitdb
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python3-gnupg
buildserver: include pip for both Python 2.x and 3.x `pip install` is a relatively common thing for app builds to use in sudo=, so it should be built into the buildserver. This then builds in the trust relationship to pypi, since it comes from Debian rather than some random pip download/install process.
2018-11-20 12:09:45 +01:00
python3-pip
provision missing pyasn1 dependency to build server
2017-04-13 00:44:53 +02:00
python3-pyasn1
python3-pyasn1-modules
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python3-requests
buildserver: include pip for both Python 2.x and 3.x `pip install` is a relatively common thing for app builds to use in sudo=, so it should be built into the buildserver. This then builds in the trust relationship to pypi, since it comes from Debian rather than some random pip download/install process.
2018-11-20 12:09:45 +01:00
python3-setuptools
updated buildserver provisions to stretch
2018-06-26 10:53:42 +02:00
python3-smmap
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
python3-yaml
Revert "Merge branch 'write-yaml-overhaul' into 'master'" This reverts merge request !630
2019-04-01 12:24:00 +02:00
python3-ruamel.yaml
add now required packages to buildserver installation Dependencies introduced in ffdroid/fdroidserver!798
2020-09-26 21:50:09 +02:00
python3-pil
python3-paramiko
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
quilt
Add required packages for linphone 3.1.0 build
2017-05-24 06:19:13 +02:00
rsync
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
scons
bs: add sqlite3 and asn1c
2016-07-23 19:14:28 +02:00
sqlite3
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
subversion
buildserver: explicitly include sudo as a dependency The basebox currently provides sudo, but that may not always be the case. This makes the sudo dependency explicit, so that this provisioning script can also be used in other settings, like GitLab CI.
2020-05-27 17:40:23 +02:00
sudo
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
swig
unzip
xsltproc
yasm
zip
zlib1g:i386
"
provision-apt: add assumeyes config closes #600
2018-11-27 18:13:33 +01:00
apt-get install $packages --download-only
apt-get install $packages
buildserver: move apt setup to a shell script This makes it so there is only a single `apt-get install` command run, instead of one command per-package like with the chef script. It also adds `apt-get upgrade` to make sure that the base box is fully up-to-date.
2016-07-04 13:52:19 +02:00
highestjava=`update-java-alternatives --list | sort -n | tail -1 | cut -d ' ' -f 1`
update-java-alternatives --set $highestjava
configure headless openjdk to run without gtk accessability dependencies
2018-08-21 12:55:31 +02:00
# configure headless openjdk to work without gtk accessability dependencies
sed -i -e 's@\(assistive_technologies=org.GNOME.Accessibility.AtkWrapper\)@#\1@' /etc/java-8-openjdk/accessibility.properties
Copy Permalink