Commit Graph

308 Commits

Author SHA1 Message Date
Niels de Vos
3592bbedbb build: use urllib3 < 2 with Jenkins jobs Builder
jenkins-job-builder does not seem to work with urllib3 2.x, force using
version 1.x as a workaround.

Updates: #3946
Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-06-27 12:51:26 +00:00
Rakshith R
a6ac81133f ci: remove k8s 1.24 support
K8s 1.24 will be End of Life on 2023-07-28.
Therefore, this commit removes support
for k8s 1.24.

refer:
https://kubernetes.io/releases/#release-v1-24

Signed-off-by: Rakshith R <rar@redhat.com>
2023-06-21 10:53:42 +00:00
Niels de Vos
a02b38ac27 ci: use CentOS Stream 9 for Jenkins Jobs Builder image
CentOS Stream 8 does not provide a module named 'dataclasses'. It seems
current versions of Jenkins Jobs Builder require that. Python 3.7
offers the module by default, so using a new base distribution with
Python 3.9 has the module too.

See-also: #3909
Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-06-21 08:11:51 +00:00
Madhu Rajanna
f7942edc6c ci: remove kubernetes 1.23 support
removed ability to run tests with
kubernetes 1.23 as its no longer
maintained version.

fixes: #3636

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2023-04-18 10:05:26 +02:00
Niels de Vos
cca994eb1a ci: run registry garbage collection every week
In the old OpenShift cluster the registry consumer 800+ GB of data. Once
running the garbage collection manually, the consumption reduced to a
little over 8GB. Let's be nice users of the infrastructure and run
garbage collection weekly.

Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-03-20 14:20:53 +00:00
Niels de Vos
8181d13313 ci: update mirroring container-images job for new OCP
The new OpenShift cluster complained about deprecated types and missing
options in the yaml files.

Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-03-20 10:52:12 +00:00
Niels de Vos
b0e9eeba36 ci: correct parameter passing in checkout-repo.sh
ShellCheck failed with the following warning:

```
SC2086 (info): Double quote to prevent globbing and word splitting.

Did you mean:
git config --global --add safe.directory "${PWD}"
```

Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-03-20 09:21:41 +00:00
Niels de Vos
8135680065 ci: migrate to new OpenShift cluster running on AWS
Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-03-20 09:21:41 +00:00
Niels de Vos
234471af33 ci: allow /opt/build for git repository when deploying jobs
When Jenkins Jobs have been modified, they should get deployed in the
Jenkins environment. This seems to fail with the following error:

```
Initialized empty Git repository in /opt/build/.git/
fatal: detected dubious ownership in repository at '/opt/build'
To add an exception for this directory, call:

	git config --global --add safe.directory /opt/build
```

By marking /opt/build as a safe directory in the global git
configuration file, this problem should not occur anymore.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2023-01-30 15:15:06 +01:00
Niels de Vos
f7ba14b2ed ci: add jobs for running with Kubernetes 1.27
Signed-off-by: Niels de Vos <ndevos@redhat.com>
2023-01-30 09:48:56 +00:00
Humble Chirammal
4037ebca49 ci: update rook version to 1.10.9
this commit update ci rook version to latest.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2023-01-13 09:50:28 +00:00
Niels de Vos
b557fc82bd ci: move ci-job-validation to duffy API
It seems all jobs were converted to the new `duffy` command, except
ci-job-validation which still used the old `cico` command.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2023-01-13 09:46:26 +00:00
Niels de Vos
3880d642b9 ci: use new duffy command for CentOS CI
The `cico` command is getting deprecated, and the new `duffy` command
should be used instead. The new command requires a `~/.config/duffy`
file that contains an API endpoint and credentials.

See-also: https://sigs.centos.org/guide/ci/#installing-and-configuring-duffy-client
Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-12-12 08:23:30 +00:00
Madhu Rajanna
69329b5592 ci: use kubernetes 1.25 for upgrade tests
Upgrade tests always runs with the latest
release of kubernetes, updating the
kubernetes to latest available release
in the CI.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-28 19:49:45 +00:00
Madhu Rajanna
253b6a9d2b ci: remove kubernetes 1.22 from CI
As we dont longer required to test with
Kubernetes 1.22 removing it from the CI.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-28 19:49:45 +00:00
Madhu Rajanna
65411d7975 ci: update outdates kubernetes version
use latest used kubernetes version or supported
kubernetes version for upgrade testing.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-26 10:18:14 +00:00
Madhu Rajanna
8cabc0327f ci: run upgrade tests with latest release
Run E2E tests with latest available release.

fixes: #2818

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-26 10:18:14 +00:00
Madhu Rajanna
c1255f809b ci: disable e2e tests by default in CI
Disable e2e tests by default in CI to
save resources. cephcsi maintainers or
contributors can add the ok-to-test label
to trigger the e2e tests.

depends on #3468

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-26 04:43:41 +00:00
Madhu Rajanna
d6b721b7a8 ci: use rook v1.10.4 in CI
update Rook image version to
v1.10.4 which is latest release

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-24 08:48:07 +00:00
Niels de Vos
83369a36f1 ci: install wget for downloading Helm
Installing Helm fails if `wget` is not available. The script that
installs Helm does not seem to abort though.

By installing `wget` in preparation for deploying with Helm, the CI jobs
should get ready to run successfully.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-10-13 06:26:56 +00:00
Niels de Vos
cf85580c16 ci: include journalctl --boot from the host in system status
Now that we run with Podman, the journal from the container that was
started by minikube is not very useful. In addition to the journal from
the minikube container or VM, include the journal from the host.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-10-12 16:36:15 +00:00
Niels de Vos
fce1892115 ci: copy images into minikube container when VM_DRIVER=podman
Even when minikube is running with `--driver=podman`, `minikube ssh`
works and container images can be copied into the minikube container.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-10-12 10:14:49 +00:00
Niels de Vos
893da82f71 ci: use VM_DRIVER=podman for AWS virtual-machines
With the CentOS CI machines moving to AWS EC2 virtual-machines, there is
no option to run minikube with a VM anymore. Instead, run minikube with
the Podman driver and partition the extra xvdb EBS volume into three
pieces.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-10-10 07:18:28 +00:00
Madhu Rajanna
7681ef27ff ci: update rook image in centos ci
update rook image to latest release
in ci

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-07 16:11:37 +00:00
Niels de Vos
a55c539f2a ci: run k8s v1.26 jobs on request
Kubernetes 1.26 has reached Alpha state, so the project can now be used
to run CI jobs against.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-09-22 04:50:27 +00:00
Madhu Rajanna
c53f63e7ac ci: mirror Rook v1.10.0 image
Rook v1.10.0 is required for ceph
cluster deployment on kubernetes 1.25
because older version of Rook still comes
with PSP templates which is removed in
Kubernetes 1.25

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-09-06 07:51:54 +00:00
Madhu Rajanna
f7782eeac2 ci: run e2e on kubernetes 1.25
Deploy kubernetes 1.25 and run e2e
tests on it on demand.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-09-05 15:22:49 +00:00
Marcel Lauhoff
1def8d8a1a ci: Set MINIKUBE_ISO_URL on minikube.sh up call
Signed-off-by: Marcel Lauhoff <marcel.lauhoff@suse.com>
2022-08-30 03:45:32 +00:00
Madhu Rajanna
ef31cd110f ci: update rook verion to v1.9.8
updating rook release version to latest
release i.e v1.9.8

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-08-05 06:55:18 +00:00
Niels de Vos
4ef7ece894 ci: use latest :v17 Ceph contaimer-image again
A new Ceph container-image has been released. This should address the
Ceph Mgr issue that was present in :v17.2.2.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-08-01 08:21:43 +00:00
Niels de Vos
dff758bd29 ci: mirror the ceph/ceph:v17.2.1 image as ceph/ceph:v17
The v17.2.2 image from last week causes segfaults in Ceph Mgr. Mirror
the :v17.2.1 image as :v17 instead of the latest.

Updates: #3259
Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-07-25 16:02:15 +00:00
Madhu Rajanna
8bb8a12928 ci: remove Kubernetes 1.21 from CI
We will run CI on 3 latest kubernetes
releases removing Kubernetes 1.21 support
as we have Kubernetes 1.22, 1.23 and 1.24 for
CI Jobs.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-07-25 07:32:51 +00:00
Madhu Rajanna
35007a76d3 ci: run e2e on Kubernetes v1.24 by default
As we have stable CI for kubernetes v1.24 and
Kubernetes v1.24 released sometime back, defaulting
Kubernetes v1.24 for the CI run.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-07-25 07:32:51 +00:00
Madhu Rajanna
8ae18c3809 ci: add rook v1.9.4 image to mirror
Add rook v1.9.4 image to mirror list
to use the image for e2e testing.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-06-01 11:04:12 +00:00
Madhu Rajanna
dd53b13a9b ci: collect kubelet status
collect kubelet status as part
of the system-status which helps
in debugging.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-05-06 06:49:58 +00:00
Madhu Rajanna
100d53d595 cleanup: add unwanted files to gitignore
This is the exact copy of the gitignore
from the devel branch to ignore files from
the git.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-05-05 09:44:57 +00:00
Madhu Rajanna
a0eccf47b4 ci: run tests on kubernetes 1.24
This commits adds the kuberenetes
1.24 to run on request for now.

Note:- Once the kubernetes 1.24 job is stable
will run it by default

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-05-05 09:44:57 +00:00
Humble Chirammal
9758f45614 ci: correct prefix path for centos mirroring repository
as a solution to the image referencing issue, we are prefixing
the string `quay.io` as a tag in mirror image list.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-31 09:37:44 +00:00
Humble Chirammal
b553425d85 ci: replace docker.io ceph image with quay.io path
The ceph images are served from quay.io and this commit adjust
the docker pull to quay.io pull for centos jobs.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-30 09:11:37 +00:00
Humble Chirammal
c58b02ae52 ci: mirror ceph v17 container version in the centos repository
This update the devel branch mirroring from v16 to v17

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-25 05:14:57 +00:00
Humble Chirammal
f5aa4dae3d ci: replace the references of container images from docker.io to quay.io
The image list was referring `docker.io` images and this commit change
that to `quay.io` references.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-25 05:14:57 +00:00
Humble Chirammal
0bf13764a5 ci: add release 3.5 image details to the mirror image list
The release 3.5 image details were missing and this commit add the
same.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-25 05:14:57 +00:00
Niels de Vos
1101ec0c8d ci: add GOARCH to path for copying kubectl
minikube 1.25.2 moved the downloaded kubectl and other binaries to a new
subdir; it now includes runtime.GOARCH as an extra component.

See-also: kubernetes/minikube#13539
Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-03-16 11:24:14 +00:00
Niels de Vos
ed95c4aa78 ci: use CentOS Stream 8 for infra containers
The container images for Jenkins Job Builder and mirroring images were
still using the EOL CentOS 8 base image. Rebuilding those
container-images fails as the CentOS mirrors do not provide the
repositories for installing package anymore.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-02-04 03:12:34 +00:00
Niels de Vos
fe922b8805 ci: pass GOARCH when building images in OpenShift
It seems that regular jobs in the OpenShift environment fail with the
following error:

    Missing GOARCH argument for building image, install Golang or run: make containerized-test GOARCH=amd64

This happens for both the `devel` and `test` image builds since December
13 when installing Golang in the container-images was added.

Fixes: 8a3fe53e "ci: install arch specific go in Dockerfile.devel"
Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-02-03 10:26:34 +00:00
Niels de Vos
50ac270360 ci: request CentOS Stream 8 bare-metal machines
CentOS 8 is EOL since the beginning of the year. CentOS Stream 8
installations should be used instead.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-02-02 12:41:11 +00:00
Madhu Rajanna
464759feef ci: update rook image to mirror
updated rook image tag to mirror
latest version to internal registry.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-01-21 10:29:12 +00:00
Madhu Rajanna
b22fe5f059 ci: remove kubernetes 1.20 from CI
removing kubernetes test run with 1.20
as with  #2705 we dont need 1.20 CI
results to merge a PR and we have kube 1.23
latest release.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-12-13 04:46:06 +00:00
Madhu Rajanna
31d037eb95 ci: run tests on kubernetes 1.23 by default
The e2e tests are running fine on kubernetes
1.23. This commit runs the tests on kubernetes
1.23 by default.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-12-10 06:58:46 +00:00
Madhu Rajanna
d351e00992 ci: run tests on kubernetes 1.23
This commits removes the older version (1.19
and 1.20) from testing and adds the kuberenetes
1.23 to run on request for now.

Note:- Once the kubernetes 1.23 job is stable
will run it by default

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-12-09 09:06:18 +00:00