Commit Graph

316 Commits

Author SHA1 Message Date
Niels de Vos
274739f70b ci: strip quay.io from mirrored ceph/ceph:v18 image
CI jobs pull the ceph/ceph:v18 image (without `quay.io`). If the
mirroring includes the registry host, the image can not be found.

Updates: #4030
Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-08-04 07:35:10 +00:00
Madhu Rajanna
32335dc9eb ci: update images for mirroring
As we need to move to latest Rook
and Ceph releases in devel branch
updating mirroring images to push
latest images to internal registry.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2023-08-02 20:29:31 +00:00
Rakshith R
ae5e455322 ci: override csi_upgrade_version from build.env
This commit enables overriding csi_upgrade_version
used for upgrade testing with CSI_UPGRADE_VERSION
value from build.env.

Signed-off-by: Rakshith R <rar@redhat.com>
2023-07-21 10:57:40 +00:00
karthik-us
2ab3e8337f ci: Update csi_upgrade_version
Point the csi_upgrade_version from v3.7.2 to the
latest release v3.9.0.

Updates: #3911
Signed-off-by: karthik-us <ksubrahm@redhat.com>
2023-07-13 08:12:53 +00:00
karthik-us
d14bba7c12 doc: Update/remove broken links
Updates few broken links, removes a non existent link and some nit-picks.

Signed-off-by: karthik-us <ksubrahm@redhat.com>
2023-07-04 14:58:17 +00:00
Niels de Vos
ab521dba96 ci: fix trigger command for ci/centos/mini-e2e-helm jobs
The `/test ci/centos/mini-e2e-helm` has been broken with the last change
where `/test all` was removed. A remaining '(' makes the regular
expression invalid, and jobs fail to get started.

Fixes: f9f3bb9 ("ci: remove `/retest all` command for Jenkins jobs")
Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-07-03 15:26:37 +00:00
Niels de Vos
f9f3bb90a5 ci: remove /retest all command for Jenkins jobs
`/retest all` causes a spike in resource consumption in Jenkins and the
OpenShift cluster kills the Pod. That means tests are not fully running
yet, and results never arrive back in the PR. Instead of `/retest all`,
the `ok-to-test` label can be used to trigger required tests with a
slight delay between each command.

Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-06-29 11:10:48 +00:00
Niels de Vos
5e728f51b2 build: remove urllib3 downgrade in jjb container, use timeout instead
The upstream reported issue suggests adding a `timeout` value in the
Jenkins Jobs Builder configuration. This looks like a nicer workaround
than downgrading urllib3.

Fixes: #3946
See-also: https://storyboard.openstack.org/#!/story/2010752
Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-06-28 12:48:12 +00:00
Niels de Vos
3592bbedbb build: use urllib3 < 2 with Jenkins jobs Builder
jenkins-job-builder does not seem to work with urllib3 2.x, force using
version 1.x as a workaround.

Updates: #3946
Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-06-27 12:51:26 +00:00
Rakshith R
a6ac81133f ci: remove k8s 1.24 support
K8s 1.24 will be End of Life on 2023-07-28.
Therefore, this commit removes support
for k8s 1.24.

refer:
https://kubernetes.io/releases/#release-v1-24

Signed-off-by: Rakshith R <rar@redhat.com>
2023-06-21 10:53:42 +00:00
Niels de Vos
a02b38ac27 ci: use CentOS Stream 9 for Jenkins Jobs Builder image
CentOS Stream 8 does not provide a module named 'dataclasses'. It seems
current versions of Jenkins Jobs Builder require that. Python 3.7
offers the module by default, so using a new base distribution with
Python 3.9 has the module too.

See-also: #3909
Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-06-21 08:11:51 +00:00
Madhu Rajanna
f7942edc6c ci: remove kubernetes 1.23 support
removed ability to run tests with
kubernetes 1.23 as its no longer
maintained version.

fixes: #3636

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2023-04-18 10:05:26 +02:00
Niels de Vos
cca994eb1a ci: run registry garbage collection every week
In the old OpenShift cluster the registry consumer 800+ GB of data. Once
running the garbage collection manually, the consumption reduced to a
little over 8GB. Let's be nice users of the infrastructure and run
garbage collection weekly.

Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-03-20 14:20:53 +00:00
Niels de Vos
8181d13313 ci: update mirroring container-images job for new OCP
The new OpenShift cluster complained about deprecated types and missing
options in the yaml files.

Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-03-20 10:52:12 +00:00
Niels de Vos
b0e9eeba36 ci: correct parameter passing in checkout-repo.sh
ShellCheck failed with the following warning:

```
SC2086 (info): Double quote to prevent globbing and word splitting.

Did you mean:
git config --global --add safe.directory "${PWD}"
```

Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-03-20 09:21:41 +00:00
Niels de Vos
8135680065 ci: migrate to new OpenShift cluster running on AWS
Signed-off-by: Niels de Vos <ndevos@ibm.com>
2023-03-20 09:21:41 +00:00
Niels de Vos
234471af33 ci: allow /opt/build for git repository when deploying jobs
When Jenkins Jobs have been modified, they should get deployed in the
Jenkins environment. This seems to fail with the following error:

```
Initialized empty Git repository in /opt/build/.git/
fatal: detected dubious ownership in repository at '/opt/build'
To add an exception for this directory, call:

	git config --global --add safe.directory /opt/build
```

By marking /opt/build as a safe directory in the global git
configuration file, this problem should not occur anymore.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2023-01-30 15:15:06 +01:00
Niels de Vos
f7ba14b2ed ci: add jobs for running with Kubernetes 1.27
Signed-off-by: Niels de Vos <ndevos@redhat.com>
2023-01-30 09:48:56 +00:00
Humble Chirammal
4037ebca49 ci: update rook version to 1.10.9
this commit update ci rook version to latest.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2023-01-13 09:50:28 +00:00
Niels de Vos
b557fc82bd ci: move ci-job-validation to duffy API
It seems all jobs were converted to the new `duffy` command, except
ci-job-validation which still used the old `cico` command.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2023-01-13 09:46:26 +00:00
Niels de Vos
3880d642b9 ci: use new duffy command for CentOS CI
The `cico` command is getting deprecated, and the new `duffy` command
should be used instead. The new command requires a `~/.config/duffy`
file that contains an API endpoint and credentials.

See-also: https://sigs.centos.org/guide/ci/#installing-and-configuring-duffy-client
Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-12-12 08:23:30 +00:00
Madhu Rajanna
69329b5592 ci: use kubernetes 1.25 for upgrade tests
Upgrade tests always runs with the latest
release of kubernetes, updating the
kubernetes to latest available release
in the CI.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-28 19:49:45 +00:00
Madhu Rajanna
253b6a9d2b ci: remove kubernetes 1.22 from CI
As we dont longer required to test with
Kubernetes 1.22 removing it from the CI.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-28 19:49:45 +00:00
Madhu Rajanna
65411d7975 ci: update outdates kubernetes version
use latest used kubernetes version or supported
kubernetes version for upgrade testing.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-26 10:18:14 +00:00
Madhu Rajanna
8cabc0327f ci: run upgrade tests with latest release
Run E2E tests with latest available release.

fixes: #2818

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-26 10:18:14 +00:00
Madhu Rajanna
c1255f809b ci: disable e2e tests by default in CI
Disable e2e tests by default in CI to
save resources. cephcsi maintainers or
contributors can add the ok-to-test label
to trigger the e2e tests.

depends on #3468

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-26 04:43:41 +00:00
Madhu Rajanna
d6b721b7a8 ci: use rook v1.10.4 in CI
update Rook image version to
v1.10.4 which is latest release

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-24 08:48:07 +00:00
Niels de Vos
83369a36f1 ci: install wget for downloading Helm
Installing Helm fails if `wget` is not available. The script that
installs Helm does not seem to abort though.

By installing `wget` in preparation for deploying with Helm, the CI jobs
should get ready to run successfully.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-10-13 06:26:56 +00:00
Niels de Vos
cf85580c16 ci: include journalctl --boot from the host in system status
Now that we run with Podman, the journal from the container that was
started by minikube is not very useful. In addition to the journal from
the minikube container or VM, include the journal from the host.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-10-12 16:36:15 +00:00
Niels de Vos
fce1892115 ci: copy images into minikube container when VM_DRIVER=podman
Even when minikube is running with `--driver=podman`, `minikube ssh`
works and container images can be copied into the minikube container.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-10-12 10:14:49 +00:00
Niels de Vos
893da82f71 ci: use VM_DRIVER=podman for AWS virtual-machines
With the CentOS CI machines moving to AWS EC2 virtual-machines, there is
no option to run minikube with a VM anymore. Instead, run minikube with
the Podman driver and partition the extra xvdb EBS volume into three
pieces.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-10-10 07:18:28 +00:00
Madhu Rajanna
7681ef27ff ci: update rook image in centos ci
update rook image to latest release
in ci

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-07 16:11:37 +00:00
Niels de Vos
a55c539f2a ci: run k8s v1.26 jobs on request
Kubernetes 1.26 has reached Alpha state, so the project can now be used
to run CI jobs against.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-09-22 04:50:27 +00:00
Madhu Rajanna
c53f63e7ac ci: mirror Rook v1.10.0 image
Rook v1.10.0 is required for ceph
cluster deployment on kubernetes 1.25
because older version of Rook still comes
with PSP templates which is removed in
Kubernetes 1.25

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-09-06 07:51:54 +00:00
Madhu Rajanna
f7782eeac2 ci: run e2e on kubernetes 1.25
Deploy kubernetes 1.25 and run e2e
tests on it on demand.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-09-05 15:22:49 +00:00
Marcel Lauhoff
1def8d8a1a ci: Set MINIKUBE_ISO_URL on minikube.sh up call
Signed-off-by: Marcel Lauhoff <marcel.lauhoff@suse.com>
2022-08-30 03:45:32 +00:00
Madhu Rajanna
ef31cd110f ci: update rook verion to v1.9.8
updating rook release version to latest
release i.e v1.9.8

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-08-05 06:55:18 +00:00
Niels de Vos
4ef7ece894 ci: use latest :v17 Ceph contaimer-image again
A new Ceph container-image has been released. This should address the
Ceph Mgr issue that was present in :v17.2.2.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-08-01 08:21:43 +00:00
Niels de Vos
dff758bd29 ci: mirror the ceph/ceph:v17.2.1 image as ceph/ceph:v17
The v17.2.2 image from last week causes segfaults in Ceph Mgr. Mirror
the :v17.2.1 image as :v17 instead of the latest.

Updates: #3259
Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-07-25 16:02:15 +00:00
Madhu Rajanna
8bb8a12928 ci: remove Kubernetes 1.21 from CI
We will run CI on 3 latest kubernetes
releases removing Kubernetes 1.21 support
as we have Kubernetes 1.22, 1.23 and 1.24 for
CI Jobs.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-07-25 07:32:51 +00:00
Madhu Rajanna
35007a76d3 ci: run e2e on Kubernetes v1.24 by default
As we have stable CI for kubernetes v1.24 and
Kubernetes v1.24 released sometime back, defaulting
Kubernetes v1.24 for the CI run.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-07-25 07:32:51 +00:00
Madhu Rajanna
8ae18c3809 ci: add rook v1.9.4 image to mirror
Add rook v1.9.4 image to mirror list
to use the image for e2e testing.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-06-01 11:04:12 +00:00
Madhu Rajanna
dd53b13a9b ci: collect kubelet status
collect kubelet status as part
of the system-status which helps
in debugging.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-05-06 06:49:58 +00:00
Madhu Rajanna
100d53d595 cleanup: add unwanted files to gitignore
This is the exact copy of the gitignore
from the devel branch to ignore files from
the git.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-05-05 09:44:57 +00:00
Madhu Rajanna
a0eccf47b4 ci: run tests on kubernetes 1.24
This commits adds the kuberenetes
1.24 to run on request for now.

Note:- Once the kubernetes 1.24 job is stable
will run it by default

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-05-05 09:44:57 +00:00
Humble Chirammal
9758f45614 ci: correct prefix path for centos mirroring repository
as a solution to the image referencing issue, we are prefixing
the string `quay.io` as a tag in mirror image list.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-31 09:37:44 +00:00
Humble Chirammal
b553425d85 ci: replace docker.io ceph image with quay.io path
The ceph images are served from quay.io and this commit adjust
the docker pull to quay.io pull for centos jobs.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-30 09:11:37 +00:00
Humble Chirammal
c58b02ae52 ci: mirror ceph v17 container version in the centos repository
This update the devel branch mirroring from v16 to v17

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-25 05:14:57 +00:00
Humble Chirammal
f5aa4dae3d ci: replace the references of container images from docker.io to quay.io
The image list was referring `docker.io` images and this commit change
that to `quay.io` references.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-25 05:14:57 +00:00
Humble Chirammal
0bf13764a5 ci: add release 3.5 image details to the mirror image list
The release 3.5 image details were missing and this commit add the
same.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-25 05:14:57 +00:00