Commit Graph

292 Commits

Author SHA1 Message Date
Madhu Rajanna
8cabc0327f ci: run upgrade tests with latest release
Run E2E tests with latest available release.

fixes: #2818

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-26 10:18:14 +00:00
Madhu Rajanna
c1255f809b ci: disable e2e tests by default in CI
Disable e2e tests by default in CI to
save resources. cephcsi maintainers or
contributors can add the ok-to-test label
to trigger the e2e tests.

depends on #3468

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-26 04:43:41 +00:00
Madhu Rajanna
d6b721b7a8 ci: use rook v1.10.4 in CI
update Rook image version to
v1.10.4 which is latest release

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-24 08:48:07 +00:00
Niels de Vos
83369a36f1 ci: install wget for downloading Helm
Installing Helm fails if `wget` is not available. The script that
installs Helm does not seem to abort though.

By installing `wget` in preparation for deploying with Helm, the CI jobs
should get ready to run successfully.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-10-13 06:26:56 +00:00
Niels de Vos
cf85580c16 ci: include journalctl --boot from the host in system status
Now that we run with Podman, the journal from the container that was
started by minikube is not very useful. In addition to the journal from
the minikube container or VM, include the journal from the host.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-10-12 16:36:15 +00:00
Niels de Vos
fce1892115 ci: copy images into minikube container when VM_DRIVER=podman
Even when minikube is running with `--driver=podman`, `minikube ssh`
works and container images can be copied into the minikube container.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-10-12 10:14:49 +00:00
Niels de Vos
893da82f71 ci: use VM_DRIVER=podman for AWS virtual-machines
With the CentOS CI machines moving to AWS EC2 virtual-machines, there is
no option to run minikube with a VM anymore. Instead, run minikube with
the Podman driver and partition the extra xvdb EBS volume into three
pieces.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-10-10 07:18:28 +00:00
Madhu Rajanna
7681ef27ff ci: update rook image in centos ci
update rook image to latest release
in ci

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-10-07 16:11:37 +00:00
Niels de Vos
a55c539f2a ci: run k8s v1.26 jobs on request
Kubernetes 1.26 has reached Alpha state, so the project can now be used
to run CI jobs against.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-09-22 04:50:27 +00:00
Madhu Rajanna
c53f63e7ac ci: mirror Rook v1.10.0 image
Rook v1.10.0 is required for ceph
cluster deployment on kubernetes 1.25
because older version of Rook still comes
with PSP templates which is removed in
Kubernetes 1.25

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-09-06 07:51:54 +00:00
Madhu Rajanna
f7782eeac2 ci: run e2e on kubernetes 1.25
Deploy kubernetes 1.25 and run e2e
tests on it on demand.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-09-05 15:22:49 +00:00
Marcel Lauhoff
1def8d8a1a ci: Set MINIKUBE_ISO_URL on minikube.sh up call
Signed-off-by: Marcel Lauhoff <marcel.lauhoff@suse.com>
2022-08-30 03:45:32 +00:00
Madhu Rajanna
ef31cd110f ci: update rook verion to v1.9.8
updating rook release version to latest
release i.e v1.9.8

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-08-05 06:55:18 +00:00
Niels de Vos
4ef7ece894 ci: use latest :v17 Ceph contaimer-image again
A new Ceph container-image has been released. This should address the
Ceph Mgr issue that was present in :v17.2.2.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-08-01 08:21:43 +00:00
Niels de Vos
dff758bd29 ci: mirror the ceph/ceph:v17.2.1 image as ceph/ceph:v17
The v17.2.2 image from last week causes segfaults in Ceph Mgr. Mirror
the :v17.2.1 image as :v17 instead of the latest.

Updates: #3259
Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-07-25 16:02:15 +00:00
Madhu Rajanna
8bb8a12928 ci: remove Kubernetes 1.21 from CI
We will run CI on 3 latest kubernetes
releases removing Kubernetes 1.21 support
as we have Kubernetes 1.22, 1.23 and 1.24 for
CI Jobs.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-07-25 07:32:51 +00:00
Madhu Rajanna
35007a76d3 ci: run e2e on Kubernetes v1.24 by default
As we have stable CI for kubernetes v1.24 and
Kubernetes v1.24 released sometime back, defaulting
Kubernetes v1.24 for the CI run.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-07-25 07:32:51 +00:00
Madhu Rajanna
8ae18c3809 ci: add rook v1.9.4 image to mirror
Add rook v1.9.4 image to mirror list
to use the image for e2e testing.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-06-01 11:04:12 +00:00
Madhu Rajanna
dd53b13a9b ci: collect kubelet status
collect kubelet status as part
of the system-status which helps
in debugging.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-05-06 06:49:58 +00:00
Madhu Rajanna
100d53d595 cleanup: add unwanted files to gitignore
This is the exact copy of the gitignore
from the devel branch to ignore files from
the git.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-05-05 09:44:57 +00:00
Madhu Rajanna
a0eccf47b4 ci: run tests on kubernetes 1.24
This commits adds the kuberenetes
1.24 to run on request for now.

Note:- Once the kubernetes 1.24 job is stable
will run it by default

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-05-05 09:44:57 +00:00
Humble Chirammal
9758f45614 ci: correct prefix path for centos mirroring repository
as a solution to the image referencing issue, we are prefixing
the string `quay.io` as a tag in mirror image list.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-31 09:37:44 +00:00
Humble Chirammal
b553425d85 ci: replace docker.io ceph image with quay.io path
The ceph images are served from quay.io and this commit adjust
the docker pull to quay.io pull for centos jobs.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-30 09:11:37 +00:00
Humble Chirammal
c58b02ae52 ci: mirror ceph v17 container version in the centos repository
This update the devel branch mirroring from v16 to v17

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-25 05:14:57 +00:00
Humble Chirammal
f5aa4dae3d ci: replace the references of container images from docker.io to quay.io
The image list was referring `docker.io` images and this commit change
that to `quay.io` references.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-25 05:14:57 +00:00
Humble Chirammal
0bf13764a5 ci: add release 3.5 image details to the mirror image list
The release 3.5 image details were missing and this commit add the
same.

Signed-off-by: Humble Chirammal <hchiramm@redhat.com>
2022-03-25 05:14:57 +00:00
Niels de Vos
1101ec0c8d ci: add GOARCH to path for copying kubectl
minikube 1.25.2 moved the downloaded kubectl and other binaries to a new
subdir; it now includes runtime.GOARCH as an extra component.

See-also: kubernetes/minikube#13539
Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-03-16 11:24:14 +00:00
Niels de Vos
ed95c4aa78 ci: use CentOS Stream 8 for infra containers
The container images for Jenkins Job Builder and mirroring images were
still using the EOL CentOS 8 base image. Rebuilding those
container-images fails as the CentOS mirrors do not provide the
repositories for installing package anymore.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-02-04 03:12:34 +00:00
Niels de Vos
fe922b8805 ci: pass GOARCH when building images in OpenShift
It seems that regular jobs in the OpenShift environment fail with the
following error:

    Missing GOARCH argument for building image, install Golang or run: make containerized-test GOARCH=amd64

This happens for both the `devel` and `test` image builds since December
13 when installing Golang in the container-images was added.

Fixes: 8a3fe53e "ci: install arch specific go in Dockerfile.devel"
Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-02-03 10:26:34 +00:00
Niels de Vos
50ac270360 ci: request CentOS Stream 8 bare-metal machines
CentOS 8 is EOL since the beginning of the year. CentOS Stream 8
installations should be used instead.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2022-02-02 12:41:11 +00:00
Madhu Rajanna
464759feef ci: update rook image to mirror
updated rook image tag to mirror
latest version to internal registry.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2022-01-21 10:29:12 +00:00
Madhu Rajanna
b22fe5f059 ci: remove kubernetes 1.20 from CI
removing kubernetes test run with 1.20
as with  #2705 we dont need 1.20 CI
results to merge a PR and we have kube 1.23
latest release.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-12-13 04:46:06 +00:00
Madhu Rajanna
31d037eb95 ci: run tests on kubernetes 1.23 by default
The e2e tests are running fine on kubernetes
1.23. This commit runs the tests on kubernetes
1.23 by default.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-12-10 06:58:46 +00:00
Madhu Rajanna
d351e00992 ci: run tests on kubernetes 1.23
This commits removes the older version (1.19
and 1.20) from testing and adds the kuberenetes
1.23 to run on request for now.

Note:- Once the kubernetes 1.23 job is stable
will run it by default

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-12-09 09:06:18 +00:00
Yug Gupta
904a352257 ci: deploy erasure coded pool
deploy erasure coded pool while deploying
rook ceph cluster in the CI.

Signed-off-by: Yug Gupta <yuggupta27@gmail.com>
2021-11-25 09:54:22 +00:00
Rakshith R
8cf5619da3 ci: use refs/pull/<id>/merge in k8s external storage tests too
This change was missed in
https://github.com/ceph/ceph-csi/pull/1617.

Signed-off-by: Rakshith R <rar@redhat.com>
2021-11-22 09:13:09 +00:00
Madhu Rajanna
92c8f723f9 ci: use official CentOS container location
registry.centos.org is not officially
maintained by the CentOS infrastructure
team. The container images on quay.io are
the official once and we should use
those instead.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-11-19 07:51:31 +00:00
Madhu Rajanna
a07fb3bcfc ci: update images for vault 1.8.5
updating ci scripts to pull the
vault images from ci registry.

Signed-off-by: Madhu Rajanna <madhupr007@gmail.com>
2021-11-19 07:12:54 +00:00
Niels de Vos
e122cff477 e2e: do not delete the namespace and contents after a failure
When a failure occurs, by default the test namespace is removed. This
makes it impossible to fetch the logs of the containers where the
failure was discovered. Pass --delete-namespace-on-failure=false as an
additional argument to the `run-e2e` make target, so that the namespace
is kept.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2021-10-18 14:48:23 +00:00
Niels de Vos
83e483bb8d ci: automatically run k8s-e2e-external-storage/1.22 job
The job is currently stable and passes usually. It can now be used for
validation.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2021-09-29 07:13:16 +00:00
Rakshith R
b2300b0835 ci: use internal minikube extra disks functionality
Minikube from v1.23.0 supports adding extra disks in
kvm2 and hyperkit VM drivers. This commit makes use of
that functionality and removes steps to attack disks
externally.

Signed-off-by: Rakshith R <rar@redhat.com>
2021-09-14 05:28:42 +00:00
Niels de Vos
ca4ec105c2 ci: use pre-pulled image for building e2e.test
The 'mini-e2e' job uses the pre-pulled container image for building the
e2e.test executable. The building of the executable takes less than 2
minutes, while building with preparing the container image takes close
to 5 minutes.

This reduces consumption of network bandwith, and might speed up other
parallel builds.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2021-08-19 09:33:35 +00:00
Prasanna Kumar Kalever
a373882099 ci: dump the rbd-nbd logs
print the rbd-nbd logs from the VM location /var/log/ceph/

Signed-off-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
2021-08-18 15:20:32 +00:00
Rakshith R
2f24c7f47d ci: use csi sidecar image versions from build.env if available
This commit makes changes necessary to use csi sidecar image versions
from build.env if available.

PR https://github.com/ceph/ceph-csi/pull/2217 adds these
variables to `build.env`.

Signed-off-by: Rakshith R <rar@redhat.com>
2021-08-16 11:17:26 +00:00
Yug Gupta
2be0306c82 ci: run tests on k8s v1.22 in place of v1.19
As kubernetes v1.19 is heading towards its EOL
on 2021-09-30, run tests on kubernetes v1.22
and require it to pass for merging.

Signed-off-by: Yug Gupta <yuggupta27@gmail.com>
2021-08-12 11:32:43 +00:00
Rakshith R
935b261be1 ci: remove create & delete namespace commands from helm jobs
Since this will be done internally by intall_helm.sh script
with kubectl_retry.

Fixes: #2309
Depends-on: #2377

Signed-off-by: Rakshith R <rar@redhat.com>
2021-08-12 04:17:29 +00:00
Rakshith R
70c6414e1e ci: add --ignore-not-found=true to delete namespace in helm cleanup
This commit is added to facilitate merging of
https://github.com/ceph/ceph-csi/pull/2377 into devel and release
branches.

https://github.com/ceph/ceph-csi/pull/2378 will remove create &
delete namespace cmds from helm e2e jobs later on.

Signed-off-by: Rakshith R <rar@redhat.com>
2021-08-11 06:10:46 +00:00
Rakshith R
e6c04e1414 ci: set ttlSecondsAfterFinished=10 to ensure job status can be checked
Signed-off-by: Rakshith R <rar@redhat.com>
2021-08-09 14:47:18 +00:00
Rakshith R
6255ec9a7a ci: update Template yamls apiVersion to template.openshift.io/v1
This was updated to prevent the following error.
Using non-groupfied API resources is deprecated and will be removed in a
future release, update apiVersion to "template.openshift.io/v1" for your
resource.

Signed-off-by: Rakshith R <rar@redhat.com>
2021-08-09 14:47:18 +00:00
Niels de Vos
c90023ad5d ci: add the root user to the libvirt group
When starting a minikube VM, there are always warning messages like
this:

    X libvirt group membership check failed:
    user is not a member of the appropriate libvirt group

The CI jobs run as root, so minikube works just fine. By adding the root
user to the libvirt group, the warning is hopefully removed.

Note that the libvirt group may not exist yet, as the packages will get
installed in a later stage. This change also adds a check to create the
libvirt group in case it is missing.

Signed-off-by: Niels de Vos <ndevos@redhat.com>
2021-07-16 09:59:45 +00:00