2019-04-25 19:12:36 +00:00
|
|
|
# Ceph CSI
|
2018-01-20 20:04:38 +00:00
|
|
|
|
2021-08-19 10:32:48 +00:00
|
|
|
[](https://github.com/ceph/ceph-csi/releases)
|
2019-04-04 06:49:06 +00:00
|
|
|
[](https://goreportcard.com/report/github.com/ceph/ceph-csi)
|
2021-08-19 08:44:34 +00:00
|
|
|
[](https://www.tickgit.com/browse?repo=github.com/ceph/ceph-csi&branch=devel)
|
2019-04-04 06:49:06 +00:00
|
|
|
|
2019-07-30 14:20:22 +00:00
|
|
|
- [Ceph CSI](#ceph-csi)
|
|
|
|
|
- [Overview](#overview)
|
|
|
|
|
- [Project status](#project-status)
|
2021-09-02 06:02:51 +00:00
|
|
|
- [Known to work CO platforms](#known-to-work-co-platforms)
|
2019-07-30 14:20:22 +00:00
|
|
|
- [Support Matrix](#support-matrix)
|
|
|
|
|
- [Ceph-CSI features and available versions](#ceph-csi-features-and-available-versions)
|
|
|
|
|
- [CSI spec and Kubernetes version compatibility](#csi-spec-and-kubernetes-version-compatibility)
|
2019-08-14 05:00:15 +00:00
|
|
|
- [Ceph CSI Container images and release compatibility](#ceph-csi-container-images-and-release-compatibility)
|
2019-07-30 14:20:22 +00:00
|
|
|
- [Contributing to this repo](#contributing-to-this-repo)
|
|
|
|
|
- [Troubleshooting](#troubleshooting)
|
|
|
|
|
- [Weekly Bug Triage call](#weekly-bug-triage-call)
|
2020-04-28 10:18:47 +00:00
|
|
|
- [Dev standup](#dev-standup)
|
2019-07-30 14:20:22 +00:00
|
|
|
- [Contact](#contact)
|
2019-07-12 07:32:44 +00:00
|
|
|
|
2019-07-22 14:38:43 +00:00
|
|
|
This repo contains Ceph
|
2019-07-22 21:50:36 +00:00
|
|
|
[Container Storage Interface (CSI)](https://github.com/container-storage-interface/)
|
|
|
|
|
driver for RBD, CephFS and kubernetes sidecar deployment yamls of provisioner,
|
2020-06-10 09:59:24 +00:00
|
|
|
attacher, resizer, driver-registrar and snapshotter for supporting CSI functionalities.
|
2018-02-06 18:30:05 +00:00
|
|
|
|
2018-07-31 09:31:12 +00:00
|
|
|
## Overview
|
2018-03-26 13:02:34 +00:00
|
|
|
|
2019-04-25 19:12:36 +00:00
|
|
|
Ceph CSI plugins implement an interface between CSI enabled Container Orchestrator
|
|
|
|
|
(CO) and Ceph cluster. It allows dynamically provisioning Ceph volumes and
|
|
|
|
|
attaching them to workloads.
|
2018-03-26 13:02:34 +00:00
|
|
|
|
2019-04-25 19:12:36 +00:00
|
|
|
Independent CSI plugins are provided to support RBD and CephFS backed volumes,
|
2018-03-26 13:02:34 +00:00
|
|
|
|
2019-06-10 08:37:24 +00:00
|
|
|
- For details about configuration and deployment of RBD plugin, please refer
|
2021-02-25 08:19:23 +00:00
|
|
|
[rbd doc](https://github.com/ceph/ceph-csi/blob/devel/docs/deploy-rbd.md) and
|
2019-06-10 08:37:24 +00:00
|
|
|
for CephFS plugin configuration and deployment please
|
2021-09-20 10:16:55 +00:00
|
|
|
refer [cephFS doc](https://github.com/ceph/ceph-csi/blob/devel/docs/deploy-cephfs.md).
|
2019-04-25 19:12:36 +00:00
|
|
|
- For example usage of RBD and CephFS CSI plugins, see examples in `examples/`.
|
2020-04-03 07:10:29 +00:00
|
|
|
- Stale resource cleanup, please refer [cleanup doc](docs/resource-cleanup.md).
|
2019-04-25 19:12:36 +00:00
|
|
|
|
2019-11-07 09:55:12 +00:00
|
|
|
NOTE:
|
|
|
|
|
|
|
|
|
|
- Ceph CSI **`Arm64`** support is experimental.
|
|
|
|
|
|
2019-04-25 19:12:36 +00:00
|
|
|
## Project status
|
|
|
|
|
|
2019-07-12 07:32:44 +00:00
|
|
|
Status: **GA**
|
2019-04-25 19:12:36 +00:00
|
|
|
|
2021-09-02 06:02:51 +00:00
|
|
|
## Known to work CO platforms
|
2019-04-25 19:12:36 +00:00
|
|
|
|
|
|
|
|
Ceph CSI drivers are currently developed and tested **exclusively** on Kubernetes
|
2021-09-02 06:02:51 +00:00
|
|
|
environments.
|
|
|
|
|
|
|
|
|
|
| Ceph CSI Version | Container Orchestrator Name | Version Tested|
|
|
|
|
|
| -----------------| --------------------------- | --------------|
|
2022-01-21 17:25:06 +00:00
|
|
|
| v3.5.1 | Kubernetes | v1.21, v1.22, v1.23|
|
2022-01-13 11:46:56 +00:00
|
|
|
| v3.5.0 | Kubernetes | v1.21, v1.22, v1.23|
|
2021-09-02 06:02:51 +00:00
|
|
|
| v3.4.0 | Kubernetes | v1.20, v1.21, v1.22|
|
|
|
|
|
|
|
|
|
|
There is work in progress to make this CO independent and thus
|
|
|
|
|
support other orchestration environments (Nomad, Mesos..etc) in the future.
|
2019-04-25 19:12:36 +00:00
|
|
|
|
2019-07-12 07:32:44 +00:00
|
|
|
NOTE:
|
2019-04-25 19:12:36 +00:00
|
|
|
|
2021-08-25 09:37:49 +00:00
|
|
|
The supported window of Ceph CSI versions is known as "N.(x-1)":
|
|
|
|
|
(N (Latest major release) . (x (Latest minor release) - 1)).
|
|
|
|
|
|
2022-01-13 11:46:56 +00:00
|
|
|
For example, if Ceph CSI latest major version is `3.5.0` today, support is
|
|
|
|
|
provided for the versions above `3.4.0`. If users are running an unsupported
|
2021-08-25 09:37:49 +00:00
|
|
|
Ceph CSI version, they will be asked to upgrade when requesting support for the
|
|
|
|
|
cluster.
|
2018-01-20 20:04:38 +00:00
|
|
|
|
2019-05-08 08:18:53 +00:00
|
|
|
## Support Matrix
|
|
|
|
|
|
|
|
|
|
### Ceph-CSI features and available versions
|
|
|
|
|
|
2021-07-12 07:42:42 +00:00
|
|
|
Please refer [rbd nbd mounter](./docs/rbd-nbd.md#support-matrix)
|
|
|
|
|
for its support details.
|
|
|
|
|
|
2020-07-23 06:34:20 +00:00
|
|
|
| Plugin | Features | Feature Status | CSI Driver Version | CSI Spec Version | Ceph Cluster Version | Kubernetes Version |
|
|
|
|
|
| ------ | --------------------------------------------------------- | -------------- | ------------------ | ---------------- | -------------------- | ------------------ |
|
|
|
|
|
| RBD | Dynamically provision, de-provision Block mode RWO volume | GA | >= v1.0.0 | >= v1.0.0 | Nautilus (>=14.0.0) | >= v1.14.0 |
|
|
|
|
|
| | Dynamically provision, de-provision Block mode RWX volume | GA | >= v1.0.0 | >= v1.0.0 | Nautilus (>=14.0.0) | >= v1.14.0 |
|
2021-12-23 08:56:15 +00:00
|
|
|
| | Dynamically provision, de-provision Block mode RWOP volume| Alpha | >= v3.5.0 | >= v1.5.0 | Nautilus (>=14.0.0) | >= v1.22.0 |
|
2020-07-23 06:34:20 +00:00
|
|
|
| | Dynamically provision, de-provision File mode RWO volume | GA | >= v1.0.0 | >= v1.0.0 | Nautilus (>=14.0.0) | >= v1.14.0 |
|
2021-12-23 08:56:15 +00:00
|
|
|
| | Dynamically provision, de-provision File mode RWOP volume | Alpha | >= v3.5.0 | >= v1.5.0 | Nautilus (>=14.0.0) | >= v1.22.0 |
|
2020-09-09 07:35:39 +00:00
|
|
|
| | Provision File Mode ROX volume from snapshot | Alpha | >= v3.0.0 | >= v1.0.0 | Nautilus (>=v14.2.2) | >= v1.17.0 |
|
|
|
|
|
| | Provision File Mode ROX volume from another volume | Alpha | >= v3.0.0 | >= v1.0.0 | Nautilus (>=v14.2.2) | >= v1.16.0 |
|
|
|
|
|
| | Provision Block Mode ROX volume from snapshot | Alpha | >= v3.0.0 | >= v1.0.0 | Nautilus (>=v14.2.2) | >= v1.17.0 |
|
|
|
|
|
| | Provision Block Mode ROX volume from another volume | Alpha | >= v3.0.0 | >= v1.0.0 | Nautilus (>=v14.2.2) | >= v1.16.0 |
|
2022-01-18 08:24:54 +00:00
|
|
|
| | Creating and deleting snapshot | GA | >= v1.0.0 | >= v1.0.0 | Nautilus (>=14.0.0) | >= v1.17.0 |
|
|
|
|
|
| | Provision volume from snapshot | GA | >= v1.0.0 | >= v1.0.0 | Nautilus (>=14.0.0) | >= v1.17.0 |
|
|
|
|
|
| | Provision volume from another volume | GA | >= v1.0.0 | >= v1.0.0 | Nautilus (>=14.0.0) | >= v1.16.0 |
|
2020-07-23 06:34:20 +00:00
|
|
|
| | Expand volume | Beta | >= v2.0.0 | >= v1.1.0 | Nautilus (>=14.0.0) | >= v1.15.0 |
|
2022-01-18 08:24:54 +00:00
|
|
|
| | Volume/PV Metrics of File Mode Volume | GA | >= v1.2.0 | >= v1.1.0 | Nautilus (>=14.0.0) | >= v1.15.0 |
|
|
|
|
|
| | Volume/PV Metrics of Block Mode Volume | GA | >= v1.2.0 | >= v1.1.0 | Nautilus (>=14.0.0) | >= v1.21.0 |
|
2020-07-23 06:34:20 +00:00
|
|
|
| | Topology Aware Provisioning Support | Alpha | >= v2.1.0 | >= v1.1.0 | Nautilus (>=14.0.0) | >= v1.14.0 |
|
2022-01-18 08:24:54 +00:00
|
|
|
| CephFS | Dynamically provision, de-provision File mode RWO volume | GA | >= v1.1.0 | >= v1.0.0 | Nautilus (>=14.2.2) | >= v1.14.0 |
|
|
|
|
|
| | Dynamically provision, de-provision File mode RWX volume | GA | >= v1.1.0 | >= v1.0.0 | Nautilus (>=v14.2.2) | >= v1.14.0 |
|
2020-07-23 06:34:20 +00:00
|
|
|
| | Dynamically provision, de-provision File mode ROX volume | Alpha | >= v3.0.0 | >= v1.0.0 | Nautilus (>=v14.2.2) | >= v1.14.0 |
|
2021-12-23 08:56:15 +00:00
|
|
|
| | Dynamically provision, de-provision File mode RWOP volume | Alpha | >= v3.5.0 | >= v1.5.0 | Nautilus (>=14.0.0) | >= v1.22.0 |
|
2022-01-18 08:24:54 +00:00
|
|
|
| | Creating and deleting snapshot | GA | >= v3.1.0 | >= v1.0.0 | Octopus (>=v15.2.4) | >= v1.17.0 |
|
|
|
|
|
| | Provision volume from snapshot | GA | >= v3.1.0 | >= v1.0.0 | Octopus (>=v15.2.4) | >= v1.17.0 |
|
|
|
|
|
| | Provision volume from another volume | GA | >= v3.1.0 | >= v1.0.0 | Octopus (>=v15.2.4) | >= v1.16.0 |
|
2020-07-23 06:34:20 +00:00
|
|
|
| | Expand volume | Beta | >= v2.0.0 | >= v1.1.0 | Nautilus (>=v14.2.2) | >= v1.15.0 |
|
2022-01-18 08:24:54 +00:00
|
|
|
| | Volume/PV Metrics of File Mode Volume | GA | >= v1.2.0 | >= v1.1.0 | Nautilus (>=v14.2.2) | >= v1.15.0 |
|
2022-03-31 12:51:36 +00:00
|
|
|
| NFS | Dynamically provision, de-provision File mode RWO volume | Alpha | >= v3.6.0 | >= v1.0.0 | Pacific (>=16.2.0) | >= v1.14.0 |
|
|
|
|
|
| | Dynamically provision, de-provision File mode RWX volume | Alpha | >= v3.6.0 | >= v1.0.0 | Pacific (>=16.2.0) | >= v1.14.0 |
|
|
|
|
|
| | Dynamically provision, de-provision File mode ROX volume | Alpha | >= v3.6.0 | >= v1.0.0 | Pacific (>=16.2.0) | >= v1.14.0 |
|
|
|
|
|
| | Dynamically provision, de-provision File mode RWOP volume | Alpha | >= v3.6.0 | >= v1.5.0 | Pacific (>=16.2.0) | >= v1.22.0 |
|
2019-07-12 07:32:44 +00:00
|
|
|
|
|
|
|
|
`NOTE`: The `Alpha` status reflects possible non-backward
|
|
|
|
|
compatible changes in the future, and is thus not recommended
|
|
|
|
|
for production use.
|
2019-05-08 08:18:53 +00:00
|
|
|
|
|
|
|
|
### CSI spec and Kubernetes version compatibility
|
|
|
|
|
|
|
|
|
|
Please refer to the [matrix](https://kubernetes-csi.github.io/docs/#kubernetes-releases)
|
|
|
|
|
in the Kubernetes documentation.
|
|
|
|
|
|
2019-08-14 05:00:15 +00:00
|
|
|
## Ceph CSI Container images and release compatibility
|
|
|
|
|
|
|
|
|
|
| Ceph CSI Release/Branch | Container image name | Image Tag |
|
2019-09-10 11:04:35 +00:00
|
|
|
| ----------------------- | ---------------------------- | --------- |
|
2021-04-16 05:37:03 +00:00
|
|
|
| devel (Branch) | quay.io/cephcsi/cephcsi | canary |
|
2022-01-21 17:25:06 +00:00
|
|
|
| v3.5.1 (Release) | quay.io/cephcsi/cephcsi | v3.5.1 |
|
2022-01-13 11:46:56 +00:00
|
|
|
| v3.5.0 (Release) | quay.io/cephcsi/cephcsi | v3.5.0 |
|
2021-08-17 05:33:11 +00:00
|
|
|
| v3.4.0 (Release) | quay.io/cephcsi/cephcsi | v3.4.0 |
|
2021-08-25 09:37:49 +00:00
|
|
|
|
|
|
|
|
| Deprecated Ceph CSI Release/Branch | Container image name | Image Tag |
|
|
|
|
|
| ----------------------- | --------------------------------| --------- |
|
2022-01-17 05:00:08 +00:00
|
|
|
| v3.3.1 (Release) | quay.io/cephcsi/cephcsi | v3.3.1 |
|
|
|
|
|
| v3.3.0 (Release) | quay.io/cephcsi/cephcsi | v3.3.0 |
|
2021-08-25 09:37:49 +00:00
|
|
|
| v3.2.2 (Release) | quay.io/cephcsi/cephcsi | v3.2.2 |
|
|
|
|
|
| v3.2.1 (Release) | quay.io/cephcsi/cephcsi | v3.2.1 |
|
|
|
|
|
| v3.2.0 (Release) | quay.io/cephcsi/cephcsi | v3.2.0 |
|
|
|
|
|
| v3.1.2 (Release) | quay.io/cephcsi/cephcsi | v3.1.2 |
|
|
|
|
|
| v3.1.1 (Release) | quay.io/cephcsi/cephcsi | v3.1.1 |
|
|
|
|
|
| v3.1.0 (Release) | quay.io/cephcsi/cephcsi | v3.1.0 |
|
|
|
|
|
| v3.0.0 (Release) | quay.io/cephcsi/cephcsi | v3.0.0 |
|
|
|
|
|
| v2.1.2 (Release) | quay.io/cephcsi/cephcsi | v2.1.2 |
|
|
|
|
|
| v2.1.1 (Release) | quay.io/cephcsi/cephcsi | v2.1.1 |
|
|
|
|
|
| v2.1.0 (Release) | quay.io/cephcsi/cephcsi | v2.1.0 |
|
|
|
|
|
| v2.0.1 (Release) | quay.io/cephcsi/cephcsi | v2.0.1 |
|
|
|
|
|
| v2.0.0 (Release) | quay.io/cephcsi/cephcsi | v2.0.0 |
|
|
|
|
|
| v1.2.2 (Release) | quay.io/cephcsi/cephcsi | v1.2.2 |
|
|
|
|
|
| v1.2.1 (Release) | quay.io/cephcsi/cephcsi | v1.2.1 |
|
|
|
|
|
| v1.2.0 (Release) | quay.io/cephcsi/cephcsi | v1.2.0 |
|
|
|
|
|
| v1.1.0 (Release) | quay.io/cephcsi/cephcsi | v1.1.0 |
|
|
|
|
|
| v1.0.0 (Branch) | quay.io/cephcsi/cephfsplugin | v1.0.0 |
|
|
|
|
|
| v1.0.0 (Branch) | quay.io/cephcsi/rbdplugin | v1.0.0 |
|
2019-08-14 05:00:15 +00:00
|
|
|
|
2019-04-04 06:43:48 +00:00
|
|
|
## Contributing to this repo
|
|
|
|
|
|
2021-02-25 08:19:23 +00:00
|
|
|
Please follow [development-guide](<https://github.com/ceph/ceph-csi/tree/devel/docs/development-guide.md>)
|
|
|
|
|
and [coding style guidelines](<https://github.com/ceph/ceph-csi/tree/devel/docs/coding.md>)
|
2019-04-04 06:43:48 +00:00
|
|
|
if you are interested to contribute to this repo.
|
|
|
|
|
|
2018-01-20 20:04:38 +00:00
|
|
|
## Troubleshooting
|
|
|
|
|
|
2018-07-31 09:31:12 +00:00
|
|
|
Please submit an issue at: [Issues](https://github.com/ceph/ceph-csi/issues)
|
2019-02-11 14:07:22 +00:00
|
|
|
|
2019-07-25 12:45:07 +00:00
|
|
|
## Weekly Bug Triage call
|
|
|
|
|
|
|
|
|
|
We conduct weekly bug triage calls at our slack channel on Tuesdays.
|
|
|
|
|
More details are available [here](https://github.com/ceph/ceph-csi/issues/463)
|
|
|
|
|
|
2020-04-28 10:18:47 +00:00
|
|
|
## Dev standup
|
|
|
|
|
|
2021-09-30 12:30:47 +00:00
|
|
|
A regular dev standup takes place every [Monday,Tuesday and Thursday at
|
|
|
|
|
12:00 PM UTC](https://meet.google.com/nnn-txfp-cge). Convert to your local
|
2021-04-07 12:30:15 +00:00
|
|
|
timezone by executing command `date -d "12:00 UTC"` on terminal
|
2020-04-28 10:18:47 +00:00
|
|
|
|
|
|
|
|
Any changes to the meeting schedule will be added to the [agenda
|
|
|
|
|
doc](https://docs.google.com/document/d/1K1aerdMpraIh56-skdoEoVF9RZrO4NUcbHtjN-f3u1s).
|
|
|
|
|
|
|
|
|
|
Anyone who wants to discuss the direction of the project, design and
|
|
|
|
|
implementation reviews, or general questions with the broader community is
|
|
|
|
|
welcome and encouraged to join.
|
|
|
|
|
|
2021-09-30 12:30:47 +00:00
|
|
|
- Meeting link: <https://meet.google.com/nnn-txfp-cge>
|
2020-04-28 10:18:47 +00:00
|
|
|
- [Current agenda](https://docs.google.com/document/d/1K1aerdMpraIh56-skdoEoVF9RZrO4NUcbHtjN-f3u1s)
|
|
|
|
|
|
2019-05-28 07:13:10 +00:00
|
|
|
## Contact
|
2019-02-11 14:07:22 +00:00
|
|
|
|
2019-05-28 07:13:10 +00:00
|
|
|
Please use the following to reach members of the community:
|
|
|
|
|
|
2019-07-16 13:32:46 +00:00
|
|
|
- Slack: Join our [slack channel](https://cephcsi.slack.com) to discuss
|
2021-08-17 05:33:11 +00:00
|
|
|
anything related to this project. You can join the slack by
|
2019-07-25 11:38:00 +00:00
|
|
|
this [invite link](https://bit.ly/2MeS4KY )
|
2019-05-28 07:13:10 +00:00
|
|
|
- Forums: [ceph-csi](https://groups.google.com/forum/#!forum/ceph-csi)
|
|
|
|
|
- Twitter: [@CephCsi](https://twitter.com/CephCsi)
|
