From 7f8c535c4211a4c885c9607b9f9c6350b57206c4 Mon Sep 17 00:00:00 2001 From: Madhu Rajanna Date: Wed, 18 Mar 2020 12:41:10 +0530 Subject: [PATCH] Update upgrade doc for node hang issue This PR updates the upgrade doc to handle the node drain issue what we have seen in https://github.com/ceph/ceph-csi/issues/756 Signed-off-by: Madhu Rajanna --- docs/ceph-csi-upgrade.md | 17 +++++++++++++++-- 1 file changed, 15 insertions(+), 2 deletions(-) diff --git a/docs/ceph-csi-upgrade.md b/docs/ceph-csi-upgrade.md index 2ff26ccbc..62c5726c2 100644 --- a/docs/ceph-csi-upgrade.md +++ b/docs/ceph-csi-upgrade.md @@ -19,6 +19,7 @@ - [4.1 Update the RBD Nodeplugin RBAC](#41-update-the-rbd-nodeplugin-rbac) - [4.2 Update the RBD Nodeplugin daemonset](#42-update-the-rbd-nodeplugin-daemonset) - [4.3 Manual deletion of RBD Nodeplugin daemonset pods](#43-manual-deletion-of-rbd-nodeplugin-daemonset-pods) + - [Handling node reboot hangs due to existing network mounts](#handling-node-reboot-hangs-due-to-existing-network-mounts) ## Pre-upgrade considerations @@ -185,7 +186,7 @@ For each node: - The pod deletion causes the pods to be restarted and updated automatically on the node. -we have successfully upgrade cephfs csi from v1.2.2 to v2.0.0 +we have successfully upgraded cephfs csi from v1.2.2 to v2.0.0 ### Upgrading RBD @@ -303,4 +304,16 @@ For each node: - The pod deletion causes the pods to be restarted and updated automatically on the node. -we have successfully upgrade RBD csi from v1.2.2 to v2.0.0 +we have successfully upgraded RBD csi from v1.2.2 to v2.0.0 + +### Handling node reboot hangs due to existing network mounts + +With prior versions of ceph-csi a node reboot may hang the reboot process. This +is due to existing cephfs or rbd network mounts not carrying the `_netdev` +mount option. The missing mount option is fixed, and future mounts using +ceph-csi would automatically carry the required flags needed for a clean +reboot. + +It is suggested to upgrade to the latest ceph-csi release and drain application +pods on all the nodes so that new mount option `_netdev` can be added to all +the mountpoints.