Koor Storage Distribution can be installed on any existing Kubernetes cluster as long as it meets the minimum version and Koor Storage Distribution is granted the required privileges (see below for more information).
Minimum Kubernetes Version¶
Kubernetes v1.17 or higher is supported for the Ceph operator.
Other Kubernetes-based distributions, such as OpenShift (OCP) and Rancher (RKE) are also supported.
Architectures released are
amd64 / x86_64 and
In order to configure the Ceph storage cluster, at least one of these local storage options are required:
- Raw devices (no partitions or formatted filesystems)
- Raw partitions (no formatted filesystem)
- PVs available from a storage class in
You can confirm whether your partitions or devices are formatted with filesystems with the following command.
FSTYPE field is not empty, there is a filesystem on top of the corresponding device. In this example, you can use
vdb for Ceph and can't use
vda or its partitions.
Enabling the Koor Storage Distribution admission controller is recommended to provide an additional level of validation that Koor Storage Distribution is configured correctly with the custom resource (CR) settings. An admission controller intercepts requests to the Kubernetes API server prior to persistence of the object, but after the request is authenticated and authorized.
To deploy the Koor Storage Distribution admission controllers, install the cert manager before Koor Storage Distribution is installed:
Ceph OSDs have a dependency on LVM in the following scenarios:
- OSDs are created on raw devices or partitions
- If encryption is enabled (
encryptedDevice: "true"in the cluster CR)
metadatadevice is specified
LVM is not required for OSDs in these scenarios:
- Creating OSDs on PVCs using the
If LVM is required for your scenario, LVM needs to be available on the hosts where OSDs will be running. Some Linux distributions do not ship with the
lvm2 package. This package is required on all storage nodes in your k8s cluster to run Ceph OSDs. Without this package even though Rook will be able to successfully create the Ceph OSDs, when a node is rebooted the OSD pods running on the restarted node will fail to start. Please install LVM using your Linux distribution's package manager. For example:
- Since version 1.5.0 LVM is supported
- Logical volumes will not be activated during the boot process. You need to add an runcmd command for that.
Ceph requires a Linux kernel built with the RBD module. Many Linux distributions have this module, but not all distributions. For example, the GKE Container-Optimised OS (COS) does not have RBD.
You can test your Kubernetes nodes by running
modprobe rbd. If it says 'not found', you may have to rebuild your kernel and include at least the
rbd module or choose a different Linux distribution.
If you will be creating volumes from a Ceph shared file system (CephFS), the recommended minimum kernel version is 4.17. If you have a kernel version less than 4.17, the requested PVC sizes will not be enforced. Storage quotas will only be enforced on newer kernels.