Red Hat OpenShift Container Platform and OKD

To deploy SUSE Storage on a cluster provisioned with OpenShift 4.x, some additional configurations are required.

OKD currently does not support the ARM platform. For more information, see the OKD website and GitHub issue #1165 (OKD in ARM platform).

Installation

Install With Helm

Please refer to this section Install with Helm first.

And then install SUSE Storage with setting openshift.enabled true:

  helm install longhorn longhorn/longhorn --namespace longhorn-system --create-namespace --set openshift.enabled=true

Install With `oc` Command

You can install SUSE Storage on OKD clusters using the following command:

    oc apply -f https://raw.githubusercontent.com/longhorn/longhorn/v1.7.0/deploy/longhorn-okd.yaml

One way to monitor the progress of the installation is to watch pods being created in the longhorn-system namespace:

    oc get pods \
    --namespace longhorn-system \
    --watch

For more information, see Install with Kubectl.

Prepare A Customized Default Disk (Optional)

To understand more about configuring the disks for SUSE Storage, please refer to the section Configuring Defaults for Nodes and Disks

SUSE Storage will use the directory /var/lib/longhorn as default storage mount point and that means SUSE Storage uses the root device as the default storage. If you don’t want to use the root device as the SUSE Storage storage, set defaultSettings.createDefaultDiskLabeledNodes true when installing SUSE Storage using Helm:

--set defaultSettings.createDefaultDiskLabeledNodes=true

And then add another device formatted for SUSE Storage

Add An Extra Disk for SUSE Storage

Create Filesystem For The Device

Create the filesystem on the device with the label longhorn on the storage node. Get into the node by oc command:

oc get nodes --no-headers | awk '{print $1}'
oc debug node/${NODE_NAME} -t -- chroot /host bash

Check if the device is present and format it with SUSE Storage label:

lsblk
sudo mkfs.ext4 -L longhorn /dev/${DEVICE_NAME}

Mounting The Device On Boot with MachineConfig CRD

The secondary drive needs to be mounted automatically when node boots up by the MachineConfig that can be created and deployed by:

cat <<EOF >>auto-mount-machineconfig.yaml
apiVersion: machineconfiguration.openshift.io/v1
kind: MachineConfig
metadata:
  labels:
    machineconfiguration.openshift.io/role: worker
  name: 71-mount-storage-worker
spec:
  config:
    ignition:
      version: 3.2.0
    systemd:
      units:
        - name: var-mnt-longhorn.mount
          enabled: true
          contents: |
            [Unit]
            Before=local-fs.target
            [Mount]
            # Example mount point, you can change it to where you like for each device.
            Where=/var/mnt/longhorn
            What=/dev/disk/by-label/longhorn
            Options=rw,relatime,discard
            [Install]
            WantedBy=local-fs.target
EOF

oc apply -f auto-mount-machineconfig.yaml

Label and Annotate The Node

Please refer to the section Customizing Default Disks for New Nodes to label and annotate storage node on where your device is by oc commands:

oc get nodes --no-headers | awk '{print $1}'

oc annotate node ${NODE_NAME} --overwrite node.longhorn.io/default-disks-config='[{"path":"/var/mnt/longhorn","allowScheduling":true}]'
oc label node ${NODE_NAME} --overwrite node.longhorn.io/create-default-disk=config

You might need to reboot the node to validate the modified configuration.

Reference

Main Contributor

@ArthurVardevanyan