Jump to contentJump to page navigation: previous page [access key p]/next page [access key n]
SUSE Enterprise Storage 7

Administration and Operations Guide

Authors: Tomáš Bažant, Alexandra Settle, and Liam Proven
Publication Date: 11/02/2021
About this guide
Available documentation
Giving feedback
Documentation conventions
Product life cycle and support
Ceph contributors
Commands and command prompts used in this guide
I Ceph Dashboard
1 About the Ceph Dashboard
2 Dashboard's Web user interface
2.1 Logging in
2.2 Utility menu
2.3 Main menu
2.4 Content pane
2.5 Common Web UI features
2.6 Dashboard widgets
3 Manage Ceph Dashboard users and roles
3.1 Listing users
3.2 Adding new users
3.3 Editing users
3.4 Deleting users
3.5 Listing user roles
3.6 Adding custom roles
3.7 Editing custom roles
3.8 Deleting custom roles
4 View cluster internals
4.1 Viewing cluster nodes
4.2 Accessing cluster inventory
4.3 Viewing Ceph Monitors
4.4 Displaying services
4.5 Displaying Ceph OSDs
4.6 Viewing cluster configuration
4.7 Viewing the CRUSH Map
4.8 Viewing manager modules
4.9 Viewing logs
4.10 Viewing monitoring
5 Manage pools
5.1 Adding a new pool
5.2 Deleting pools
5.3 Editing a pool's options
6 Manage RADOS Block Device
6.1 Viewing details about RBDs
6.2 Viewing RBD's configuration
6.3 Creating RBDs
6.4 Deleting RBDs
6.5 Creating RADOS Block Device snapshots
6.6 RBD mirroring
6.7 Managing iSCSI Gateways
6.8 RBD Quality of Service (QoS)
7 Manage NFS Ganesha
7.1 Creating NFS exports
7.2 Deleting NFS exports
7.3 Editing NFS exports
8 Manage CephFS
8.1 Viewing CephFS overview
9 Manage the Object Gateway
9.1 Viewing Object Gateways
9.2 Managing Object Gateway users
9.3 Managing the Object Gateway buckets
10 Manual configuration
10.1 Configuring TLS/SSL support
10.2 Changing host name and port number
10.3 Adjusting user names and passwords
10.4 Enabling the Object Gateway management front-end
10.5 Enabling iSCSI management
10.6 Enabling Single Sign-On
11 Manage users and roles on the command line
11.1 Managing the password policy
11.2 Managing user accounts
11.3 User roles and permissions
11.4 Proxy configuration
11.5 Auditing API requests
11.6 Configuring NFS Ganesha in the Ceph Dashboard
11.7 Debugging plugins
II Cluster Operation
12 Determine the cluster state
12.1 Checking a cluster's status
12.2 Checking cluster health
12.3 Checking a cluster's usage stats
12.4 Checking OSD status
12.5 Checking for full OSDs
12.6 Checking the monitor status
12.7 Checking placement group states
12.8 Storage capacity
12.9 Monitoring OSDs and placement groups
13 Operational tasks
13.1 Modifying the cluster configuration
13.2 Adding nodes
13.3 Removing nodes
13.4 OSD management
13.5 Moving the Salt Master to a new node
13.6 Updating the cluster nodes
13.7 Updating Ceph
13.8 Halting or rebooting cluster
13.9 Removing an entire Ceph cluster
14 Operation of Ceph services
14.1 Operating individual services
14.2 Operating service types
14.3 Operating services on a single node
14.4 Shutting down and restarting the whole Ceph cluster
15 Backup and restore
15.1 Back Up Cluster Configuration and Data
15.2 Restoring a Ceph node
16 Monitoring and alerting
16.1 Configuring custom or local images
16.2 Updating monitoring services
16.3 Disabling monitoring
16.4 Configuring Grafana
16.5 Configuring the Prometheus Manager Module
16.6 Prometheus security model
16.7 Prometheus Alertmanager SNMP webhook
III Storing Data in a Cluster
17 Stored data management
17.1 OSD devices
17.2 Buckets
17.3 Rule sets
17.4 Placement groups
17.5 CRUSH Map manipulation
17.6 Scrubbing placement groups
18 Manage storage pools
18.1 Creating a pool
18.2 Listing pools
18.3 Renaming a pool
18.4 Deleting a pool
18.5 Other operations
18.6 Pool migration
18.7 Pool snapshots
18.8 Data compression
19 Erasure coded pools
19.1 Prerequisite for erasure coded Pools
19.2 Creating a sample erasure coded pool
19.3 Erasure code profiles
19.4 Marking erasure coded pools with RADOS Block Device
20 RADOS Block Device
20.1 Block device commands
20.2 Mounting and unmounting
20.3 Snapshots
20.4 RBD image mirrors
20.5 Cache settings
20.6 QoS settings
20.7 Read-ahead settings
20.8 Advanced features
20.9 Mapping RBD using old kernel clients
20.10 Enabling block devices and Kubernetes
IV Accessing Cluster Data
21 Ceph Object Gateway
21.1 Object Gateway restrictions and naming limitations
21.2 Deploying the Object Gateway
21.3 Operating the Object Gateway service
21.4 Configuration options
21.5 Managing Object Gateway access
21.6 HTTP front-ends
21.7 Enable HTTPS/SSL for Object Gateways
21.8 Synchronization modules
21.9 LDAP authentication
21.10 Bucket index sharding
21.11 OpenStack Keystone integration
21.12 Pool placement and storage classes
21.13 Multisite Object Gateways
22 Ceph iSCSI gateway
22.1 ceph-iscsi managed targets
22.2 Conclusion
23 Clustered file system
23.1 Mounting CephFS
23.2 Unmounting CephFS
23.3 Mounting CephFS in /etc/fstab
23.4 Multiple active MDS daemons (active-active MDS)
23.5 Managing failover
23.6 Setting CephFS quotas
23.7 Managing CephFS snapshots
24 Export Ceph data via Samba
24.1 Export CephFS via Samba share
24.2 Joining Samba Gateway and Active Directory
25 NFS Ganesha
25.1 Creating an NFS service
25.2 Starting or Restarting NFS Ganesha
25.3 Listing objects in the NFS recovery pool
25.4 Creating an NFS export
25.5 Verifying the NFS export
25.6 Mounting the NFS export
25.7 Multiple NFS Ganesha clusters
V Integration with Virtualization Tools
26 libvirt and Ceph
26.1 Configuring Ceph with libvirt
26.2 Preparing the VM manager
26.3 Creating a VM
26.4 Configuring the VM
26.5 Summary
27 Ceph as a back-end for QEMU KVM instance
27.1 Installing qemu-block-rbd
27.2 Using QEMU
27.3 Creating images with QEMU
27.4 Resizing images with QEMU
27.5 Retrieving image info with QEMU
27.6 Running QEMU with RBD
27.7 Enabling discard and TRIM
27.8 Setting QEMU cache options
VI Configuring a Cluster
28 Ceph cluster configuration
28.1 Configure the ceph.conf file
28.2 Configuration database
28.3 config-key store
28.4 Ceph OSD and BlueStore
28.5 Ceph Object Gateway
29 Ceph Manager modules
29.1 Balancer
29.2 Enabling the telemetry module
30 Authentication with cephx
30.1 Authentication architecture
30.2 Key management
A Ceph maintenance updates based on upstream 'Octopus' point releases
Glossary
List of Figures
2.1 Ceph Dashboard login screen
2.2 Ceph Dashboard home page
2.3 Status widgets
2.4 Capacity widgets
2.5 performance widgets
3.1 User management
3.2 Adding a user
3.3 User roles
3.4 Adding a role
4.1 Hosts
4.2 Services
4.3 Ceph Monitors
4.4 Services
4.5 Ceph OSDs
4.6 OSD flags
4.7 OSD recovery priority
4.8 OSD details
4.9 Create OSDs
4.10 Adding primary devices
4.11 Create OSDs with primary devices added
4.12
4.13 Newly added OSDs
4.14 Cluster configuration
4.15 CRUSH Map
4.16 Manager modules
4.17 Logs
5.1 List of pools
5.2 Adding a new pool
6.1 List of RBD images
6.2 RBD details
6.3 RBD configuration
6.4 Adding a new RBD
6.5 RBD snapshots
6.6 Running rbd-mirror daemons
6.7 Creating a pool with RBD application
6.8 Configuring the replication mode
6.9 Adding peer credentials
6.10 List of replicated pools
6.11 New RBD image
6.12 New RBD image synchronized
6.13 RBD images' replication status
6.14 List of iSCSI targets
6.15 iSCSI target details
6.16 Adding a new target
7.1 List of NFS exports
7.2 NFS export details
7.3 Adding a new NFS export
7.4 Editing an NFS export
8.1 CephFS details
8.2 CephFS details
9.1 Gateway's details
9.2 Gateway users
9.3 Adding a new gateway user
9.4 Gateway bucket details
9.5 Editing the bucket details
12.1 Ceph cluster
12.2 Peering schema
12.3 Placement groups status
17.1 OSDs with mixed device classes
17.2 Example tree
17.3 Node replacement methods
17.4 Placement groups in a pool
17.5 Placement groups and OSDs
18.1 Pools before migration
18.2 Cache tier setup
18.3 Data flushing
18.4 Setting overlay
18.5 Migration complete
20.1 RADOS protocol
22.1 iSCSI initiator properties
22.2 Discover target portal
22.3 Target portals
22.4 Targets
22.5 iSCSI target properties
22.6 Device details
22.7 New volume wizard
22.8 Offline disk prompt
22.9 Confirm volume selections
22.10 iSCSI initiator properties
22.11 Add target server
22.12 Manage multipath devices
22.13 Paths listing for multipath
22.14 Add storage dialog
22.15 Custom space setting
22.16 iSCSI datastore overview
25.1 NFS Ganesha structure
30.1 Basic cephx authentication
30.2 cephx authentication
30.3 cephx authentication - MDS and OSD

Copyright © 2020– 2021 SUSE LLC and contributors. All rights reserved.

Except where otherwise noted, this document is licensed under Creative Commons Attribution-ShareAlike 4.0 International (CC-BY-SA 4.0): https://creativecommons.org/licenses/by-sa/4.0/legalcode.

For SUSE trademarks, see http://www.suse.com/company/legal/. All third-party trademarks are the property of their respective owners. Trademark symbols (®, ™ etc.) denote trademarks of SUSE and its affiliates. Asterisks (*) denote third-party trademarks.

All information found in this book has been compiled with utmost attention to detail. However, this does not guarantee complete accuracy. Neither SUSE LLC, its affiliates, the authors nor the translators shall be held liable for possible errors or the consequences thereof.

Print this page