Scheduling

First, Longhorn will always try to schedule the new replica on a new node with a new zone if possible. In this context, "new" means that a replica for the volume has not already been scheduled to the zone or node, and "existing" refers to a node or zone that already has a replica scheduled to it.

At this time, if both the Replica Node Level Soft Anti-Affinity and Replica Zone Level Soft Anti-Affinity settings are un-checked, and if there is no new node with a new zone, Longhorn will not schedule the replica.

Then, Longhorn will look for a new node with an existing zone. If possible, it will schedule the new replica on the new node with an existing zone.

At this time, if Replica Node Level Soft Anti-Affinity is un-checked and Replica Zone Level Soft Anti-Affinity is checked, and there is no new node with an existing zone, Longhorn will not schedule the replica.

Last, Longhorn will look for an existing node with an existing zone to schedule the new replica. At this time both Replica Node Level Soft Anti-Affinity and Replica Zone Level Soft Anti-Affinity should be checked.

Once the node and zone stage is satisfied, Longhorn will decide whether it can schedule the replica on any disk of the node. Longhorn will check the available disks on the selected node with the matching tag, the total disk space, and the available disk space. It will also check whether another replica already exists and whether anti-affinity is set to be "hard" (no sharing) or "soft" (prefer not to share.)

For example, after the node and zone stage, Longhorn finds Node A satisfies the requirements for scheduling a replica to the node. Longhorn will check all the available disks on this node.

Assume this node has two disks and neither one has another replica: Disk X with available space 1 GB, and Disk Y with available space 2 GB. And the replica Longhorn going to schedule needs 1 GB. With default Storage Minimal Available Percentage 25, Longhorn can only schedule the replica on Disk Y if this Disk Y matches the disk tag, otherwise Longhorn will return failure on this replica selection. But if the Storage Minimal Available Percentage is set to 0, and Disk X also matches the disk tag, Longhorn can schedule the replica on Disk X.

Now suppose one of the potential candidate disks has an existing replica and `Replica Disk Soft Anti-Affinity" is set to true. In principle, Longhorn would be allowed to choose either disk, but in practice, it will avoid the existing replica and place the new replica on another disk, even if it is an otherwise inferior choice.