Automated Storage Tiering

In this topic:

About Automated Storage Tiering

Changing physical disk tier numbers

Changing the maximum number of tiers for a disk pool

Preserving tier space for new allocations

Also see:

Disk Pools for information about disk tiers, tier affinity, and pool allocation

Allocation View for a visual display of the data temperature in disk pools

About Automated Storage Tiering

The Automated Storage Tiering feature (also known as Auto-tiering) continually calculates the frequency that data in disk pools is accessed and migrates data based on the frequency or "temperature". The initial temperature assigned to an SAU is the average temperature of data in the tier to which it is stored. Auto-tiering identifies access patterns in storage allocation units (SAUs) and either promotes the data to a higher priority tier or demotes the data to a lower priority tier based on usage relative to other data within the pool. The most frequently and consistently accessed data will be migrated to higher priority tiers and the least-accessed data will be migrated to lower priority tiers. The tiers used for storage are also effected by the storage profile of a virtual disk, as described in a following section. Automated Storage Tiering is a licensed option.

The default behavior of auto-tiering is to migrate data based on the frequency of read operations only. Data can also be monitored for the frequency of both read and write operations by enabling a custom storage profile setting and applying the storage profile to virtual disks. The write-aware auto-tiering setting, when enabled, gives auto-tiering the ability to migrate data based on both reads and writes equally. This setting could be useful when very few read operations occur to the back-end storage used by a virtual disk. In this case, read operations alone might not present a true picture of how frequently the data is accessed. This could occur with some applications where most operations are performed in memory. See Storage Profiles for important information about write-aware auto-tiering and creating custom storage profiles.

A disk pool is comprised of a number of tiers that are used to separate physical disks of different speeds and performance within the same pool. Each pool can have from one to 15 tiers; the default setting is three. The number of tiers in a pool is assigned when it is created, but can be changed at any time. See Changing the Number of Tiers in a Disk Pool in this topic.

When calculating the number of tiers in a disk pool, be aware that there should be a significant difference in performance between tiers in order to justify the migration of data between the tiers. Data migration will affect the disk pool performance.

When physical disks are initially added to a pool, they are assigned (by default) to a tier which falls in the middle of the top and bottom tiers. To implement the auto-tiering scheme, after adding disks to the pool, the user should change the tier number assigned to the disks to reflect the speed and performance of the disks. For instance, if the disk pool has three tiers, Tier 1 should consist of the fastest physical disks in the pool or the disks that should be used the most often. Tier 3 should consist of the slowest disks or disks that should be used the least. See Changing Physical Disk Tier Numbers in this topic. In this manner, frequently accessed data will utilize the fastest disks in the highest priority tiers, while infrequently accessed data can be relegated to the slowest disks in the lowest priority tiers. Automated Storage Tiering can improve performance by decreasing response time when data is being read from physical disks.

See Allocation View for a visual display of the temperature of data in a disk pool.

Preserving Tier Space for New Allocations

A percentage of space in disk tiers of a pool can be preserved for future virtual disk allocations. The Space preserved for new allocations setting allows the percentage value to be set per disk pool and the same percentage of space will be preserved in each tier in the pool, except for the lowest tier (which cannot be preserved). The default setting is 0% per tier which will not preserve any space in tiers. The maximum percentage that can be set is 95% per tier. The percentage can be changed as required. This setting can be configured when a disk pool is created or later in the Settings tab of the Disk Pool Details page.

Since storage allocation begins with the highest available tier in the tier affinity set of a virtual disk, this setting can be used to preserve space in higher tiers for immediate virtual disk allocations without waiting for data migrations to occur. Storage allocations and data migration caused by auto-tiering will occur in each tier until the available space is equal to the percentage set. At that time, the next available tier in the tier affinity set will be used to store SAUs.

The setting will be honored with these exceptions:

• When there is no free space in the pool
• When space is needed to keep SAUs in the virtual disk tier affinity
• The setting does not apply to the lowest tier in the pool. This tier is always available for new allocations when all other tiers are full.

To change the percentage of tier space preserved for new allocations:

• Open the Disk Pool Details page>Settings tab for the disk pool.
• In the Auto-tiering area, enter the percentage of tier space to preserve in the Space preserved for new allocations box.
• Click Apply.

Effects of Storage Profiles on Auto-tiering

Automated Storage Tiering works in conjunction with the storage profile assigned to a virtual disk. The storage profile of a virtual disk designates the priority of the data. The tier affinity of a virtual disk are the preferred disk tiers to be used when allocating storage for that virtual disk. The tier affinity is calculated based on the performance class and the maximum number of tiers in the disk pool. SAUs for a virtual disk will reside within the tier affinity unless space is unavailable. When the tier affinity is fully allocated, data will be forced out of tier affinity. Auto-tiering will migrate data to the correct tier affinity once space is available again.

By default, data temperature and migration is based on read access patterns. A setting in storage profiles can enable write-aware auto tiering, which will also identify write access patterns. When write-aware auto tiering is enabled, the temperature of data will be determined by both read and write access patterns equally and data will be migrated accordingly. This setting may be useful when virtual disk storage is based on applications that are write intensive, but not read intensive. To enable write-aware auto tiering, create a custom storage profile with the option enabled and assign the storage profile to virtual disks. See Storage Profiles for more information.

See Storage Profiles and Disk Pools for more information on storage profiles and tier affinity.

Data Migration

SAUs migrate between tiers as necessary to maintain the auto-tiering and storage profile schemes. High priority data migrations occur at a much faster rate than regular priority migrations. The Automated Storage Tiering feature must be enabled for the data migration cases below to occur.

Data Migration Cases

• High priority migrations occur:
  • To bring virtual disk data that is outside of the tier affinity back into the tier affinity.
  • When a disk is being decommissioned.
  • When the performance class in a virtual disk storage profile has changed.
  • When the tier number of a physical disk has changed.
• Regular priority migrations occur:
  • When data is promoted or demoted based on frequent and consistent reads that raise or lower the heat map temperature. Data migration is relative to the usage of other data and available space in the tier. Demoted data will only be moved to a lower priority tier if it is required to make space for data that needs to be promoted to that tier.

Changing Physical Disk Tier Numbers

The disk tier number of a physical disk is used in the implementation of the auto-tiering scheme, as well as storage profile settings based on data priority.

Assign a tier number to each pool disk based on the performance of the disk. For instance, if the disk pool has three tiers, Tier 1 should consist of the fastest physical disks in the pool or the disks that should be used the most often. Tier 3 should consist of the slowest disks or disks that should be used the least.

To change tier number for a disk:

1. In the DataCore Servers Panel, expand the disk pool. The physical disks will be listed.
2. Right-click on each physical disk, point to Disk Tier and select the correct tier number.

   Tier number can also be changed in the physical disk details page.

3. Click Yes on the confirmation message to proceed with the operation.

Changing the Maximum Number of Tiers for a Disk Pool

The maximum number of tiers allowed in a pool is used in the implementation of the auto-tiering scheme.

The number of tiers is set per pool. The highest maximum number of tiers is 15; the default setting is three. There should be a significant difference in disk performance between tiers. Three tiers is optimal for most applications. The maximum number of tiers can be changed at any time.

To change the number of tiers:

1. Open theDisk Pool Details page>Settings tab for the disk pool.
2. In the Disk Tiers area, select the new maximum number of tiers by clicking the arrows in the box.
3. Click Apply.