Académique Documents
Professionnel Documents
Culture Documents
Module Objectives
By the end of this module, you should be able to: Describe Data ONTAP RAID technology Identify a disk in a disk shelf based on its ID Execute commands to determine a disk ID Identify a hot-spare disk in a FAS system Describe the effects of using multiple disk types Create a 32-bit and a 64-bit aggregate Execute aggregate commands in the Data ONTAP operating system
2011 NetApp, Inc. All rights reserved. 2
Storage
The Data ONTAP operating system provides data storage for clients: A volume (or a smaller increment within vol1 a volume) makes storage available to clients through protocols. Volumes are contained in an aggregate. aggr1 Aggregates are not visible to clients.
Storage Architecture
aggr0
aggr1
2011 NetApp, Inc. All rights reserved.
online
online
aggr1
plex0 rg1
rg0
system> sysconfig -r ... Plex /aggr1/plex0 (online, normal, active, pool0) RAID group /aggr1/plex0/rg0 (normal) ... RAID group /aggr1/plex0/rg1 (normal)
...
RAID types:
RAID 4 RAID-DP technology (a RAID 6 implementation)
rg0
plex0 rg1
system> sysconfig -r ... RAID group /aggr1/plex0/rg0 (normal) RAID Disk Device HA SHELF BAY CHAN Pool... --------- ------ ------------- ---- ---parity 0a.24 0a 1 8 FC:A 0... data 0a.25 0a 1 9 FC:A 0...
2011 NetApp, Inc. All rights reserved. 7
Disk types:
Parity
Data
Composed of 4-KB blocks
rg0
plex0 rg1
system> sysconfig -r ... RAID group /aggr1/plex0/rg0 (normal) RAID Disk Device HA SHELF BAY CHAN Pool... --------- ------ ------------- ---- ---parity 0a.24 0a 1 8 FC:A 0... data 0a.25 0a 1 9 FC:A 0...
2011 NetApp, Inc. All rights reserved. 8
Disks
Disks
All data is stored on disks. To understand how physical media is managed in your storage system, you need to be familiar with:
Disk types (FC, SATA, SAS, SSD) Disk qualification Disk ownership Spare disks
10
Disk Qualification
NetApp allows only qualified disks to be used with the Data ONTAP operating system. Qualification
Ensures quality and reliability Is enforced by /etc/qual_devices
Caution!
Modifying the disk qualification requirement file can cause your storage system to halt.
11
FC-AL
DS14mk4 (ESH2 or ESH4)
SAS
DS4243
DS14mk2AT
DS2246
12
FC-AL Architecture
FC and ATA disks connect through an FC-AL (Fibre Channel Arbitrated Loop) architecture with ESH (electronically switched hub) technology Uses FC and ATA disks types
e0a
0a
0b
LINK LINK
0c
0d
LINK
ESH
DS14
FC
Power
MK4
Fault
Loop A
Loop B
System
Shelf ID
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
13
Device ID = host_adapter.disk_id
14
0a
0a
LINK
e0a
0b
LINK LINK
0c
0d
LINK
LINK
LINK LINK
LINK
13
14
15
10
16
Fault
Loop A
Loop B
System
Shelf ID
Shelf ID
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
450F
13 12 11 10 Shelf ID 1 2
Bay Number
3
4 5 6 7
130
130 130 130 130
6148
7764 9380 10996 125112
16
https://kb.netapp.com/support/index?page=content&id=3012395
17
SAS Architecture
Serial Attached SCSI (SAS) provides the affordability of SATA with the reliability of FC SAS uses expanders
Expanders are switches Maintain point-to-point connections with disks
e0a
0a
0b
LINK LINK
0c
0d
LINK
Expander
18
Device ID = host_adapter.shelf_id.bay_id
19
0a
0a
LINK
e0a
0b
LINK LINK
0c
0d
LINK
LINK
LINK LINK
LINK
Shelf ID of 00
Bay 0
Bay 1
Bay 2
Bay 3
Bay 20
2011 NetApp, Inc. All rights reserved.
Bay 23
20
Disk Ownership
Disks are assigned to one system controller. Disk ownership is either:
Hardware-based: determined by the slot position of the host bus adapter (HBA) and shelf module port Software-based: determined by the storage system administrator
Storage Systems FAS6200 series FAS6000 series FAS3200 series FAS3100 series FAS3000 series FAS2000 series Software Disk Ownership X X X X X X Hardware Disk Ownership
21
Hardware-based output: SANOWN not enabled Software-based output: report on the current ownership
22
Hardware-Based Ownership
Determined by two conditions:
1. 2. How a storage system is configured How the disk shelves are attached to the storage system
A standalone system owns all disks that are directly attached to it. If part of a high-availability configuration:
Local node owns the disks connected to the ESH A channel Partner node owns the disk connected to the ESH B channel
4Gb 2Gb 1Gb ELP
X2
1Gb
2Gb
4Gb
SHELF ID
A B
ES H 4
4Gb 2Gb 1Gb ELP
Channel B
2011 NetApp, Inc. All rights reserved. 23
X2
ESH4
Channel A
Software-Based Ownership
Ownership is determined by the system administrator: To verify current ownership:
system> disk show -v DISK OWNER --------- --------------0b.43 Not Owned ... 0b.29 system (84165672) ... POOL ----NONE Pool0 SERIAL NUMBER ------------41229013 41229011
POOL ----NONE
To unassign disks:
This option specifies whether disks are automatically assigned on systems with software disk ownership. The default is on. The Data ONTAP operating system assigns unassigned disks to the system and pool based upon the disk loop. Automatic assignment is invoked:
10 minutes after boot Every five minutes
system> disk assign auto
26
Disk Selection
When creating an aggregate, the Data ONTAP operating system selects disks:
With the same speed That match the speed of existing disks
The Data ONTAP operating system verifies that adequate spares are available.
If spares are not available, the Data ONTAP operating system warns you. NOTE: NetApp recommends that spares be available.
2011 NetApp, Inc. All rights reserved. 27
28
Spare Disks
Spare disks are used to:
Increase aggregate capacity Replace failed disks
29
30
31
32
RAID Groups
RAID groups are a collection of data disks and parity disks. RAID groups provide protection through parity. The Data ONTAP operating system organizes disks into RAID groups. The Data ONTAP operating system supports:
RAID 4 RAID-DP technology
33
RAID 4 Technology
RAID 4 protects against data loss that results from a single-disk failure in a RAID group. A RAID 4 group requires a minimum of two disks:
One parity disk One data disk
Data
Data
Data
Data
Data
Data
Data
Parity
34
RAID-DP Technology
RAID-DP technology protects against data loss that results from double-disk failures in a RAID group. A RAID-DP group requires a minimum of three disks:
One parity disk One double-parity disk One data disk
Data
Data
Data
Data
Data
Data
Parity
DoubleParity
35
RAID 4 NetApp Platform All storage systems (with SATA) All storage systems (with FC or SAS) Minimum Group Size 2 Maximum Group Size 7 Default Group Size 7
14
36
Growing Aggregates
Take care with how you grow your aggregates.
Existing rg0
Data Data Data Data Data Data Data Parity
Existing rg1
Data
Data
Data
Data
Data
Data
Data
Parity
If you grow this configuration by three disks when the existing disks are nearly full, the new data disks can become hot disks.
Data
Parity
37
41
Degraded Mode
Degraded mode occurs when a disk fails in a RAID group During degraded mode:
Data is still available Performance is less than optimal
Data must be recalculated from parity until the failed disk is replaced. CPU usage increases to calculate from parity.
The failed disk (or disks for RAID-DP) will be rebuilt on a spare drive (if available)
If no spares are available or if the rebuild fails, the system shuts down after a period of time.
To change the time interval, use the options raid.timeout command.
44
45
750 GB
1 TB
750 GB
750 GB
750 GB
750 GB
NOTE: When a larger disk replaces a smaller disk, disk resizing occurs.
46
Disk Replacement
To replace a data disk with a spare disk:
system> disk replace start device_id spare_device_id system> disk replace start 0a.21 0a.23
0a.20 0a.21 0a.22 0a.23
Parity Disk
Data Disk
Target Disk
Data Disk
Spare Disk
47
Aggregates
48
Aggregates
Aggregates logically contain flexible volumes (FlexVol volumes). NetApp recommends that aggregates be 32-bit or 64-bit. An aggregate name must:
Begin with a letter or the underscore character (_) Contain only letters, digits, and underscore characters Contain no more than 255 characters A single storage system supports up to 100 aggregates (including traditional volumes)
49
Adding an Aggregate
Use one of two methods:
The CLI: system> aggr create ... NetApp System Manager: the Aggregate Wizard
To create an aggregate:
system> aggr create aggr1 3
2011 NetApp, Inc. All rights reserved.
The 64-bit aggregate, which is called aggr, has 24 disks. By default, the aggregate uses RAID-DP technology. The command succeeds only if 24 disks (spares) are available. To create a 32-bit aggregate:
system> aggr create aggr -B 32 24
or
system> aggr create aggr 24
2011 NetApp, Inc. All rights reserved. 51
32-bit
Maximize performance when no more than 16 TB of space is needed.
64-bit
Achieve high performance and the ability to exceed the 16-TB limitation.
52
To destroy an aggregate:
system> aggr offline aggr system> aggr destroy aggr
53
54
55
56
57
For a 64-bit aggregate, select this option. For a 32bit aggregate, do not select the option.
2011 NetApp, Inc. All rights reserved. 58
59
60
Exercise
Module 3: Physical Storage Estimated Time: 60 minutes
65
66