Académique Documents
Professionnel Documents
Culture Documents
doc Page 1
18 July 2006 Network Appliance Australia Pty Ltd ABN 14 092 499 431
Data ONTAP 7.0 Cook Book
Revision: 1.0
David Thiessen
NetApp PSE
Australia
Table of Contents
1 Volume Creation & Exporting..................................................................................................... 4
1.1 Creating Volumes .......................................................................................................................... 4
1.1.1 Software Disk Ownership......................................................................................................... 4
1.1.2 Traditional Volumes ................................................................................................................. 4
1.1.3 Create Aggregates ................................................................................................................... 5
1.1.4 Flex Volumes............................................................................................................................ 5
1.1.5 Create Qtrees........................................................................................................................... 6
1.2 Sharing Volumes & Qtrees ............................................................................................................ 6
1.2.1 NFS exports ............................................................................................................................. 6
1.2.2 CIFS shares ............................................................................................................................. 7
1.3 Using Quotas ................................................................................................................................. 8
2 SAN Implementation.................................................................................................................... 9
2.1 Fiber Channel SAN........................................................................................................................ 9
2.1.1 Enable the Fibre Channel Protocol .......................................................................................... 9
2.1.2 Create a LUN ......................................................................................................................... 10
2.1.3 Access LUNs on a Solaris Host ............................................................................................. 10
2.1.4 Access LUNs on a Windows Host.......................................................................................... 12
2.2 iSCSI SAN ................................................................................................................................... 12
2.2.1 Enable the iSCSI Protocol...................................................................................................... 12
2.2.2 Install SnapDrive for Windows ............................................................................................... 13
2.2.3 Connecting Windows Server to Storage Appliance ............................................................... 13
2.2.4 Create a LUN using SnapDrive.............................................................................................. 14
2.3 Resize a LUN............................................................................................................................... 14
2.4 Access LUN with NFS/CIFS protocols......................................................................................... 14
2.5 Clone a LUN ................................................................................................................................ 15
DOT 7 0 Cook Book_Rev1_0.doc Page 2
18 July 2006 Network Appliance Australia Pty Ltd ABN 14 092 499 431
3 Networking and Appliance Access.......................................................................................... 16
3.1 Creating VLANS........................................................................................................................... 16
3.2 Virtual Interfaces (VIF) ................................................................................................................. 16
3.2.1 Create a VIF........................................................................................................................... 16
3.2.2 Delete a VIF interface or VIF.................................................................................................. 17
3.3 Using SecureAdmin ..................................................................................................................... 17
3.3.1 Managing SSH....................................................................................................................... 17
3.3.2 Managing SSL........................................................................................................................ 17
3.4 Using the RLM............................................................................................................................. 18
3.4.1 Configure the RLM................................................................................................................. 18
3.4.2 Use the RLM .......................................................................................................................... 18
3.5 Create Local User Accounts ........................................................................................................ 18
4 Snap Applications...................................................................................................................... 20
4.1 Snapshots .................................................................................................................................... 20
4.2 SnapRestore................................................................................................................................ 20
4.3 Asynchronous SnapMirror ........................................................................................................... 20
4.3.1 Create an Asynchronous Volume SnapMirror Relationship .................................................. 20
4.3.2 Convert a read-only SnapMirror Volume to read-write .......................................................... 21
4.3.3 Resync a Broken Volume SnapMirror Relationship............................................................... 21
4.3.4 Create an Asynchronous Qtree SnapMirror........................................................................... 22
4.3.5 Convert read-only Qtree SnapMirrror to writeable................................................................. 22
4.3.6 Purging Asynchronous Mirrors............................................................................................... 23
5 Backup & Recovery ................................................................................................................... 24
5.1 Network Data Management Protocol (NDMP) Copy ................................................................... 24
5.1.1 Enable NDMP......................................................................................................................... 24
5.2 ndmpcopy .................................................................................................................................... 24
5.3 Volume Copy ............................................................................................................................... 24
6 Cluster Failover Implementation.............................................................................................. 26
6.1 Enable clustering ......................................................................................................................... 26
6.2 Setup takeover interfaces ............................................................................................................ 26
6.3 Perform cluster takeover/giveback .............................................................................................. 28
6.3.1 Perform Takeover................................................................................................................... 28
6.3.2 Perform Giveback................................................................................................................... 28
7 MultiStore (Vfiler) Implementation ........................................................................................... 30
7.1 MultiStore (Vfiler) Configuration................................................................................................... 30
7.2 MultiStore (Vfiler) Administration ................................................................................................. 30
DOT 7 0 Cook Book_Rev1_0.doc Page 3
18 July 2006 Network Appliance Australia Pty Ltd ABN 14 092 499 431
7.2.1 MultiStore(Vfiler) Stop/Destroy............................................................................................... 31
8 Sample Configuration Files ...................................................................................................... 32
8.1 /etc/quota ..................................................................................................................................... 32
8.2 /etc/rc ........................................................................................................................................... 32
8.3 /etc/exports .................................................................................................................................. 33
8.4 /etc/snapmirror.conf ..................................................................................................................... 33
9 Troubleshooting Commands.................................................................................................... 34
9.1 General Troubleshooting ............................................................................................................. 34
9.2 NFS Troubleshooting................................................................................................................... 34
9.3 CIFS Troubleshooting.................................................................................................................. 34
9.4 Network Troubleshooting............................................................................................................. 35
9.5 NDMP Troubleshooting................................................................................................................ 35
9.6 SAN Troubleshooting................................................................................................................... 36
9.6.1 Filer SAN Utilities ................................................................................................................... 36
9.6.2 Solaris SAN Utilities ............................................................................................................... 36
9.6.3 Windows SAN Utilities............................................................................................................ 37
9.6.4 Common SAN Switch Commands ......................................................................................... 37
9.7 Test & Simulation Tools............................................................................................................... 37
DOT 7 0 Cook Book_Rev1_0.doc Page 4
18 July 2006 Network Appliance Australia Pty Ltd ABN 14 092 499 431
1 Volume Creation & Exporting
1.1 Creating Volumes
The following section describes the procedures to create a traditional and an aggregate volume.
1.1.1 Software Disk Ownership
The FAS270, FAS6000 series, and V-Series (gateway) appliances rely on ownership labels written to
disk rather than physical connections. The following section describes how to assign and remove disk
ownership.
NOTE: Unowned disks cannot be used for data or as spares without being assigned ownership.
Step Command/Action Description
1
NA> disk show -v Display all visible disks and whether they
are owned or not
2 NA> disk show n Show all unassigned disks
3
NA> disk assign 0b.43 0b.41 Assigns the listed disks to current filer
head
4
NA> disk assign 2a.18 2a.21 o toaster1 Assigns listed disks to filer named
toaster1
4
NA> disk assign all
Warning: Use with caution. Not restricted by A
and B loop in clusters
Assign all unowned disks to current filer
head
5 NA> disk assign <lun_id_list> c {block | zoned} Assign LUNs to a V-Series
6 NA> disk remove_ownership [ disk_id | all ] Remove disk ownership.
disk assign syntax:
disk assign {disk_name | all | -n count } [-p pool] [-o ownername] [-s sysid] [-c block|zoned] [-f]
1.1.2 Traditional Volumes
Create a traditional volume on the storage appliance.
Step Command/Action Description
1
NA> vol create vol1 -t raid_dp -r 14 9 Create a volume called "vol1" using
raid_dp, a maximum raid size of 14 disks
with an initial size of 9 disks.
Traditional Volume Syntax:
vol create <vol-name> [ -l <language_code> ] [-f] [-n] [-m] [-L] [-t raid4 | raid_dp]
[-r <raid-group-size>] [-R <rpm>] <disk-list>
1.1.2.1 Add disks to a Traditional Volume
Step Command/Action Description
DOT 7 0 Cook Book_Rev1_0.doc Page 5
18 July 2006 Network Appliance Australia Pty Ltd ABN 14 092 499 431
1
NA> vol status s Display list of available spare disks and their
disk IDs
NA> vol add vol2 d 7.17 7.26 Add disks 7.17 and 7.26 to the volume vol2
2
NA> vol add vol2 4@72 Add four 72GB disks to volume vol2
3 reallocate on
Enable block reallocation
OPTIONAL: Temporarily affects performance
and significantly increases snapshot
consumption, but recommended when adding
3 or more disks
4 reallocate start f /vol/vol2
Distributes data evenly across the expanded
volume
1.1.3 Create Aggregates
Step Command/Action Description
1
NA> aggr create aggr0 -t raid_dp -r 14 9 Create an aggregate called "aggr0" using
raid_dp, a maximum raid size of 14 disks
with an initial size of 9 disks
Aggregate Syntax:
aggr create <aggr-name> [-f] [-n] [-m] [-L] [-t raid4 | raid_dp] [-r <raid-group-size>]
[-R <rpm>] [-l <language_code>] <disk-list>
1.1.3.1 Add disks to Aggregates
Step Command/Action Description
1
NA> aggr status s Display list of available spare disks and
their disk IDs
NA> aggr add aggr0 d 7.17 7.26 Add disks 7.17 and 7.26 to the
aggregate named "aggr0"
2
NA> aggr add aggr0 4@72 Add four 72GB disks to aggregate
named aggr0
3 reallocate on
Enable block reallocation
OPTIONAL: Temporarily affects
performance and significantly increases
snapshot consumption, but
recommended when adding 3 or more
disks
4 reallocate start f /vol/vol2
Distributes data evenly across the
expanded aggregate
1.1.4 Flex Volumes
Create a flexible volume on the storage appliance.
DOT 7 0 Cook Book_Rev1_0.doc Page 6
18 July 2006 Network Appliance Australia Pty Ltd ABN 14 092 499 431
Step Command/Action Description
1
NA> df A aggr0 Displays available free space in
aggregate aggr0
2
NA> vol create flex1 aggr0 7g Create a flexible volume called "flex1" on
aggregate "aggr0" of size 7GB.
Flexible Volume Syntax:
vol create <vol-name> [ -l <language_code> ] [ -s none | file | volume ] <hosting-aggr-name>
<size>[k|m|g|t]
1.1.4.1 Change size of a FlexVol
Step Command/Action Description
1
NA> df A aggr0 Check size and available space in the
containing aggregate named aggr0
NA> vol size vol4 150G Set the size of flexVol vol4 to 150GB
2
NA> vol size vol4 [+ | -] 30G Add or remove 30GB from flexVol vol4
1.1.5 Create Qtrees
Create a Qtree on the flexible volume.
Step Command/Action Description
1
NA> qtree create /vol/flex1/qt_alpha Create a Qtree called "qt_alpha" on
flexible volume flex1
2
NA> qtree security /vol/flex1/qt_alpha [ ntfs | unix
]
Configure the security profile for the Qtree
to be NTFS or Unix
1.2 Sharing Volumes & Qtrees
The following section describes procedures to export volumes or qtrees via NFS or CIFS.
1.2.1 NFS exports
1. On Filer: Create new NFS volume and export it:
Step Command/Action Description
1 NA> vol create flex2 aggr0 size 7g Create new volume for Unix Share
2 NA> qtree security /vol/flex2 unix Configure Qtree Security Settings
NA> exportfs -i -o rw,root=adminhost /vol/flex2 Immediately create export.
3
Edit /etc/exports file:
/vol/flex1 -rw,root=adminhost
Make export persistent
4 NA> exportfs -a Activate all entries in /etc/exports file
DOT 7 0 Cook Book_Rev1_0.doc Page 7
18 July 2006 Network Appliance Australia Pty Ltd ABN 14 092 499 431
2. On UNIX Server: Create new mount point and mount export:
Step Command/Action Description
6 # showmount -e fbfiler2 Verify available mounts on FBFiler2
7 # mkdir /mnt/fbfiler2/unix_vol Create a mount point
8 # mount fbfiler2:/vol/flex2 /mnt/fbfiler2/unix_vol Mount the Unix export from filer FBFiler2
9 # cd /mnt/fbfiler2/unix_vol Change to new mount point
10 # ls -al Verify mount was successful
11
Add mount command and options to /etc/vfstab
(Solaris) or /etc/fstab (HP-UX, Linux)
Make mount persistent
Note: If you change the name of the exported volume or qtree you must update /etc/exports on the
filer and the /etc/fstab or /etc/vfstab file on the host.
1.2.2 CIFS shares
1. On Filer: Create new CIFS volume and export it:
Step Command/Action Description
1 NA> vol create flex_cifs aggr0 size 7g Create new volume for CIFS Share
2 NA> qtree security /vol/flex_cifs ntfs Configure Qtree Security Settings
3 NA> cifs setup Run CIFS setup wizard
* Configure WINS
* Enter hostname for storage appliance
* Set CIFS authentication (Domain, Workgroup
or local)
* Enter Windows Domain name
* Enter Windows 2000 user (e.g.
Administrator@domain.com)
* Enter Administrator password
* Accept default AD container account
4
NA> cifs testdc Establish connection with Domain
controllers.
5
NA> cifs shares -add cifs_share /vol/flex_cifs -
comment 'New CIFS Share'
Create a CIFS share called "cifs_share"
6
(NA> cifs access cifsTeam Full Control) Set access rights to provide the cifsTeam
with full control rights to the share
2. On Windows Server:
Step Command/Action Description
7 * Log into Windows 2000 domain controller as
Administrator
Create a new user in the Domain if
applicable
DOT 7 0 Cook Book_Rev1_0.doc Page 8
18 July 2006 Network Appliance Australia Pty Ltd ABN 14 092 499 431
Administrator
* Start -> Programs -> Administrative Tools ->
Active Directory Users and Computers. Click on
"Action", select "New" then "User"
* Create a new user to access the filer.
applicable
8
* Open Computer Management:
Start -> Programs -> Administrative Tools ->
Computer Management
* Click on Action and select "Connect to another
computer". Enter the name of the storage
appliance
* System Tools -> Shared Folders -> Shares
View the available shares on the storage
appliance
9
* At the Windows desktop, right click on My
Network Places, select Map Network Drive
* \\fbfiler2\cifs_share
Map the storage appliance's cifs_share
folder to the server
Note: If you change the name of the shared volume or qtree the share will still be accessible because
CIFS tracks an unique SSID rather than the pathname.
1.3 Using Quotas
The following section describes the commands uses to manage qtree and volume quotas.
Step Command/Action Description
1 quota on /vol/vol2
Enables quotas if /etc/quotas exists or
implements changes in /etc/quotas for
vol2
(See section 8 for example /etc/quotas)
2 quota resize Implements changes made to /etc/quotas
3 quota report
prints the current file and space
consumption for each user or group with a
quota and for each qtree.
DOT 7 0 Cook Book_Rev1_0.doc Page 9
18 July 2006 Network Appliance Australia Pty Ltd ABN 14 092 499 431
2 SAN Implementation
The following section provides a summary of the procedures to enable access to a LUN on the storage
appliance using either the Fibre Channel Protocol or iSCSI protocol.
2.1 Fiber Channel SAN
The following section describes how to access a LUN using the Fibre Channel Protocol.
2.1.1 Enable the Fibre Channel Protocol
1. Enabling the Fibre Channel Protocol on a Storage Appliance
Step Command/Action Description
1 NA> license add <license_key> Add FCP License
2 NA> fcp start Start the FCP service
3
NA> sysconfig -v Locate Fibre Channel Target Host
Adapter. Note FC Nodename and FC
Portname for each.
4 NA> fcp show cfmode Display the Fibre Channel interface mode
2. Enabling the Fibre Channel Protocol on a Solaris Server
Step Command/Action Description
1
# /driver_directory/install Install the Fibre Channel Card driver
application
2
# reboot -- -r Restart the Solaris server to enable the
new hardware device
3
# sanlun fcp show adapter -v Show full details of the Fibre Channel
card on the server
4
# /usr/sbin/lpfc/lputil Light Pulse Common Utility to get
information regarding Emulux host
adapters.
3. Enabling the Fibre Channel Protocol on a Windows Server
Step Command/Action Description
1
Locate the host adapter driver and install on the
Windows server
Install the Host Adapter driver
2 Start -> Shutdown -> Restart Restart the Windows Server
3
C:\WINNT\system32\lputilnt.exe Run Light Pulse Common Utility to gather
detailed information regarding the host
adapter
DOT 7 0 Cook Book_Rev1_0.doc Page 10
18 July 2006 Network Appliance Australia Pty Ltd ABN 14 092 499 431
2.1.2 Create a LUN
1. Creating a LUN on the Storage Appliance
Step Command/Action Description
1
Create a LUN:
* lun create, igroup create, lun map
* lun setup
* FilerView -> LUNs -> Wizard
Create a LUN on the storage appliance
manually, via a CLI script, or through
FIlerView.
2
Enter LUN details during setup process:
* LUN Path: /vol/flex1/QTUser/UserLun
* LUN Size: 2g
* Space-reserved: Yes
* Protocol: Solaris
* Description: User LUNa
* iGroup Name: UserIG
* iGroup Type: FCP
* OS: Solaris
* Add Initiator to iGroup: WWNN of Solaris
host adapter
* Add LUN ID for iGroup Initiator
Enter the appropriate details for the LUN
Note: NA> fcp show adapters
NA> fcp show initiators
2.1.3 Access LUNs on a Solaris Host
Step Command/Action Description
1
# cd /opt/NTAPsanlun/bin Change to the directory of the NetApp
HBA Attach Kit
2
# ./create_binding.pl -l root -n <filer_ip> Run the Perl script to locate the ports
available on the filer.
Note: Do not reboot the server at the
completion of the script.
3
# cat /kernel/drv/lpfc.conf | more View the file to verify the bindings
created.
4
# /usr/sbin/lpfc/lputil
- Select "5. Persistent Bindings"
- Select "1. Display Current Bindings"
View the persistent bindings
5
# vi /kernel/drv/sd.conf
Entry e.g:
name="sd" parent="lpfc" target="0" lun=1;
Update the sd.conf file with newly bound
LUN target and LUN ID values.
6 # reboot -- -r Reboot the Solaris server.
7
# sanlun lun show Verify the new LUN can be viewed from
the Solaris server. Locate and record the
controller, target, disk and slice
DOT 7 0 Cook Book_Rev1_0.doc Page 11
18 July 2006 Network Appliance Australia Pty Ltd ABN 14 092 499 431
information of the LUN.
8
# devfsadm
# sanlun lun show
If the devices are not located, re-scan for
devices. Check again for the LUN.
9 # reboot -- -r If required, reboot the Solaris server.
10
# format
* Select the appropriate disk
* Disk not labeled. Label it now? Y
* format> partition
* partition> modify
* "1. All Free Hog"
* Create the new partition? <CR>
* Free Hog partition [6]? <CR>
* Enter size of partition '0': 1c (1 Cylinder)
* Enter size of partition '1': <CR>