Vous êtes sur la page 1sur 356

3PAR InServ 2.3.

1 T-Class Storage Server Maintenance Manual

3PAR, Inc. 4209 Technology Drive Fremont, CA 94538 U.S.A.


Part No. 325-200090 Rev C August 2010

3PAR Confidential

Revision Notice
This is the third release of this manual. A complete revision history is provided at the end of this manual.

Changes
While reasonable efforts have been made in the preparation of this document to assure its accuracy, 3PAR Inc. assumes no liability resulting from errors or omissions or from the use of the information contained herein. 3PAR Inc. reserves the right to change the product design and documentation without reservation and without notification.

Updates to the Documentation at 3PAR Central


Any updates to this document, or other 3PAR technical documents, can be found by logging into 3PAR Central's Document Control System from 3PAR's Support page, at: http://support.3PAR.com.

3PAR Technical Support and Services


Contact your local service provider for technical support and services, at: http://www.3PAR.com/services.html.

Sales and Ordering Information


For sales and ordering information contact: 3PAR, Inc. 4209 Technology Drive Fremont, CA 94538 Telephone: 5104135999 Fax: 5104135699 E-mail: salesinfo@3PAR.com

Reader Comments and Suggestions


Please E-mail your comments and suggestions about this document to ReaderComments@3PAR.com.

Copyright Printed Material


Copyright 2009-2010, 3PAR Inc. All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording or otherwise, without the prior written consent of 3PAR Inc., 4209 Technology Drive, Fremont, CA 94538. The users may print one copy for personal use. Production of multiple copies or copies for sale is strictly prohibited.

Trademarks
3PAR, InServ, InForm, InSpire and Serving Information are registered trademarks of 3PAR Inc. Microsoft, Windows, Windows 2000, and Windows NT are either registered trademarks or trademarks of Microsoft Corporation. NEMA is a registered trademark of National Electrical Manufacturers Association. SecureCRT is a registered trademark of VanDyke Software, Inc. UL is a registered trademark of Underwriters Laboratories Inc. All other trademarks and registered trademarks are owned by their respective owners.

Federal Communications Commission Radio Frequency Interference Statement


WARNING: Changes or modifications to this unit not expressly approved by the party responsible for compliance could void the users authority to operate the equipment. This device complies with Part 15 of FCC Rules. Operation is subjected to the following two conditions (1) this device may not cause harmful interference, and (2) this device must accept any interference received, including interference that may cause undesired operation. This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense.

3PAR Confidential

Canadian Compliance Statement


This ClassA digital apparatus meets all requirements of the Canadian Interference-Causing Equipment Regulations. Cet appareil numrique de la classe A respecte toutes les exigences du Rglement sur le matrial brouilleur du Canada.

Japanese Compliance Statement

This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment (VCCI). If this equipment is used in a domestic environment, radio disturbance may arise. When such trouble occurs, the user may be required to take corrective actions.

European Compliance Statement:


This product complies with CENELEC EN55022 Class A and EN55024:1998/A1:2001 specifications for Information Technology Equipment (ITE). WARNING: This is a Class A product. In a domestic environment, this product may cause radio interference in which case the user may be required to take adequate measures.

3PAR Confidential

3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Table of Contents
1 Introduction
1.1 Related Documentation 1.2 Organization 1.3 Typographical Conventions 1.4 Advisories 1.5 Using this Guide 1.2 1.3 1.5 1.6 1.6

2 Precautions
2.1 General Precautions 2.2 Disk and Drive Magazine Precautions 2.3 Controller Node Precaution 2.4 Clock Battery Precaution 2.5 Drive Chassis and Node Power Supply Precaution 2.6 Battery Backup Unit Precautions 2.7 Power Distribution Unit Precautions 2.8 AC Cord Precaution 2.2 2.3 2.4 2.4 2.5 2.5 2.6 2.6

3 Connecting the Maintenance PC


3.1 Connecting to a Controller Node 3.2

Table of Contents

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

3.2 Connecting to the Service Processor


3.2.1 3.2.2 Using a Serial Connection Using an Ethernet Connection 3.2.2.1 3.2.3 Logging into the SP Onsite Customer Care Interface (SPOCC)

3.9 3.9 3.17 3.22 3.24 3.24 3.27 3.30 3.30 3.31

Using a Secure Shell Protocol 3.2.3.1 3.2.3.2 Using PuTTy Using Secure CRT

3.3 Serial Cable Pinouts


3.3.1 3.3.2 Crossover Adapter Assembly Straight-Through Adapter

4 Understanding LED Status


4.1 Using the Component LEDs
4.1.1 4.1.2 Removing the Bezels and Unlocking the Door Drive Cage LEDs 4.1.2.1 4.1.2.2 4.1.3 4.1.4 4.1.5 4.1.6 4.1.7 4.1.8 DC4 Drive Cage FC-AL Module LEDs Drive Magazine LEDs

4.2 4.2 4.3 4.4 4.7 4.9 4.12 4.13 4.14 4.16 4.17 4.18 4.18 4.19 4.21

Controller Node LEDs QLogic iSCSI Port LEDs 3PAR Fibre Channel Port LEDs Power Supply LEDs Battery Backup Unit LEDs Power Distribution Unit Lamps

4.2 Service Processor LEDs


4.2.1 4.2.2 4.2.3 Wintec Service Processor Supermicro Service Processor Supermicro II Service Processor

5 Powering Down the Storage Server


5.1 General Precautions 5.2 Power-Down Procedure 5.1 5.2

vi

Table of Contents

3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Drive Chassis Maintenance Procedures


6 Replacing a Disk on a Drive Magazine
6.1 General Precautions 6.2 Planning
6.2.1 Logging Mode

6.1 6.2 6.2 6.3

6.3 Drive Replacement Procedure

7 Replacing a Drive Magazine


7.1 General Precautions 7.2 Planning
7.2.1 Logging Mode

7.1 7.2 7.2 7.3

7.3 Drive Magazine Replacement Procedure

8 Replacing an SFP Module on an FC-AL


8.1 General Precautions 8.2 SFP Module Replacement Procedure 8.2 8.2

9 Replacing a Drive Cage FC-AL Module


9.1 General Precautions 9.2 FC-AL Replacement Procedure 9.1 9.2

10 Replacing a Drive Cage Midplane Assembly


10.1 General Precautions 10.2 Planning 10.3 Migrating Data Off the Drive Cage 10.4 Midplane Assembly Replacement Procedure 10.5 Migrating Data Back to the Drive Cage 10.1 10.2 10.2 10.6 10.11

11 Replacing a Controller Node


11.1 General Precautions 11.2 Controller Node Replacement Procedure 11.1 11.2

Table of Contents

vii

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Controller Node Maintenance Procedures


12 Replacing an SFP on a PCI Adapter
12.1 General Precautions 12.2 SFP Module Replacement Procedure 12.1 12.2

13 Replacing a PCI Adapter


13.1 General Precautions 13.2 PCI Adapter Replacement Procedure 13.1 13.2

14 Replacing Control Cache


14.1 General Precautions 14.2 Control Cache Replacement Procedure 14.1 14.2

15 Replacing Data Cache


15.1 General Precautions 15.2 Data Cache Replacement Procedure 15.1 15.2

16 Replacing a Data Cache Riser Card


16.1 General Precautions 16.2 Data Cache Riser Card Replacement Procedure 16.1 16.2

17 Replacing a Disk in a Node


17.1 General Precautions 17.2 Node Disk Replacement Procedure
17.2.1 Performing Node Rescue

17.1 17.2 17.4

18 Replacing a Clock Battery


18.1 General Precautions 18.2 Clock Battery Replacement Procedure 18.1 18.1

19 Replacing a Controller Node Chassis


19.1 General Precautions 19.2 Removing a Controller Node Chassis 19.1 19.2

viii

Table of Contents

3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

19.3 Unpacking a Controller Node Chassis 19.4 Installing a Replacement Controller Node Chassis

19.7 19.9

20 Replacing a Controller Node Power Supply


20.1 General Precautions 20.2 Controller Node Power Supply Replacement Procedure 20.1 20.2

Power System Maintenance Procedures


21 Replacing a Drive Chassis Power Supply
21.1 General Precautions 21.2 Drive Chassis Power Supply Replacement Procedure 21.2 21.2

22 Replacing a Battery Backup Unit


22.1 General Precautions 22.2 Battery Backup Unit Replacement Procedure 22.1 22.2

23 Replacing a Power Distribution Unit


23.1 General Precautions 23.2 Replacing PDUs in Cabinets that only have Rear PDUs 23.3 Replacing PDUs in Cabinets that have Front and Rear PDUs 23.1 23.2 23.8

24 Replacing an AC Cord
24.1 General Precautions 24.2 AC Cord Replacement Procedure 24.1 24.2

Service Processor Maintenance Procedures


25 Service Processor Replacement and Upgrade
25.1 General Precautions 25.2 Replacing a Service Processor
25.2.1 Replacing a Service Processor

25.1 25.2 25.2

Table of Contents

ix

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Appendices
A Tools
A.1 Tools Required for Performing Maintenance A.1

B Guided Maintenance
B.1 Overview B.2 Accessing Guided Maintenance B.1 B.3

C Removing and Replacing a Controller Node


C.1 C.2 C.3 General Precautions Removing a Controller Node Replacing a Serviced Controller Node C.1 C.2 C.5

D Node Rescue
D.1 D.2 Performing an Auto-Node Rescue Performing Manual Node Rescue D.2 D.7

Locking Fascia
E.1 Locking Fascia
E.1.1 E.1.2 E.1.3 Converting a Cabinet from Standard to Locking Fascias Removing the Locking Fascia Replacing the Locking Fascia

E.2 E.2 E.3 E.4 E.6 E.6 E.8 E.10

E.2

Locking Fascia II
E.2.1 E.2.2 E.2.3 Converting a Standard Cabinet to a Locking Fascia II Removing the Locking Fascia Replacing the Locking Fascia

F Illustrated Parts Catalog


F.1 F.2 F.3 F.4 Storage Server Frame Components Drive Chassis Components Internal Node Components Miscellaneous Components F.2 F.6 F.10 F.14

Table of Contents

3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

G Agency Compliance Statements


G.1 Safety Precautions G.2 Safety Agency Compliance Notices
G.2.1 G.2.2 G.2.3 G.2.4 System Placement and Security Battery Replacement and Disposal Controller Nodes Drive Chassis

G.2 G.2 G.2 G.5 G.8 G.13 G.16 G.16

G.3 3PAR Power Cables G.4 Japan Green Law Statement of Compliance

IX RH

Index Revision History

Table of Contents

xi

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

xii

Table of Contents

3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

1 Introduction
In this chapter
1.1 Related Documentation 1.2 Organization 1.3 Typographical Conventions 1.4 Advisories 1.5 Using this Guide 1.2 1.3 1.5 1.6 1.6

Introduction

1.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

1.1 Related Documentation


The following documents provide additional information related to 3PAR InServ Storage Servers:
Table 1-1. Related Documents

For information about Upgrading the InServ Storage Server

Read the 3PAR InServ T-Class Storage Server Upgrades Guide

Using the InForm Command Line Interface (CLI) to configure and manage the InServ Storage Server Understanding the InServ Storage Server and its features Using the InForm Management Console (IMC) user interface to configure and administer InServ Storage Servers CLI commands and their usage

3PAR InForm OS CLI Administrators Manual 3PAR InForm OS Concepts Guide

3PAR InForm Management Console Online Help

3PAR InForm OS Command Line Interface Reference

Identifying InServ Storage Server components and fixing problems Using 3PAR Remote Copy

3PAR InForm OS Messages and Operators Guide: Service Edition 3PAR Inform OS Remote Copy Users Guide

1.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

1.2 Organization
The procedures in this guide are divided into four sections and seven appendices.

Chapter 1, Introduction (this chapter), provides an overview of this manual, including information on audience, document conventions, and related documentation.

Chapter 2, Precautions, provides general safety instructions, which should be followed before attempting any procedure in this guide.

Chapter 3, Connecting the Maintenance PC, describes the procedure for connecting and configuring the Maintenance PC to perform maintenance procedures on the storage server.

Chapter 4, Understanding LED Status, describes the storage servers component LEDs. Chapter 5, Powering Down the Storage Server, provides instructions on safely powering down the storage server in order to perform maintenance on the servers components.

Drive Chassis Maintenance Procedures

Chapter 6, Replacing a Disk on a Drive Magazine, describes how to safely replace a disk drive on a drive magazine.

Chapter 7, Replacing a Drive Magazine, provides instructions on replacing a drive magazine.

Chapter 8, Replacing an SFP Module on an FC-AL, provides instructions on replacing a small form-factor pluggable transceiver (SFP) on an FC-AL.

Chapter 9, Replacing a Drive Cage FC-AL Module, details the procedure for replacing an FCAL module.

Chapter 10, Replacing a Drive Cage Midplane Assembly, provides instructions on replacing a failed drive cage midplane assembly.

Controller Node Maintenance Procedures


Chapter 11, Replacing a Controller Node, describes how to replace a failed controller node. Chapter 12, Replacing an SFP on a PCI Adapter, provides instructions on replacing a small form-factor pluggable transceiver (SFP) on a PCI adapter.

Chapter 13, Replacing a PCI Adapter, provides instructions on replacing a controller nodes fibre channel adapter.

1.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Chapter 14, Replacing Control Cache, provides instructions on replacing control cache DIMMs in a controller node.

Chapter 15, Replacing Data Cache, describes how to replace data cache DIMMs. Chapter 16, Replacing a Data Cache Riser Card, describes the procedure for replacing the data cache riser card in a controller node.

Chapter 17, Replacing a Disk in a Node, describes the procedure for safely replacing an disk in a controller node.

Chapter 18, Replacing a Clock Battery, describes how to replace the clock battery in a controller node.

Chapter 19, Replacing a Controller Node Chassis, provides instructions on safely replacing a controller node chassis.

Power System Maintenance Procedures

Chapter 21, Replacing a Drive Chassis Power Supply, describes the procedure for safely replacing a drive chassis power supply.

Chapter 20, Replacing a Controller Node Power Supply, describes the procedure for safely replacing a controller node power supply.

Chapter 22, Replacing a Battery Backup Unit, provides instructions on replacing the storage servers battery backup units.

Chapter 23, Replacing a Power Distribution Unit, describes how to safely replace a power distribution unit.

Chapter 24, Replacing an AC Cord, describes how to safely replace a failed AC cord.

Service Processor Maintenance Procedures

Chapter 25, Service Processor Replacement and Upgrade, describes the procedure for removing and replacing a service processor.

Appendices

Appendix A, Tools, lists the tools required for performing maintenance procedures. Appendix B, Guided Maintenance, describes how to use guided maintenance scripts. Appendix C, Removing and Replacing a Controller Node, describes how to safely handle, remove, and replace a controller node when servicing the nodes internal components.

1.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Appendix D, Node Rescue, describes the procedure to restore a controller node InForm OS. Appendix E, Locking Fascia, describes this optional feature and how to secure the InServ Storage Server.

Appendix F, Illustrated Parts Catalog, lists all field replaceable parts for InServ Storage Servers.

Appendix G, Agency Compliance Statements, contains safety precautions and agency compliance notices for InServ Storage Servers and storage server components.

This guide also contains an index and a revision history for your reference.

1.3 Typographical Conventions


The following typographical conventions are used in this guide:
Table 1-2. Typographical Conventions

Typeface ABCDabcd

Meaning Used for dialog box elements such as titles and button labels.

Example Enter your system name in the Value box and click OK .

ABCDabcd

Used for file names, paths, and screen output, and for text you are to enter.

3PAR(TM) InForm(R) OS <version> <sernum>-<nodeID> ttyS0 When prompted, type yes and press ENTER.

ABCDabcd

Used to contrast your input from screen output.

root@<sernum>-<nodeID># rootb

ABCDabcd ABCDabcd

Used for variables in file names, paths, and screen output, and variables in user input.

[root@(systemID-nodeID)root]

To continue Enter your system name ==> systemname

1.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

1.4 Advisories
Before performing any of the procedures described in this guide, read Appendix G, Agency Compliance Statements, to obtain important safety information. To avoid injury to people or damage to data and equipment, be sure to observe the cautions and warnings in this guide. Always be careful when handling any electrical equipment. The following types of alert messages are used to emphasize important information:

NOTE: Notes are reminders or suggestions that supplement the procedures included in this guide.

CAUTION: Cautions alert you to actions that can cause damage to equipment, software, or data.

WARNING: Warnings alert you to actions that can cause injury to people or irreversible damage to data or the operating system.

1.5 Using this Guide


The maintenance procedures described in this guide should only be used in instances where online guided maintenance is not available for the hardware that requires servicing. See Appendix B, Guided Maintenance, for a list of Field Replaceable Units (FRUs) with available guided maintenance.

1.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

2 Precautions
In this chapter
2.1 General Precautions 2.2 Disk and Drive Magazine Precautions 2.3 Controller Node Precaution 2.4 Clock Battery Precaution 2.5 Drive Chassis and Node Power Supply Precaution 2.6 Battery Backup Unit Precautions 2.7 Power Distribution Unit Precautions 2.8 AC Cord Precaution 2.2 2.3 2.4 2.4 2.5 2.5 2.6 2.6

Precautions

2.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

2.1 General Precautions


Follow these general precautions when servicing the InServ Storage Server to avoid injury, data loss, and damage to the server:

CAUTION: Field Replaceable Units (FRUs) should be within 10 C (18 F) of the temperature of the computer room before power is applied to them in an InServ system. This is especially true for disk drives. The maximum rate of change (gradient) in temperature for the FRU should be 10 C (18 F) per hour. See Table 2-1 for additional environmental specifications.

Table 2-1. Environmental Specifications for InServ Storage Servers

Specification Altitude Operating Non-operating Ambient temperature Operating

Value

010,000 ft (3,048 m) 040,000 ft (12,192 m)

50104 F (1040 C) 03,000 ft (914.4 m) 5095 F (1035 C) 3,00010,000 ft (9143,048 m)

Non-operating

40203 F (4095 C) 040,000 ft (012,192 m)

Temperature gradient Operating Non-operating Relative humidity 18 F/hr. (10 C/hr.) 18 F/hr. (10 C/hr.) 2080 percent noncondensing, maximum gradient 10 percent per hour

2.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

CAUTION: Using improper tools can result in damage to the storage server. See the tools list in Appendix A, Tools.

Prepare an Electrostatic Discharge-safe (ESD) work surface by placing an antistatic mat on the floor, or table, near the InServ Storage Server. Attach the ground lead of the mat to an unpainted surface of the rack.

Always use a wrist grounding strap. A wrist grounding strap is provided with the InServ Storage Server. Attach the grounding strap clip directly to an unpainted surface of the rack.

Avoid contact between electronic components and clothing, which can carry an electrostatic charge.

If applicable, ensure all cables are properly labeled and easily identifiable prior to removing a component.

2.2 Disk and Drive Magazine Precautions


You should always observe caution when handling drive magazines. When carrying a drive magazine, always support it with both hands. With the solid back panel of the magazine facing you and with one hand on the handle, support the bottom of the magazine with your other hand.

CAUTION: If you require more than 30 minutes to replace a disk on a drive magazine, install a drive magazine filler panel over the empty drive magazine slot to prevent overheating while you are working. See the 3PAR InServ T-Class Storage Server Installation, Deinstallation, and Upgrade Guide for filler panel installation procedures.

CAUTION: To avoid damage to hardware and the loss of data, never remove a drive magazine from the InServ Storage Server without confirming that the hotplug LED on the drive magazine is lit.

2.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

CAUTION: To avoid potential damage to equipment and loss of data, handle disks and drive magazines carefully.

2.3 Controller Node Precaution


Use both hands to carry controller nodes. With one hand on the node handle, support the bottom of the controller node with your other hand.

CAUTION: To avoid potential damage to equipment and loss of data, handle controller nodes carefully.

2.4 Clock Battery Precaution


When replacing a controller node clock battery, observe the following precaution:

WARNING: The lithium coin battery may explode if it is incorrectly installed in the controller node. Replace the coin battery only with an equivalent type recommended by 3PAR.

WARNING: Dispose of used batteries according to the manufacturers instructions.

2.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

2.5 Drive Chassis and Node Power Supply Precaution


When handling a power supply, observe the following precaution:

CAUTION: To prevent overheating, this procedure requires a maximum service time of 10 minutes.

2.6 Battery Backup Unit Precautions


When handling a Battery Backup Unit (BBU), observe the following precautions:

WARNING: Do not attempt to disassemble the BBU. If a battery string inside the unit fails, you must replace the entire battery backup unit.

WARNING: Battery backup units are heavy. Use care when replacing them.

CAUTION: Verify the storage server cabinet is completely immobilized before removing battery backup units. For storage servers with 3PAR cabinets, confirm that the leveling feet at the bottom of the cabinet rest firmly on the ground before removing a BBU.

The BBU requires 10 hours to become fully charged. The battery charge increases by 10 percent each hour. When both backup batteries of a node are fully discharged, the cache size on all nodes is set to 0 and all requests from the host are in write through mode. As batteries recharge and the available battery charge increases, cache size is increased in 10 percent increments and write-caching is enabled.

2.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

2.7 Power Distribution Unit Precautions


When handling a Power Distribution Unit (PDU), observe the following precautions:

WARNING: Do not operate a storage server if any of the main power cords show evidence of damage or wear. Immediately replace all PDUs that have a damaged or worn power cord.

WARNING: To avoid possible injury, damage to storage server equipment, and potential loss of data, do not use the surplus power outlets in the storage server PDUs. Never use outlets in the PDUs to power components that do not belong to the storage server or to power storage server components that reside in other cabinets.

2.8 AC Cord Precaution


When handling an AC cord, observe the following precaution:

WARNING: To avoid serious injury, never touch a damaged power cord before switching off the PDU and power supply connected to the damaged cord.

2.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

3 Connecting the Maintenance PC


In this chapter
3.1 Connecting to a Controller Node 3.2 Connecting to the Service Processor 3.2.1 Using a Serial Connection 3.2.2 Using an Ethernet Connection 3.2.2.1 Logging into the SP Onsite Customer Care Interface (SPOCC) 3.2.3 Using a Secure Shell Protocol 3.2.3.1 Using PuTTy 3.2.3.2 Using Secure CRT 3.3 Serial Cable Pinouts 3.3.1 Crossover Adapter Assembly 3.3.2 Straight-Through Adapter 3.2 3.9 3.9 3.17 3.22 3.24 3.24 3.27 3.30 3.30 3.31

Many of the maintenance procedures described in this manual require the use of a separate maintenance PC to issue CLI commands to perform and verify maintenance procedures. This chapter describes procedures for connecting and configuring the maintenance PC.

Connecting the Maintenance PC

3.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

3.1 Connecting to a Controller Node


The maintenance PC connects directly to a controller node through a serial cable using terminal emulation software such as HyperTerminal. To connect the maintenance PC to a node: 1 2 Remove the bezel that covers the controller node chassis. Insert a standard Category 5 cable into the maintenance port of one of the controller nodes as shown in Figure 3-1.

Maintenance Port (C0)

0589_L_R2

Figure 3-1. Location of the Maintenance Port

NOTE: A cable with adapter (P/N 180-0055) should be connected to the SP. Disconnect the Ethernet cable from the RJ-45 to DB-9 adapter attached to the SP (P/N 180-0059).

3.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Attach a DB9 female to RJ45 serial adapter assembly (P/N 1800055) to the free end of the Ethernet cable and then insert the adapter into the DB9 serial port (COM 1) of the maintenance PC, see Figure 3-2.

Node
C0 Serial Port Ethernet Cable Crossover Adapter (P/N 180-0055) Maintenance PC (Laptop)
0659_L_R1

Figure 3-2. Connecting the Ethernet Cable

4 5

Power on the maintenance PC. On the taskbar, choose Start > Programs > Accessories > Communications > HyperTerminal.

3.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

In the Connection Description dialog box, enter a session name in the Name box for which you are configuring the maintenance PC, and then click OK (Figure 3-3).

0167_S_R1

Figure 3-3. Entering a Session Name

3.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

In the Connect To dialog box, select serial port COM1 from the Connect using list, and then click OK (Figure 3-4).

0168_S_R1

Figure 3-4. Selecting Serial Port COM1

3.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

In the COM1 Properties dialog box, select 57600 from the Bits per second list and select Xon/Xoff from the Flow control list, then click OK (Figure 3-5).

0169_S_R1

Figure 3-5. Configuring Serial Port COM1

HyperTerminal establishes a serial connection with the controller node to which the maintenance PC is physically connected.

3.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Press ENTER to display the login prompt in the terminal window. A display similar to the one shown in Figure 3-6 appears.

0286_S_R1

Figure 3-6. HyperTerminal Login Prompt

3.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

10 In the HyperTerminal main window, click File and then click Properties . The New Session Properties dialog box appears (Figure 3-7).

0171_S_R1

Figure 3-7. New Session Properties Dialog Box

3.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

11 Click the Settings tab. From the Emulation list, select either ANSI or VT100 to set the session emulation type, then click OK . 12 Enter your login ID and password to begin maintenance procedures.

NOTE: If you do not have a login ID and password, contact your 3PAR Authorized Service Provider.

3.2 Connecting to the Service Processor


The maintenance PC can connect to the service processor either through a serial connection or through the Local Area Network (LAN). After you are connected, you can use a terminal emulation program to communicate with the service processor.

NOTE: Connecting to the service processor through the LAN (Ethernet) requires establishing a Secure Shell Session (SSH). If you do not have SSH, connect to the serial port of the service processor.

3.2.1 Using a Serial Connection


To connect the maintenance PC to the service processor using HyperTerminal through a serial connection: 1 Unlock the rear door of the storage server cabinet. Open the door by unlatching the three latches located at the top, center, and bottom of the door. 2 Locate the service processor. Attach the DB9 female serial adapter (P/N 1800055), that is at the free end of the blue Ethernet cable, to the Serial port on your maintenance PC. A standard Category 5 Ethernet cable with the appropriate RJ45 to DB9 adapters at each end should already be connected to the service processor's DB9 Serial port.

3.9
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

If necessary, insert a standard Category 5 Ethernet cable into the service processor serial port with the DB9 female to RJ45 adapter (P/N 1800059). See Figure 3-8 or Figure 3-9 or Figure 3-10 for the location of the serial port on the service processor.

NOTE: See Serial Cable Pinouts on page 3.30 for serial cable pinout diagram.

Serial Port with DB9 Female to RJ45 Adapter (P/N 180-0059-01)


0165_L_R2

Figure 3-8. Wintec Service Processor Serial Port with Adapter

Serial Port with DB9 Female to RJ45 Adapter (P/N 180-0059-01)


0636_L_R1

Figure 3-9. Supermicro Service Processor Serial Port and Adapter

Serial Port with DB9 Female to RJ45 Adapter (P/N 180-0059-01)


0805_L_R1

Figure 3-10. Supermicro II Service Processor Serial Port and Adapter

3.10
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

A standard Category 5 Ethernet cable may already be connected to the DB9 female to RJ45 adapter (Figure 3-11).
Service Processor 180-0059 Blue Ethernet Cable 180-0055 Maintenance PC (Laptop)
0341_L_R1

Figure 3-11. Attaching the Blue Ethernet Cable

4 5

Power on the maintenance PC. On the taskbar, choose Start > Programs > Accessories > Communications > HyperTerminal.

3.11
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

In the Connection Description dialog box, enter a session name in the Name box for the maintenance PC you are configuring, then click OK (Figure 3-12).

0167_S_R1

Figure 3-12. Entering a Session Name

3.12
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

In the Connect To dialog box, select serial port COM1 from the Connect using list, then click OK (Figure 3-13).

0168_S_R1

Figure 3-13. Selecting Serial Port COM1

3.13
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

In the COM1 Properties dialog box, select 38400 from the Bits per second list and select Xon/Xoff from the Flow control list, then click OK (Figure 3-14).

38400

0169_S_R2

Figure 3-14. Configuring Serial Port COM 1

HyperTerminal establishes a serial connection with the service processor to which the maintenance PC is physically connected.

3.14
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Press ENTER to display the login prompt in the terminal window. A display similar to the one shown in Figure 3-15 appears.

0660_S_R1

Figure 3-15. HyperTerminal Login Prompt

3.15
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

10 In the HyperTerminal main window, click File and then click Properties . The New Session Properties dialog box opens (Figure 3-16).

0171_S_R1

Figure 3-16. New Session Properties Dialog Box

3.16
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

11 Click the Settings tab. From the Emulation list, select either ANSI or VT100 to set the session emulation type, then click OK . 12 Enter your login ID and password to begin the maintenance procedures.

NOTE: If you do not have a login ID and password, contact your 3PAR Authorized Service Provider.

3.2.2 Using an Ethernet Connection


To connect the maintenance PC to the service processor through the private Local Area Network using an Ethernet cable, you must first configure the LAN settings on the maintenance PC. To configure the LAN settings on the maintenance PC: 1 Unlock and open the rear door of the storage server cabinet.

If necessary, insert a red crossover Category 5 Ethernet cable (RJ45 to RJ45) into the proper Ethernet port of the SP (ETH1), see Figure 3-17 or Figure 3-18 or Figure 3-19.

Eth-1 (Int) Eth-0 (Ext)


0166_L_R2

Figure 3-17. Wintec Service Processor Ethernet Ports

Eth-1 (Int) Eth-0 (Ext)


0638_L_R1

Figure 3-18. Supermicro Service Processor Ethernet Ports

3.17
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Eth-1 (Int) Eth-0 (Ext)


0806_L_R1

Figure 3-19. Supermicro II Service Processor Ethernet Ports

NOTE: The Supermicro and Wintec Service Processor Ethernet port (ETH0) corresponds with the front NIC Port LED 1 and Ethernet port (ETH1) corresponds with the front NIC Port LED 2.

Connect the free end of the crossover Ethernet cable to the Ethernet port in the maintenance PC.

Power on the maintenance PC.

3.18
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

4 5

Right-click the My Network Places desktop icon to bring up the shortcut menu. Click Properties . The Network and Dial-up Connections window appears (Figure 3-20).

0172_S_R1

Figure 3-20. Network and Dial-Up Connections Window

3.19
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Right-click the Local Area Connection icon to bring up the Local Area Connections Properties menu.

Click Properties . The Local Area Connection Properties dialog box appears (Figure 3-21).

0173_S_R1

Figure 3-21. Local Area Connection Properties Dialog Box

3.20
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Double-click Internet Protocol (TCP/IP) . The Internet Protocol (TCP/IP) Properties dialog box appears (Figure 3-22).

0174_S_R1

Figure 3-22. Internet Protocol (TCP/IP) Properties Box

3.21
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

In the Internet Protocol (TCP/IP) Properties dialog box, click the Use the following IP address button and then type the following IP addresses:

Table 3-1. IP Addresses

IP address Subnet mask Default gateway

10.255.155.49 255.255.255.248 None.

10 Click OK . 11 Click OK in the Advanced TCP/IP Settings dialog box to finish configuring the LAN connection.

3.2.2.1 Logging into the SP Onsite Customer Care Interface (SPOCC)


After the Ethernet connection is configured for the service processor, log in to the Service Processor Onsite Customer Care (SPOCC) interface from the maintenance PC using a supported Web browser. SPOCC and SPMAINT are two of the service processor user interfaces. These interfaces enable you to perform various administrative and diagnostic tasks in support of both the InServ Storage Server and the service processor. To log in to SPOCC using a Web browser: 1 Type the IP address of the service processor in the Web browser and press ENTER.

NOTE: If you are using the crossover cable to the service processors ETH1 (Int) port, use IP address 10.255.155.54.

3.22
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

The Service Processor Login screen appears (Figure 3-23).

0177_S_R1

Figure 3-23. Service Processor Login Screen

Click the Login button. The Enter Network Password dialog box appears.

Type your user name and password and click OK .

NOTE: If you do not have a user name and password, contact your 3PAR Authorized Service Provider.

3.23
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

3.2.3 Using a Secure Shell Protocol


After the Ethernet connection is configured for the service processor, also initiate a Secure Shell Session (SSH) using PuTTy or SecureCRT. The following sections describe the various methods for obtaining an SSH connection to the service processor.

3.2.3.1 Using PuTTy


Follow these steps to initiate a secure shell session between the maintenance PC and the service processor using PuTTY: 1 Go to the permanent location where you extracted putty.zip and double-click the putty.exe file (Figure 3-24).

0183_S_R1

Figure 3-24. Launching the PuTTY Application

3.24
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

In the PuTTY Configuration dialog box that appears, type the service processor IP address in the Host Name (or IP address ) box, click the SSH protocol button, then click Open (Figure 3-25).

0184_S_R1

Figure 3-25. PuTTY Configuration Dialog Box

3.25
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

If you are connecting to the service processor for the first time, the PuTTY Security Alert dialog box appears. Click Yes (Figure 3-26).

0185_S_R1

Figure 3-26. PuTTY Security Alert Dialog Box

The PuTTY main window appears (Figure 3-27).

0186_S_R1

Figure 3-27. PuTTY Main Window Login Screen

3.26
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Type your user ID and press ENTER, then type your password and press ENTER.

NOTE: If you do not have a user ID and password, contact your 3PAR Authorized Service Provider.

3.2.3.2 Using Secure CRT


To initiate a secure shell session between the maintenance PC and the service processor, use SecureCRT: 1 2 On the taskbar, choose Start > Programs > SecureCRT > SecureCRT. In the SecureCRT window, click the Quick Connect icon (Figure 3-28).

0187_S_R1

Figure 3-28. SecureCRT Window

3.27
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

In the Quick Connect dialog box that appears, select ssh2 from the Protocol list, type the IP address of the service processor in the Hostname box, type your user ID in the Username box, then click Connect (Figure 3-29).

NOTE: If you are using the service processors private network (crossover cable to ETH1) then use IP address 10.225.155.54.

0188_S_R1

Figure 3-29. Quick Connect Dialog Box

3.28
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

In the Enter Password dialog box, type your password and click OK .

NOTE: If you do not have a user ID and password, contact your 3PAR Authorized Service Provider.

A window similar to the following appears (Figure 3-30).

0190_S_R2

Figure 3-30. Secure CRT Session

3.29
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

3.3 Serial Cable Pinouts


The following tables and diagrams illustrate the serial cable pinouts for the crossover DB9 female serial to RJ45 adapter assembly (P/N 1800055) and the straight-through DB9 to RJ45 serial adapter (P/N 1800059).

3.3.1 Crossover Adapter Assembly


The following table lists cable pinouts for the crossover DB9 female serial to RJ45 adapter assembly (P/N 1800055). This connector inserts into the COM port on the maintenance PC.
Table 3-2. Crossover DB9 Female Serial to RJ45 Serial Connector Pinouts

Color Black Orange Green

DB9 (Female) Pin 2 3 5

RJ45 Pin 3 2 5

Figure 3-31 illustrates the pin locations and connections for the crossover DB9 female serial to RJ45 adapter assembly (P/N 1800055).
DB9 RJ45

1 6 2 7 3 8 4 9 5 DB9 Pin 5 (Green) DB9 Pin 3 (Orange) RJ45 Pin 5 (Green) 6 7 8 RJ45 Pin 3 (Black) DB9 Pin 2 (Black) RJ45 Pin 2 (Orange) 2 3 4 5 1

0162_L_R2

Figure 3-31. Crossover DB9 Female Serial to RJ45 Serial Connector Pinouts

3.30
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

3.3.2 Straight-Through Adapter


The following table lists connector pinouts for the straight-through DB9 to RJ45 adapter (P/N 1800059). This connector inserts into the COM port on the service processor.
Table 3-3. Straight-Through DB9 to RJ45 Adapter Serial Cable Pinouts

Color Orange Black Green

DB9 (Female) Pin 2 3 5

RJ45 Pin 2 3 5

Figure 3-32 illustrates the pin locations and connections for the straight-through DB9 to RJ45 adapter (P/N 1800059).
DB9 RJ45

1 6 2 7 3 8 4 9 5 DB9 Pin 5 (Green) DB9 Pin 3 (Black) RJ45 Pin 5 (Green) 6 7 8 RJ45 Pin 3 (Black) DB9 Pin 2 (Orange) RJ45 Pin 2 (Orange) 2 3 4 5 1

0163_L_R2

Figure 3-32. Straight-Through DB9 to RJ45 Serial Connector Pinouts

3.31
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

3.32
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

4 Understanding LED Status


In this chapter
4.1 Using the Component LEDs 4.1.1 Removing the Bezels and Unlocking the Door 4.1.2 Drive Cage LEDs 4.1.3 Controller Node LEDs 4.1.4 QLogic iSCSI Port LEDs 4.1.5 3PAR Fibre Channel Port LEDs 4.1.6 Power Supply LEDs 4.1.7 Battery Backup Unit LEDs 4.1.8 Power Distribution Unit Lamps 4.2 Service Processor LEDs 4.2.1 Wintec Service Processor 4.2.2 Supermicro Service Processor 4.2.3 Supermicro II Service Processor 4.2 4.2 4.3 4.9 4.12 4.13 4.14 4.16 4.17 4.18 4.18 4.19 4.21

Understanding LED Status

4.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

4.1 Using the Component LEDs


InServ Storage Server components have LEDs to indicate whether or not the hardware is functioning properly and to help identify errors. These LEDs serve as tools for diagnosing basic hardware problems. You can quickly identify hardware problems by simply examining the LEDs on all the components. Use the tables and diagrams in the following sections to determine if the hardware is functioning properly. If you detect any problems during inspection of the LEDs, contact your 3PAR Authorized Service Provider.

4.1.1 Removing the Bezels and Unlocking the Door


An optional locking fascia kit may be installed on the storage server. If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

WARNING: Hazardous energy is located behind the rear access door of the storage server cabinet. Use caution when working with the door open.

To view the node, drive chassis or service processor LEDs, remove the bezels. To view the power supply, battery or power distribution unit LEDs, open the rear door by unlatching the three latches of the door (T800 Storage Servers contain PDUs in the front and rear of the cabinet).

4.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

4.1.2 Drive Cage LEDs


The DC4 drive chassis holds one DC4 drive cage housing with two drive cage FC-AL modules and a maximum of ten drive magazines. See Figure 4-1.
Drive Magazines 0 1 2 3 4 5 6 7 8 9

Ports B0 A0

0588_L_R2

Ports A1 B1

Figure 4-1. DC4 Drive Cage

4.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

4.1.2.1 DC4 Drive Cage FC-AL Module LEDs


The DC4 drive cage FC-AL modules have the following LEDs (Figure 4-2):

Port A Port A RX LED Port B Port B RX LED FC-AL Status LED Split Mode LED Port B TX LED Hot-Plug LED 4 Gb/s Port A TX LED

(Typical)
0655_L_R1

Figure 4-2. Connections and LEDs on the DC4 Drive Cage FC-AL Modules

4.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Consult Table 4-1 to verify proper functioning of the DC4 drive cage FC-AL modules.
Table 4-1. Drive Cage DC4 FC-AL Module LED Displays

LED RX

Appearance Steady green light

Meaning Indicates the presence of a small form-factor pluggable optical transceiver (SFP) and a valid signal from the node.

No light

Indicates no connection to the node or no SFP is installed.

TX

Steady green light

Indicates the presence of an SFP and the LED is on and transmitting.

No light

Indicates no SFP is present or the SFP transmitter failed.

FC-AL status

Steady green light

Indicates the drive cage is functioning properly, but is not communicating with other nodes.

Flashing green light (1 blink per second)

Indicates the cage is connected and communicating with the system manager of a node in the cluster.

Steady amber light

Normal, initial indication for two seconds upon power up. Otherwise, indicates FC-AL module error or other cage error. If both FC-AL modules have a steady light, the temperature of a disk drive has exceeded 55C, or a power supply has failed.

4.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Table 4-1. Drive Cage DC4 FC-AL Module LED Displays (continued)

LED

Appearance Flashing amber light (1 blink per second)

Meaning The drive cage has some type of error, such as a failed or missing power supply, but is communicating with a node.

Rapid toggle between amber and green light

Indicates a cage firmware upgrade initiated by the

upgradecage CLI command is in


progress. A firmware upgrade normally takes less than two minutes to complete. Hot-plug Steady amber light Indicates the FC-AL module is prepared for replacement (hot plug). No light Indicates the FC-AL module is not prepared for hot plug. Split Mode Steady green light Indicates the drive cage is split into two logical portions. No light Indicates the drive cage is not split. 4 GB/s Steady green light Indicates the transfer rate is operating at 4 Gb/s. No light Indicates the transfer rate is operating at 2 Gb/s.

4.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

4.1.2.2 Drive Magazine LEDs


Drive magazines contain the following LEDs (Figure 4-3):

Disk Status LEDs

Hot-Plug LED
3 2 1 0
!

Drive Magazine Status LED


0587_L_R1

DC4

Figure 4-3. DC4 Drive Magazine Status LEDs

4.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Consult Table 4-2 to verify proper functioning of disks and drive magazines.
Table 4-2. Drive Magazine LED Displays

LED Drive Magazine Status

Appearance Steady green light

Meaning Indicates the drive magazine is functioning properly.

Steady amber light

Indicates a drive magazine error, or one or more drives are bypassed on at least one path.

Disk status

Quick flashing, or 20 percent on, 80 percent off green light Steady green light

Indicates the disk is not spun up but has power. Indicates the disk is spun up and waiting for a command.

Flashing green light

Indicates the disk is executing commands.

No light Steady amber light

Indicates no disk is present. Indicates a disk error, or the disk is bypassed on both paths (loops).

Hot-plug

Steady amber light

Indicates the drive magazine is prepared for replacement (hotplug).

Flashing amber light

Indicates there is a connection failure between the drive magazine and the drive chassis.

No light

Indicates the magazine is not prepared for hot-plug.

4.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

NOTE: After powering on, allow approximately two minutes for the disks on the DC4 drive magazine to spin up before checking the drive magazine LEDs.

4.1.3 Controller Node LEDs


Depending upon the configuration, storage servers contain two, four, six, or eight controller nodes, all located in the storage server chassis. Controller nodes contain the following LEDs (Figure 4-4):

Ethernet 10/100/1000 Mbps LED Disk Hot-plug LED Node Hot-plug LED Node Status LED

Ethernet Activity LED


0571_L_R2

Figure 4-4. Controller Node LEDs

Consult Table 4-3 to verify proper functioning of controller nodes.

4.9
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Table 4-3. Controller Node LED Displays

LED Disk Hot-plug

Appearance Steady amber light

Meaning Indicates the node disk is prepared for hot-plug.

No light

Indicates the node disk is not prepared for hot-plug.

Node Hot-plug

Steady amber light

In combination with the Status LED blinking green three times per second, indicates the controller node is prepared for removal. In combination with the Status LED being solid, indicates a fatal node failure.

No light

Indicates the node is not prepared for removal.

Node status

Flashing green light (1 blink per second) Flashing amber light (1 blink per second)

Indicates the node is fully functional and part of the cluster. Indicates the node has a failed or missing power supply, fan, battery backup unit, or TOD battery but the node is still operational.

Steady green light

Indicates the node is in the process of joining the cluster.

Rapidly flashing green (3 blinks per second), in conjunction with the hotplug LED being solid amber.

Indicates the node is safe to remove.

4.10
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Table 4-3. Controller Node LED Displays (continued)

LED

Appearance Steady amber light Solid amber and hot-plug LED amber

Meaning Indicates an error within the node. Indicates a fatal node failure.

Ethernet activity

Steady green light Flashing green light No light

Indicates an Ethernet link. Indicates no Ethernet activity. Indicates no Ethernet connection. 1000 Mb/sec mode. 100 Mb/sec mode. 10 Mb/sec mode (or disconnected).

Ethernet 10/100/1000 Mbps

Steady amber light Steady green light No light

4.11
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

4.1.4 QLogic iSCSI Port LEDs


The QLogic iSCSI adapter contains two ports. There is one LED for each port as shown in Figure 4-5.

LEDs (2x) Port 1

Port 2

0514_L_R2

Figure 4-5. iSCSI Adapter Ports and LEDs Table 4-4. iSCSI Adapter Port LED Meanings

LED Appearance Steady Green Flashing Green No Light

Meaning Indicates a link is established. Indicates receiving or transmitting activity. Indicates no connection or active link.

4.12
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

4.1.5 3PAR Fibre Channel Port LEDs


The 3PAR Fibre Channel adapter contained in the controller node also contains Fibre Channel port LEDs (Figure 4-6).

Port 1

Port 4

LED (4x)

0256_L_R2

Figure 4-6. 3PAR 4-Port Fibre Channel LEDs

Consult Table 4-5 to verify the proper function of the 3PAR Fibre Channel adapter LED.
Table 4-5. 3PAR Fibre Channel Port Status LED Indications (3PAR 4-Port Adapter)

LED Appearance No Light Steady Green Light Flashing Green Light

Meaning Wake-up Failure (dead device). Normal -- Link up at 2-4 Gbps. Link down or not connected.

4.13
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

4.1.6 Power Supply LEDs


Power supply units are located at the rear of all drive cages and controller nodes.

Power supplies have the following LEDs (Figure 4-7):


AC LED Power Supply Status LED AC LED Power Supply Status LED

Drive Chassis Power Supply

Controller Node Power Supply


0632_L_R1

Figure 4-7. Power Supply LEDs

NOTE: The appearance of the power supplies can vary slightly according to manufacturer and location (drive chassis or controller node).

4.14
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Consult Table 4-6 to verify proper operation of the power supplies.


Table 4-6. Power Supply LED Displays

LED Power Supply Status

Appearance Steady green light Steady amber light No light

Meaning Indicates the power is on. Indicates a power supply error. Indicates a broken connection to the AC power source.

AC

Steady green light

Indicates the AC is entering from an external source.

No light

Indicates no AC is entering from an external source (for example, when power is off or when using battery power).

4.15
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

4.1.7 Battery Backup Unit LEDs


Depending on the configuration, storage servers with 3PAR cabinets include one or more battery trays that hold up to four Battery Backup Units (BBUs) apiece. BBUs supply power to write the cache memory to the drive inside the node in the event of a power failure. BBUs contain two batteries, labeled BATTERY A and BATTERY B. The BBUs also include the following LEDs (Figure 4-8):

Battery A Status LED Battery B Status LED

0260_L_R1

Figure 4-8. Battery Backup Unit LEDs

Consult Table 4-7 to verify the proper functioning of the BBUs.


Table 4-7. Battery Backup Unit LED Displays

LED Battery A Status LED

Appearance Steady green light Flashing green light

Meaning Indicates battery A is charged. Indicates the battery is undergoing a test.

Steady amber light No light

Indicates a battery error. BBUs or power supply is turned off.

4.16
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Table 4-7. Battery Backup Unit LED Displays (continued)

LED Battery B Status LED

Appearance Steady green light Flashing green light

Meaning Indicates battery B is charged. Indicates the battery is undergoing a test.

Steady amber light No light

Indicates a battery error. BBUs or power supply is turned off.

4.1.8 Power Distribution Unit Lamps


InServ Storage Servers include four Power Distribution Units (PDUs). PDUs contain two power bank lamps (Figure 4-9):
Power Bank Lamps

Power Bank 1

Power Bank 2
0261_L_R1

Figure 4-9. Power Distribution Unit Lamps

A blue illuminated lamp indicates that power is being supplied to a power bank. When the blue lamp is not illuminated, the power bank is not receiving AC input.

4.17
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

4.2 Service Processor LEDs


4.2.1 Wintec Service Processor
The Wintec service processor LEDs are defined in the following section. The LED's are located at the top of the Wintec service processor (Figure 4-10).
Power Button Reset Button Power LED NIC Port 1 LED NIC Port 2 LED Hard Disk Drive LED

0009_L_R2

Figure 4-10. Wintec Service Processor LEDs

Consult Table 4-8 to verify proper functioning of the Wintec service processor displays.

NOTE: The Wintec service processor NIC Port LEDs in front and Ethernet Ports in the rear are criss-crossed. NIC Port 2 corresponds with ETH1 and NIC Port 1 corresponds with ETH0.

Table 4-8. Wintec Service Processor Front-Panel Displays

LED Hard Disk

Appearance No light Flashing blue light

Meaning Indicates no hard drive activity. Indicates hard drive activity. Indicates no network activity. Indicates network activity.

NIC Port 2

No light Flashing amber light

4.18
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Table 4-8. Wintec Service Processor Front-Panel Displays (continued)

LED NIC Port 1

Appearance No light Flashing amber light

Meaning Indicates no network activity. Indicates network activity Indicates the system is off. Indicates the system is powered on.

Power

No light Steady blue light

4.2.2 Supermicro Service Processor


The Supermicro service processor LEDs are defined in the following section. The LEDs are located at the top of the service processor (Figure 4-11).
Power Button Reset Button Power LED Hard Disk Drive LED NIC Port 1 LED NIC Port 2 LED Overheat LED

0637_L_R1

Figure 4-11. Supermicro Service Processor LEDs

Consult Table 4-9 to verify proper functioning of the Supermicro service processor displays.

4.19
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Table 4-9. Supermicro Service Processor Front-Panel Displays

LED Power

Appearance No light Steady green light

Meaning Indicates the service processor is off. Indicates the service processor is on. Indicates no hard drive activity. Indicates hard drive activity. Indicates the port is not connected. Indicates the port is connected. Indicates network activity. Indicates the port is not connected. Indicates the port is connected. Indicates network activity. Indicates the service processor temperature is normal.

Hard Disk Drive

No light Flashing amber light

NIC Port 2

No light Steady green light Flashing green light

NIC Port 1

No light Steady green light Flashing green light

Overheat

No light

Steady red light

Indicates the service processor temperature is overheating.

4.20
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

4.2.3 Supermicro II Service Processor


The Supermicro II service processor LEDs are defined in the following section. The LEDs are located at the top of the service processor (Figure 4-12).
Power LED Hard Disk Drive LED NIC Port 1 LED NIC Port 2 LED Overheat LED

Reset Button Power Button


0802_L_R1

Figure 4-12. Supermicro II Service Processor LEDs

Consult Table 4-10 to verify proper functioning of the Supermicro II service processor displays.
Table 4-10. Supermicro II Service Processor Front-Panel Displays

LED Power

Appearance No light Steady green light

Meaning Indicates the service processor is off. Indicates the service processor is on. Indicates no hard drive activity. Indicates hard drive activity. Indicates the port is not connected. Indicates the port is connected and there is network activity.

Hard Disk Drive

No light Flashing amber light

NIC Port 2

No light Steady green light

Flashing green light

Indicates network activity.

4.21
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Table 4-10. Supermicro II Service Processor Front-Panel Displays (continued)

LED NIC Port 1

Appearance No light Steady green light

Meaning Indicates the port is not connected. Indicates the port is connected and there is network activity.

Flashing green light Overheat No light

Indicates network activity. Indicates the service processor temperature is normal.

Steady red light

Indicates the service processor is overheating.

Flashing red light

Indicates the service processor has a failed fan.

4.22
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

5 Powering Down the Storage Server


In this chapter
5.1 General Precautions 5.2 Power-Down Procedure 5.1 5.2

5.1 General Precautions


When powering down the storage server, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Powering Down the Storage Server

5.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

5.2 Power-Down Procedure


When it is necessary to remove power from the storage server, the following procedure describes how to safely remove power from the storage server and the service processor. To power-down the storage server: 1 Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the SP by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 4 5 6 Select option 4 , InServ Product Maintenance . Select option 6 , Halt an InServ cluster/node . Select the desired InServ and confirm all prompts to halt the system. Press x to return to the 3PAR Service Processor Menu . Allow 2 to 3 minutes for the InServ to halt, then verify the node status LEDs are flashing green and the node hot-plug LEDs are solid amber which indicate the nodes have halted (Figure 5-1).

Disk Hot-plug LED Node Hot-plug LED Node Status LED


0601_L_R3

Figure 5-1. Hot-Plug LED and Power Status LED

5.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

7 8 9

Select option 1 , SP Control/Status . Select option 3 , Halt SP. When prompted, press y to confirm halting the SP.

10 Wait approximately 30 seconds and verify if the LED on the front of the SP is no longer illuminated. 11 Remove AC to the storage server by turning off all eight PDU circuit breakers (two circuit breakers per PDU) in the cabinet (Figure 5-2).

Circuit Breaker CB-1

Circuit Breaker CB-2


0295_L_R2

Figure 5-2. PDU Circuit Breakers

If necessary: 12 Replace the bezel at the front of the server. 13 Close and lock the rear door of the server. 14 Replace and secure the front fascias on the storage server frame if applicable.

5.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

5.4
3PAR Confidential

Drive Chassis Maintenance Procedures

3PAR Confidential

3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

6 Replacing a Disk on a Drive Magazine


In this chapter
6.1 General Precautions 6.2 Planning 6.2.1 Logging Mode 6.3 Drive Replacement Procedure 6.1 6.2 6.2 6.3

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

6.1 General Precautions


When handling the disks and drive magazines, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing a Disk on a Drive Magazine

6.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

6.2 Planning
Replacing a disk requires preparation which can take between 2-12 hours to complete prior to the physical replacement procedure. This section provides helpful hints and estimated times for migrating data. The table below shows examples of the time allotment needed for running the CLI command

servicemag on disks at or near capacity (Table 6-1).


Table 6-1. Time Estimates for Running CLI Command servicemag on fully used drives

Drive Magazine Size 50 GB 146 GB 300 GB 500 GB or larger

Estimated Time Required 1 Hour or less 3 Hours 6 Hours 10 to 12 Hours

6.2.1 Logging Mode


For slower (NL) or large disks (NL or >146GB), it is recommended to use the -log option with the CLI servicemag command. Conditions for using Logging mode:

Use if only a single disk has failed. Use if the disk replacement can be completed within 30 minutes. Do not use if you have any RAID-0 sets on the drive magazine. Do not use if there are multiple failed disks or multiple problems.

Additional CLI commands:


Recommended CLI command: servicemag start -log -pdid <pd_id>. Use the -pdid option in conjunction to specify the disk to be replaced. This ensures the data vacates from the disk to be replaced.

6.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

6.3 Drive Replacement Procedure


To replace a disk on a drive magazine: 1 Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the SP by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 4 Select option 7 , Interactive CLI for an InServ. Select the desired InServ. Issue the showpd command. Verify the location of the failed disk and if there are adequate spare chunklets defined. NOTE: If there are not enough spare chunklets defined, contact your technical support representative for assistance.

cli% showpd Id 0 1 2 3 4 5 6 7 CagePos 0:0:0 0:0:1 0:0:2 0:0:3 0:1:0 0:1:1 0:1:0 0:1:1 Type Speed(K) State FC 10 normal FC 10 normal FC 10 normal FC 10 failed FC 10 normal FC 10 normal FC 10 normal FC 10 normal ----Size(MB)----Total Free 139520 119808 139520 122112 139520 119552 139520 117504 139520 119552 139520 122112 139520 119552 139520 122112 ----Ports---A B 0:0:1* 1:0:1 0:0:1 1:0:1* 0:0:1* 1:0:1 0:0:1 1:0:1* 0:0:1* 1:0:1 0:0:1 1:0:1* 0:0:1* 1:0:1 0:0:1 1:0:1*

...

6.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Issue the servicemag start -log -pdid <disk_id> command, where <disk_id> is the ID of the failed disk.

cli% servicemag start -log -pdid 3 Are you sure you want to run servicemag? select q=quit y=yes n=no: y servicemag start -log -pdid 3 ... servicing disks in mag: 0 3 ... valid disks: WWN [2000001D38B11AC7] .................... WWN [2000001D38B114FE] .................... WWN [2000001D38B119AB] .................... WWN [2000001D38B11277] ... not valid disks:

Id Id Id Id

[ [ [ [

1204] 1205] 1206] 1207]

diskpos diskpos diskpos diskpos

[0] [1] [2] [3]

The servicemag start operation will continue in the background.

To monitor progress, issue the servicemag status -d command.

cli% servicemag status -d Cage 0, magazine 0: The magazine was successfully brought offline by a servicemag start command. The command completed Thu Feb 11 10:49:30 2010. The output of the servicemag start was: servicemag start -log -pdid 3 ... servicing disks in mag: 0 3 ... normal disks: WWN [2000001D38B11AC7] Id [1204] diskpos [0] .................... WWN [2000001D38B114FE] Id [1205] diskpos [1] .................... WWN [2000001D38B119AB] Id [1207] diskpos [3] ... not normal disks: WWN [2000001D38B11277] Id [1206] diskpos [2] ... relocating chunklets to spare space... ... relocating chunklets from degraded raid sets to spare space ... relocating chunklets from degraded raid sets to spare space ... logging chunklets from pd WWN [2000001D38B11AC7] Id [0] ... logging chunklets from pd WWN [2000001D38B114FE] Id [1] ... logging chunklets from pd WWN [2000001D38B119AB] Id [2] ... retrying logging chunklets... ... spinning down disk WWN [2000001D38B11AC7] Id [0] ... spinning down disk WWN [2000001D38B114FE] Id [1] ... spinning down disk WWN [2000001D38B119AB] Id [2] ... spinning down disk WWN [2000001D38B11277] Id [3] ... bypassing mag 0 3 ... bypassed mag 0 3 servicemag start -log -pdid 3 -- Succeeded

6.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

When the command completes successfully, Succeeded is returned on the display, the hotplug LED on the drive magazine is illuminated, and the drive status LEDs on the drive magazine are blinking slowly (Figure 6-1).

Disk Status LEDs

Hot-Plug LED
3 2 1 0
!

Drive Magazine Status LED


0587_L_R1

DC4

Figure 6-1. DC4 Drive Magazine Status LEDs

To locate the drive cage, issue the locatecage cage<x> command to turn on all LEDs for a short duration, where <x> is the cage number. Drive magazine locations within the drive cage are shown in Figure 6-2.

6.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Remove the bezel from the front of the drive chassis.


Drive Magazines 0 1 2 3 4 5 6 7 8 9

0598_L_R2

Figure 6-2. DC4 Drive Magazine Locations in the Drive Cage

Prepare an Electrostatic Discharge-safe (ESD-safe) work area.

10 Wearing a wrist grounding strap, use a #2 Phillips screwdriver to loosen the captive screw that secures the drive magazine to the drive chassis housing (Figure 6-3).

Captive Screw

3 2 1 0

DC4
0591_L_R1

Figure 6-3. Loosening the Captive Screw on the Drive Magazine

6.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

11 With your right hand on the handle of the drive magazine and your left hand supporting the drive magazine from beneath, slide the magazine out of the drive chassis. 12 Place the drive magazine on an ESD-safe, level work surface with the solid back panel facing down. 13 Identify the disk requiring replacement. The disk status LEDs numbered on the front of the drive magazine corresponds to the disks mounted on the drive magazine. The numbers are also indicated along the side of the drive magazine, as shown in Figure 6-4.
DC4

Front

Rear

DC4 with SSDs

Front Rear 3 2 1 0

DC4 Type-2

Front 3 2 1

Rear

0
0600_L_R5

Figure 6-4. Disk Drive Numbering in a DC4 and DC4 Type-2 Drive Magazine

6.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

14 Use a #2 Phillips screwdriver to remove the screws from the drive mount on a DC4 drive magazine as shown in Figure 6-5.

For DC4 and DC4 Type-2 drive magazines, unscrew and remove each screw securing the disk drives.

For DC4 drive magazines populated with Solid State Drives (SSDs), loosen each screw approximately one to one-half turn. It is not necessary to remove all the screws.

Screw (4x)

DC4

Screw (4x)

DC4 with SSDs 3


2 1 0

Screw (3x)

DC4 Type-2 3 2 1

0
0597_L_R3

Figure 6-5. Loosening and Removing the Screws Securing the Disks

NOTE: Some brackets used with SSDs do not have clearance slots. Brackets without clearance slots require removal of all screws before unmounting the drive assembly.

6.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

15 After loosening the disk, slide the disk toward the top of the drive magazine. Angle the disk up and then slide it out of the magazine, as shown in Figure 6-6.

For DC4 drive magazine populated with SSDs, slide the drive assembly away from the main connector until the screwheads clear the screw clearance slots and lift assembly at an angle out of the magazine.

DC4

DC4 with SSDs


2 1 0

DC4 Type-2
3 2 1 0

0592_L_R3

Figure 6-6. Sliding a Disk Out of the Magazine

6.9
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

16 Remove the replacement disk from its protective packaging and avoid touching the exposed underside of the replacement disk. 17 To install the disk into the new drive magazine: a Carefully insert the replacement disk into the opening in the drive magazine.

For an SSD assembly, align the screw clearance slots with the screwheads and insert.

Slide the disk down until the screw holes align with the screw holes in the drive mount. At this point, the drive should be seated in its connector and the top of the disk should be near flush with the top of the drive magazine and should lay flat within the magazine.

Secure the disk to the drive mount with the screws. Do not overtighten the screws.

6.10
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

18 Insert the drive magazine into the drive chassis with the ejector handle completely lowered, using the notch at the top of the drive chassis housing as a guide (Figure 6-7).

0599_L_R1

Figure 6-7. Inserting a Magazine into a Drive Chassis

CAUTION: The drive magazines should slide in-and-out easily. If a drive magazine does not insert smoothly, do not force it. Confirm whether the drive magazine is properly aligned with the guide notch at the top of the drive chassis housing and apply moderate pressure toward the left side of the magazine while inserting.

19 When the drive magazine slides to a stop, quickly lift the ejector handle up to engage the magazine into the drive chassis midplane.

NOTE: If any disks in the drive magazine fail to spin up, reseat the drive magazine and be sure to close the ejector handle quickly.

6.11
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

20 Secure the magazine to the chassis by tightening the captive screw at the front of the magazine. Do not overtighten the screw. 21 Place the removed disk in the protective packaging for return to 3PAR.

NOTE: After inserting the magazine into the drive chassis, allow approximately one minute for the disks on the magazine to spin up before checking the magazine LEDs.

22 Verify all disk status LEDs on the drive magazine appear steady green and the hot-plug LED is not illuminated. 23 On the SP, issue the showpd command and verify the removed disk lists as failed and the replacement disk lists as new. cli% showpd Id CagePos Type Speed(K) State --0:2:3 FC 15 new 1196 0:0:0 NL 7 normal 1197 0:0:1 NL 7 normal 1198 0:0:2 NL 7 normal 1199 0:0:3 NL 7 normal 1200 0:1:0 SSD 150 normal 1201 0:1:1 SSD 150 normal 1202 0:1:2 SSD 150 normal 1203 0:1:3 SSD 150 normal 1204 0:2:0 FC 15 normal 1205 0:2:1 FC 15 normal 1206 0:2:2 FC 15 normal 1207 0:2:3 FC 15 failed 1208 0:3:0 NL 7 normal 1209 0:3:1 NL 7 normal 1210 0:3:2 NL 7 normal 1211 0:3:3 NL 7 normal ... ----Size(MB)----- ----Ports---Total Free A B 285440 0 6:1:3* 7:2:3 953344 886272 6:1:3* 7:2:3 953344 886528 6:1:3 7:2:3* 953344 886272 6:1:3* 7:2:3 953344 886784 6:1:3 7:2:3* 47360 28416 6:1:3* 7:2:3 47360 29184 6:1:3 7:2:3* 47360 28416 6:1:3* 7:2:3 47360 29184 6:1:3 7:2:3* 285440 0 6:1:3* 7:2:3 285440 0 6:1:3 7:2:3* 285440 0 6:1:3 7:2:3 285440 0 6:1:3 ----953344 886784 6:1:3* 7:2:3 953344 886784 6:1:3 7:2:3* 953344 886528 6:1:3* 7:2:3 953344 886528 6:1:3 7:2:3*

----------------------------------------------------------------41 total 20484864 17538816

6.12
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

NOTE: The new disk appears at the top of the listed disks in the showpd command output.

24 Issue the servicemag resume <X Z> command, where X is the drive cage number and

Z is the location of the drive magazine in the drive chassis.


cli% servicemag resume 0 3 Are you sure you want to run servicemag? select q=quit y=yes n=no: y servicemag resume 0 3 ... mag 0 3 already onlooped ... firmware is current on pd WWN [20000024B6284FE8] Id [933] ... firmware is current on pd WWN [2000001D38B11AC7] Id [1204] ... firmware is current on pd WWN [2000001D38B114FE] Id [1205] ... firmware is current on pd WWN [2000001D38B119AB] Id [1207] ... firmware is current on pd WWN [2000001D38B11277] Id [1206] ... checking for valid disks... ... disks in mag : 0 3 ... normal disks: WWN [20000024B6284FE8] Id [933] diskpos [2] .................... WWN [2000001D38B11AC7] Id [1204] diskpos [0] .................... WWN [2000001D38B114FE] Id [1205] diskpos [1] .................... WWN [2000001D38B119AB] Id [1207] diskpos [3] ... not normal disks: WWN [2000001D38B11277] Id [1206] ... verifying spare space for disks 1204 and 1204 ... verifying spare space for disks 1205 and 1205 ... verifying spare space for disks 1207 and 1207 ... playback chunklets from pd WWN [20000024B6284FE8] Id [933] ... playback chunklets from pd WWN [2000001D38B11AC7] Id [1204] ... playback chunklets from pd WWN [2000001D38B114FE] Id [1205] ... playback chunklets from pd WWN [2000001D38B119AB] Id [1207] The servicemag resume operation will continue in the background. The servicemag resume process may take several hours or more to complete, depending on the number of chunklets to be relocated. Once servicemag status shows chunklets have begun relocating from spare space, issue the servicemag status command (the -d is optional for additional detailed information) to monitor the servicemag completion.

6.13
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

25 Issue the servicemag status -d <X Z> command, where <X Z> is the location of the drive cage and magazine from the previously issued servicemag resume command.
cli% servicemag status -d Cage 0, magazine 3: The magazine is being brought online due to a servicemag resume. The last status update was at Thu Feb 11 11:09:21 2010. Unable to provide a relocation estimate The cumulative output so far is: servicemag resume 0 3 ... mag 0 3 already onlooped ... firmware is current on pd WWN [20000024B6284FE8] Id [933] ... firmware is current on pd WWN [2000001D38B11AC7] Id [1204] ... firmware is current on pd WWN [2000001D38B114FE] Id [1205] ... firmware is current on pd WWN [2000001D38B119AB] Id [1207] ... firmware is current on pd WWN [2000001D38B11277] Id [1206] ... checking for valid disks... ... disks in mag : 0 3 ... normal disks: WWN [20000024B6284FE8] Id [933] diskpos [2] .................... WWN [2000001D38B11AC7] Id [1204] diskpos [0] .................... WWN [2000001D38B114FE] Id [1205] diskpos [1] .................... WWN [2000001D38B119AB] Id [1207] diskpos [3] ... not normal disks: WWN [2000001D38B11277] Id [1206] ... verifying spare space for disks 1204 and 1204 ... verifying spare space for disks 1205 and 1205 ... verifying spare space for disks 1207 and 1207 ... playback chunklets from pd WWN [20000024B6284FE8] Id [933] ... playback chunklets from pd WWN [2000001D38B11AC7] Id [1204] ... playback chunklets from pd WWN [2000001D38B114FE] Id [1205] ... playback chunklets from pd WWN [2000001D38B119AB] Id [1207] ... 170 chunklets still waiting to be played back or relocating... ... All chunklets played back / relocated. ... relocating chunklets from raid set to new disk ... relocating chunklets from spare space

NOTE: Both step 26 and step 27 are not required when using CLI command option -pdid. Continue to step 28 if applicable. These steps perform when the

servicemag resume command is complete.

6.14
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

26 Issue the dismisspd <PD_ID> command to remove the replaced disk, where <PD_ID> is the ID of the replaced physical disk. cli% dismisspd 0

27 Issue the showpd <PD_ID> command and verify if the replaced disk is removed. cli% showpd 0 No data available for specified PD(s)

28 Issue the checkhealth -svc command to verify your system is healthy. 29 In the SP window issue the exit command to stop the CLI session. 30 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 31 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 32 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 33 Close and lock the rear door of the InServ. 34 Replace the bezel that covers the front of the InServ. 35 Replace and secure the front fascia on the storage server if applicable.

6.15
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

6.16
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

7 Replacing a Drive Magazine


In this chapter
7.1 General Precautions 7.2 Planning 7.2.1 Logging Mode 7.3 Drive Magazine Replacement Procedure 7.1 7.2 7.2 7.3

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

7.1 General Precautions


When handling drive magazines, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing a Drive Magazine

7.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

7.2 Planning
Replacing a drive magazine requires preparation and can take between 20 minutes to 12 hours to complete prior to the physical replacement procedure. This section provides estimated times for migrating data. The table below shows examples of the time allotment needed for running CLI command

servicemag on drive magazines at or near capacity (Table 7-1).


Table 7-1. Time Estimates for Running CLI Command servicemag

Drive Magazine Size 50 GB 146 GB 300 GB 500 GB or larger

Estimated Time Required 1 Hour or less 3 Hours 6 Hours 10 - 12 Hours

7.2.1 Logging Mode


When replacing a drive magazine, use the -log option with the CLI servicemag command. Instances when Logging mode is not recommended:

Do not use if there are multiple drive magazine problems. Do not use if there are multiple failures in the same drive cage. Do not use if you have any RAID-0 sets on the drive magazine. Do not use if there are multiple problems or failures.

Additional CLI commands:

Recommended CLI command: servicemag start -log -nodisks <cage_id>

<mag_id>.

This option should be used only in conjunction with the -log option when servicing a magazine which has all valid drives and no disks need to be replaced.

7.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

7.3 Drive Magazine Replacement Procedure


To replace a drive magazine: 1 Start an spmaint session. a Connect the Maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the SP by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 4 Select option 7 , Interactive CLI for an InServ. Select the desired InServ. Issue the showpd command. Verify the location of the failed drive magazine and there are adequate spare chunklets defined.

NOTE: If there are not enough spare chunklets defined, contact your technical support representative for assistance.

7.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Issue the servicemag start -log -nodisks <X Z>, where X is the drive cage number and Z is the location of the drive magazine in the drive cage. NOTE: The servicemag start command moves all the required, used chunklets on the magazine. This is executed simultaneously for each hard drive and takes approximately 20 seconds for each used chunklet.

cli% servicemag start -log -nodisks 0 3 Are you sure you want to run servicemag? select q=quit y=yes n=no: y servicemag start -log -nodisks 0 3 ... servicing disks in mag: 0 3 ... valid disks: WWN [5000C50002841761] .................... WWN [5000C500028486F2] .................... WWN [5000C5000284173F] .................... WWN [5000C50002841675] ... not valid disks:

Id Id Id Id

[56] [57] [58] [59]

diskpos diskpos diskpos diskpos

[0] [1] [2] [3]

The servicemag start operation will continue in the background. 6 To monitor progress, issue the servicemag status -d <X Z>, where <X Z> is the location of the drive cage and magazine from the previously issued servicemag start command. cli% servicemag status -d 0 3 Cage 0, magazine 3: The magazine is being brought offline due to a servicemag start. The last status update was at Wed Nov 21 07:52:29 2007. The cumulative output so far is: servicemag start -log -nodisks 0 3 ... servicing disks in mag: 0 3 ... valid disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not valid disks: ... relocating chunklets to spare space... ... relocating chunklets from degraded raid sets to spare space ... logging chunklets from pd WWN [5000C50002841761] Id [56] ... logging chunklets from pd WWN [5000C500028486F2] Id [57] ... logging chunklets from pd WWN [5000C5000284173F] Id [58] ... logging chunklets from pd WWN [5000C50002841675] Id [59] ...

7.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

When the command completes successfully, Succeeded is returned on the display, the hot-plug LED on the drive magazine is illuminated, and the drive status LEDs on the drive magazine are blinking slowly (Figure 7-1).

Disk Status LEDs

Hot-Plug LED
3 2 1 0
!

Drive Magazine Status LED


0587_L_R1

DC4

Figure 7-1. DC4 Drive Magazine LEDs

To locate the drive cage, issue the locatecage cage<x> command to turn on all LEDs for a short duration, where <x> is the cage number. Drive magazine locations within the drive cage are shown in Figure 7-2.

7.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Remove the bezel from the front of the drive cage.


Drive Magazines 0 1 2 3 4 5 6 7 8 9

0598_L_R2

Figure 7-2. DC4 Drive Magazine Locations in the Drive Cage

Prepare an Electrostatic Discharge-safe (ESD-safe) work area.

10 Wearing a wrist grounding strap, use a #2 Phillips screwdriver to loosen the captive screw that secures the drive magazine (Figure 7-3).

Captive Screw

3 2 1 0

DC4
0591_L_R1

Figure 7-3. Loosening the Captive Screw on the DC4 Drive Magazine

7.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

11 With your right hand on the handle of the drive magazine and your left hand supporting the magazine from beneath, slide the magazine out of the drive chassis. 12 Place the magazine on an ESD-safe, level work surface with the solid back panel facing down. 13 Remove the replacement magazine from its protective packaging and set aside any electrostatic preventative packing material protecting the magazine. It will be used to package the replaced drive magazine. 14 Place the replacement magazine on the ESD-safe work surface next to the failed magazine. Perform step 15 through step 17 for each disk.

NOTE: When removing and replacing the disks, you must replace the disks in the same position on the replacement magazine.

7.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

15 Use a #2 Phillips screwdriver to remove the screws from the drive mount on a DC4 drive magazine drive magazine as shown in Figure 7-4.
Screw (4x)

DC4

Screw (4x)

DC4 with SSDs 3


2 1 0

Screw (3x)

DC4 Type-2 3 2 1

0
0597_L_R3

Figure 7-4. Screws Securing the Disks

7.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

16 Remove each disk from the failed drive magazine by sliding it out of the drive mount, as shown in Figure 7-5. Avoid touching the exposed underside of the disk.

DC4

DC4 with SSDs


2 1 0

DC4 Type-2
3 2 1 0

0592_L_R3

Figure 7-5. Sliding a Disk Out of the Drive Magazine

7.9
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

17 To install the disk into the new drive magazine: a Move all disks from the failed drive magazine into the replacement drive magazine. Carefully insert the disk into the same position on the replacement drive magazine. b Slide the disk down until the screw holes align with the screw holes in the drive mount. At this point, the disk should be seated in its connector and the top of the disk should be near flush with the top of the drive magazine and should lay flat within the magazine. c Secure the disk to the drive magazine with the screws. Do not overtighten the screws.

18 Place the removed magazine into the protective packaging for return to 3PAR.

7.10
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

19 Insert the drive magazine into the drive chassis with the ejector handle completely lowered, using the notch at the top of the drive chassis housing as a guide (Figure 7-6).

0599_L_R1

Figure 7-6. Inserting a Magazine into a Drive Chassis

CAUTION: The drive magazines should slide in easily. If a drive magazine does not insert smoothly, do not force it. Confirm the drive magazine is properly aligned with the guide notch at the top of the drive chassis housing and apply moderate pressure toward the left side of the magazine when inserting.

7.11
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

20 When the drive magazine slides to a stop, quickly lift the ejector handle up to engage the magazine into the drive chassis midplane.

NOTE: After inserting the magazine into the drive chassis, allow approximately one minute for the disks on the magazine to spin up before checking the magazine LEDs.

NOTE: If any of the disks in the drive magazine fail to spin up, reseat the drive magazine and be sure to close the ejector handle quickly.

NOTE: If you have difficulty inserting drive magazines into drive chassis that also have drive magazine filler panels installed, it may be necessary to remove the adjacent filler panel to insert the drive magazine more easily.

21 Secure the magazine to the chassis by tightening the captive screw at the front of the magazine. Do not overtighten the screw. 22 Verify all disk status LEDs on the drive magazine appear steady green and the hot-plug LED is not illuminated. 23 In the SP window, issue the showpd command and verify the four disks are installed and in a valid state. cli% showpd Id 0 1 2 3
...

CagePos 0:0:0 0:0:1 0:0:2 0:0:3

Type Speed(K) State FC 15 normal FC 15 normal FC 15 normal FC 15 normal

----Size(MB)----Total Free 139520 119808 139520 122112 139520 119552 139520 117504

----Ports---A B 0:0:1* 1:0:1 0:0:1 1:0:1* 0:0:1* 1:0:1 0:0:1 1:0:1*

7.12
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

24 Issue the servicemag resume <X Z> command, where X is the drive cage number and Z is the location of the drive magazine in the drive cage. cli% servicemag resume 0 3 Are you sure you want to run servicemag? select q=quit y=yes n=no: y servicemag resume 0 3 ... onlooping mag 0 3 ... checking for valid disks... ... disks in mag : 0 3 ... valid disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not valid disks: ... firmware is current on pd WWN [5000C50002841761] Id [56] ... firmware is current on pd WWN [5000C500028486F2] Id [57] ... firmware is current on pd WWN [5000C5000284173F] Id [58] ... firmware is current on pd WWN [5000C50002841675] Id [59] ... verifying disk 56 ... verifying spare space for disks 56 and 56 ... verifying disk 57 ... verifying spare space for disks 57 and 57 ... verifying disk 58 ... verifying spare space for disks 58 and 58 ... verifying disk 59 ... verifying spare space for disks 59 and 59 ... playback chunklets from pd WWN [5000C50002841761] Id [56] ... playback chunklets from pd WWN [5000C500028486F2] Id [57] ... playback chunklets from pd WWN [5000C5000284173F] Id [58] ... playback chunklets from pd WWN [5000C50002841675] Id [59] The servicemag resume operation will continue in the background. The servicemag resume process can take several hours or more to complete, depending on the number of chunklets to be relocated. Once servicemag status -d shows that chunklets are being relocated from spare space, skip to step 26 to disconnect. Servicemag completion may be monitored with the servicemag status -d command in step 25 on page 7.14

7.13
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

25 Issue the servicemag status -d <X Z> command, where X is the drive cage number and Z is the location of the drive magazine in the drive cage from the previously issued

servicemag resume command.


cli% servicemag status -d 0 3 The magazine was brought online by a successful servicemag resume command. The command completed at Wed Nov 21 07:57:38 2007. The output of the servicemag resume was: servicemag resume 0 3 ... onlooping mag 0 3 ... checking for valid disks... ... disks in mag : 0 3 ... valid disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not valid disks: ... firmware is current on pd WWN [5000C50002841761] Id [56] ... firmware is current on pd WWN [5000C500028486F2] Id [57] ... firmware is current on pd WWN [5000C5000284173F] Id [58] ... firmware is current on pd WWN [5000C50002841675] Id [59] ... verifying disk 56 ... verifying spare space for disks 56 and 56 ... verifying disk 57 ... verifying spare space for disks 57 and 57 ... verifying disk 58 ... verifying spare space for disks 58 and 58 ... verifying disk 59 ... verifying spare space for disks 59 and 59 ... playback chunklets from pd WWN [5000C50002841761] Id [56] ... playback chunklets from pd WWN [5000C500028486F2] Id [57] ... playback chunklets from pd WWN [5000C5000284173F] Id [58] ... playback chunklets from pd WWN [5000C50002841675] Id [59] ... All chunklets played back / relocated. ... no chunklets to move servicemag resume 0 3 -- Succeeded When the command completes successfully, Succeeded is returned on the display.

7.14
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

26 Issue the checkhealth -svc command to verify your system is healthy. 27 In the SP window issue the exit command to stop the CLI session. 28 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 29 Disconnect the serial cable from the maintenance PC, coil and replace the cable behind the SP. 30 Disconnect the red cross-over Ethernet cable from the laptop and coil and place the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 31 Close and lock the rear door of the InServ. 32 Replace the bezel that covers the front of the InServ.

7.15
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

7.16
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

8 Replacing an SFP Module on an FC-AL


In this chapter
8.1 General Precautions 8.2 SFP Module Replacement Procedure 8.2 8.2

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

Replacing an SFP Module on an FC-AL

8.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

8.1 General Precautions


When handling drive cage SFP modules, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

8.2 SFP Module Replacement Procedure


This section describes the procedure for replacing an SFP module in an FC-AL. To replace a drive cage SFP module: 1 Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the SP by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 Select option 7 , Interactive CLI for an InServ. Select the desired InServ.

8.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Issue the servicecage startfc <x> <cage> command, where <x> is the SFP module to be replaced and <cage> is the name of the drive cage to be serviced. cli% servicecage startfc 1 cage5 cli%

Port A Port A RX LED Port B Port B RX LED FC-AL Status LED Split Mode LED Port B TX LED Hot-Plug LED 4 Gb/s Port A TX LED

(Typical)
0655_L_R1

Figure 8-1. FC-AL LED and Port Locations

8.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

To locate the drive cage, issue the locatecage t 15 <cage> command to turn on all LEDs for a short duration, where 15 is the number of seconds the LEDs are illuminated and

<cage> is the cage number.


6 Issue the showcage d <cage> command, where <cage> is the cage name and verify that the FC-AL hot-plug is on. cli% showcage -d cage4 Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side 4 cage4 2:2:1 0 3:2:1 0 8 30-38 2.37 2.37 DC4 n/a -----------Cage detail info for cage4 --------Position: --Fibre Channel Info PortA0 PortB0 PortA1 PortB1 Link_Speed 4Gbps --- 4Gbps ----------------------------------SFP Info----------------------------------FCAL SFP -State- --Manufacturer-- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM 0 0 OK FINISAR CORP. 4.1 No No No Yes 1 1 OK FINISAR CORP. 4.1 No No No Yes Interface Board Info FCAL0 FCAL1 Link A RXLEDs Green Off Link A TXLEDs Green Off Link B RXLEDs Off Green Link B TXLEDs Off Green LED(Loop_Split) Off Off LEDS(system,hotplug) Green,Off Green,Amber ... 7 8 Verify the hot-plug LED on the FC-AL module being worked on is lit. See Figure 8-1. Detach the Fibre Channel cable from the SFP by squeezing the tabs on the sides of the cable and pulling to remove.

8.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Wearing a wrist grounding strap, lift up on the retaining clip of the defective SFP module. See Figure 8-2.

0799_L_R1

Figure 8-2. Removing the SFP

10 Carefully slide the defective SFP module out of the SFP slot. 11 Remove the replacement SFP module from its protective packaging. 12 Place the removed SFP module into the protective packaging for return to 3PAR. 13 Insert the replacement SFP module into the FC-AL until fully seated. 14 Lock the SFP retaining clip in place. 15 Reconnect the Fibre-Channel cable. 16 Verify the TX (Transmit) and RX (Receive) LEDs are illuminated. See Figure 8-1. 17 Issue the servicecage endfc <x> <cage> command, where <x> is the FC-AL module and <cage> is the name of the drive cage. cli% servicecage endfc 1 cage0 cli%

8.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

18 Issue the showpd command and verify that the port for the replaced SFP is now active and that disks are on the loop. cli% showpd Id 0 1 2 3 4 5 CagePos 0:0:0 0:0:1 0:0:2 0:0:3 0:1:0 0:1:1 Type Speed(K) State FC 10 normal FC 10 normal FC 10 normal FC 10 normal FC 10 normal FC 10 normal ----Size(MB)----- ----Ports---Total Free A B 139520 119808 0:0:1* 1:0:1 139520 122112 0:0:1 1:0:1* 139520 119552 0:0:1* 1:0:1 139520 117504 0:0:1 1:0:1* 139520 119552 0:0:1* 1:0:1 139520 122112 0:0:1 1:0:1*

19 Issue the showcage d <cage> command, where <cage> is the cage name and verify that the SFP State is OK.

cli% showcage -d cage4 Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side 4 cage4 2:2:1 0 3:2:1 0 8 30-37 2.37 2.37 DC4 n/a -----------Cage detail info for cage4 --------Position: --Fibre Channel Info PortA0 PortB0 PortA1 PortB1 Link_Speed 4Gbps --- 4Gbps ----------------------------------SFP Info----------------------------------FCAL SFP -State- --Manufacturer-- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM 0 0 OK FINISAR CORP. 4.1 No No No Yes 1 1 OK FINISAR CORP. 4.1 No No No Yes Interface Board Info FCAL0 FCAL1 Link A RXLEDs Green Off Link A TXLEDs Green Off Link B RXLEDs Off Green Link B TXLEDs Off Green LED(Loop_Split) Off Off LEDS(system,hotplug) Green,Off Green,Off

8.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

20 Issue the checkhealth -svc command to verify your system is healthy. 21 In the SP window issue the exit command to stop the CLI session. 22 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 23 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 24 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 25 Close and lock the rear door of the InServ. 26 Replace the bezel that covers the front of the InServ. 27 Replace and secure the front fascia on the storage server if applicable.

8.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

8.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

9 Replacing a Drive Cage FC-AL Module


In this chapter
9.1 General Precautions 9.2 FC-AL Replacement Procedure 9.1 9.2

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

9.1 General Precautions


When handling drive cage FC-AL modules, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing a Drive Cage FC-AL Module

9.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

9.2 FC-AL Replacement Procedure


To replace a drive cage FC-AL module: 1 Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the SP by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 4 Select option 7 , Interactive CLI for an InServ. Select the desired InServ. Issue the servicecage startfc <x> <cage> command, where <x> is the FC-AL module to be replaced and <cage> is the cage name. cli% servicecage startfc 1 cage4 Are you sure you want to run "servicecage startfc 1 cage4"? select q=quit y=yes n=no: y

Issue the showcage d <cage> command, where <cage> is the cage name and verify the FC-AL hot-plug is Amber by checking the LED (system,hotplug) line:

9.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

cli% showcage -d cage4 Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side 4 cage4 2:2:1 0 3:2:1 0 8 29-37 2.36 2.36 DC4 n/a -----------Cage detail info for cage4 --------Position: --Fibre Channel Info PortA0 PortB0 PortA1 PortB1 Link_Speed 4Gbps --- 4Gbps ----------------------------------SFP Info----------------------------------FCAL SFP -State- --Manufacturer-- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM 0 0 OK FINISAR CORP. 4.1 No No No Yes 1 1 OK FINISAR CORP. 4.1 No No No Yes Interface Board Info FCAL0 FCAL1 Link A RXLEDs Green Off Link A TXLEDs Green Off Link B RXLEDs Off Green Link B TXLEDs Off Green LED(Loop_Split) Off Off LEDS(system,hotplug) Green,Off Green,Amber -----------Midplane Info----------Firmware_status Old Product_Rev 2.36 State Normal Op Loop_Split 0 VendorId,ProductId 3PARdata,DC4 Unique_ID 1062030000098E00 ...

9.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Note the location of all Fibre Channel cables to be reconnected after FC-AL replacement. If necessary, mark the cables that connect to the FC-AL before removing them. The drive-side Fibre Channel cables are marked to simplify this task. Detach the Fibre Channel cables from the FC-AL module by squeezing the tabs on the sides of the cable and pulling to remove.

Wearing a wrist grounding strap, pull down the retaining clip of the SFP module (Figure 9-1).

0799_L_R1

Figure 9-1. SFP Module

8 9

Holding the retaining clip, slide the SFP module out of the defective FC-AL. Use a #2 Phillips screwdriver to loosen the captive screw that secures the FC-AL (Figure 9-2).

FC-AL Handle

Captive Screw

0800_L_R1

Figure 9-2. FC-AL Captive Screw

9.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

10 Pull the FC-AL handle down and slide the FC-AL module out of the drive chassis using the handle on the side of the module, as shown in Figure 9-3.

0801_L_R1

Figure 9-3. Removing the FC-AL

11 Remove the replacement FC-AL module from its protective packaging and electrostatic packing material and set aside. 12 Place the removed FC-AL module into the protective packaging for return to 3PAR. 13 Insert the replacement FC-AL module into the drive chassis and lift up the FC-AL handle until fully seated.

CAUTION: Drive cage FC-AL modules should glide in-and-out smoothly. If an FC-AL module does not easily insert, do not force it. Before continuing, confirm that the FC-AL module is properly aligned with the card guides at the top and bottom of the drive chassis housing.

14 Tighten the screw that secures the FC-AL module to the drive chassis housing. Do not overtighten the screw. 15 Insert the SFP module into the FC-AL until fully seated. 16 Lock the retaining clip in place. 17 Reconnect all Fibre-Channel cables.

9.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

18 Issue the servicecage endfc <x> <cage> command, where <x> is the FC-AL module replaced and <cage> is the drive cage being updated. cli% servicecage endfc 1 cage4 Are you sure you want to run "servicecage endfc 1 cage4"? select q=quit y=yes n=no: y Upgrading cage cage4 cpuA from rev 2.36 to revision in file /opt/tpd/fw/cage/dc4/ lbod_fw.bin-2.37. Beginning test after upgrade for cage4 cage4 passed test after upgrade 19 Issue the showcage d <cage> command, where <cage> is the name of the drive cage where the FC-AL module is replaced, and verify that the drive cage now contains the correct firmware level shown below RevA and RevB. cli% showcage -d cage4 Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side 4 cage4 2:2:1 0 3:2:1 0 8 29-37 2.37 2.37 DC4 n/a -----------Cage detail info for cage4 --------Position: --Fibre Channel Info PortA0 PortB0 PortA1 PortB1 Link_Speed 4Gbps --- 4Gbps ----------------------------------SFP Info----------------------------------FCAL SFP -State- --Manufacturer-- MaxSpeed(Gbps) TXDisable TXFault RXLoss DDM 0 0 OK FINISAR CORP. 4.1 No No No Yes 1 1 OK FINISAR CORP. 4.1 No No No Yes Interface Board Info FCAL0 FCAL1 Link A RXLEDs Green Off Link A TXLEDs Green Off Link B RXLEDs Off Green Link B TXLEDs Off Green LED(Loop_Split) Off Off LEDS(system,hotplug) Green,Off Green,Off -----------Midplane Info----------Firmware_status Current Product_Rev 2.37 State Normal Op Loop_Split 0 VendorId,ProductId 3PARdata,DC4 Unique_ID 1062030000098E00

9.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

20 Issue the showpd command and verify the port for the replaced FC-AL module is now active and the disks are on the loop. cli% showpd Id CagePos 0 0:0:0 1 0:0:1 2 0:0:2 3 0:0:3 4 0:1:0 5 0:1:1 ... Type Speed(K) State FC 10 normal FC 10 normal FC 10 normal FC 10 normal FC 10 normal FC 10 normal ----Size(MB)----- ----Ports---Total Free A B 139520 119808 0:0:1* 1:0:1 139520 122112 0:0:1 1:0:1* 139520 119552 0:0:1* 1:0:1 139520 117504 0:0:1 1:0:1* 139520 119552 0:0:1* 1:0:1 139520 122112 0:0:1 1:0:1*

21 Issue the checkhealth -svc command to verify your system is healthy. 22 In the SP window issue the exit command to stop the CLI session. 23 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 24 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 25 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the Ethernet cable and all other cables to the node. 26 Close and lock the rear door of the InServ. 27 Replace the bezel that covers the front of the InServ. 28 Replace and secure the front fascia on the storage server if applicable.

9.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

9.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

10 Replacing a Drive Cage Midplane Assembly


In this chapter
10.1 General Precautions 10.2 Planning 10.3 Migrating Data Off the Drive Cage 10.4 Midplane Assembly Replacement Procedure 10.5 Migrating Data Back to the Drive Cage 10.1 10.2 10.2 10.6 10.11

10.1 General Precautions


When handling a drive cage midplane assembly, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing a Drive Cage Midplane Assembly

10.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

10.2 Planning
Replacing a drive cage midplane requires preparations which are determined after reviewing the customers system layout. Each site must be evaluated for an efficient and safe replacement without bringing down the entire InServ Storage Server.

Determine if there is free disk space to migrate data from the drive cage midplane that is being replaced.

NOTE: If there are not enough spare chunklets defined, contact your technical support representative for assistance.

10.3 Migrating Data Off the Drive Cage


To migrate data off the drive cage: 1 Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the SP by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 4 Select option 7 , Interactive CLI for an InServ. Select the desired InServ. Issue the showpd -sortcol 1 command to determine all PD IDs in the cage. The 1 indicates which column to sort by. 5 Set the selected PDs allocation flags to OFF by issuing the setpd ldalloc off <pdid> command for each disk ID, where <PD_ID> is the physical disk identification.

10.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Confirm the setting by issuing the showpd -sortcol 1. The PDs set to OFF will indicate 0 free space.

cli% showpd -sortcol 1 Id 0 1 2


...

CagePos 0:0:0 0:1:0 0:2:0

Type Speed(K) State FC 15 normal FC 15 normal FC 15 normal

---Size(MB)---Total Free 139520 69760 139520 0 139520 69760

-----------Ports----------A0 B0 A1 B1 0:0:1* 2:0:1 1:0:1 3:0:1 0:0:1* 2:0:1 1:0:1 3:0:1 0:0:1* 2:0:1 1:0:1 3:0:1

Issue the servicemag start <X Z> command, where X is the drive cage number and Z is the location of the drive magazine in the drive chassis.

NOTE: The servicemag start command moves all used chunklets on the magazine. This is executed simultaneously for each disk drive and takes approximately 20 seconds for each used chunklet.

cli% servicemag start 0 1 Are you sure you want to run servicemag? select q=quit y=yes n=no: y servicemag start 0 1 ... servicing disks in mag: 0 1 ... normal disks: WWN [5000C50002841761] .................... WWN [5000C500028486F2] .................... WWN [5000C5000284173F] .................... WWN [5000C50002841675] ... not normal disks:

Id Id Id Id

[56] [57] [58] [59]

diskpos diskpos diskpos diskpos

[0] [1] [2] [3]

The servicemag start operation will continue in the background.

10.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

To monitor progress, issue the servicemag status -d <X Z> command, where <X Z> is the location of the drive cage and magazine from the previously issued servicemag

start command.
cli% servicemag status -d Cage 0, magazine 1: The magazine is being brought offline due to a servicemag start. The last status update was at Wed Sep 16 07:52:29 2009. The cumulative output so far is: servicemag start 0 1 ... servicing disks in mag: 0 1 ... normal disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not normal disks: ... relocating chunklets to spare space... ... relocating chunklets from degraded raid sets to spare space

Repeat step 7 for all drive magazines in the cage then continue to Midplane Assembly Replacement Procedure on page 10.6.

NOTE: Up to five servicemag -start operations may be running at once. Ensure one is proceeding before starting the next.

10.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

When servicemag completes successfully, Succeeded is returned on the display, the hot-plug LED on the drive magazine is illuminated, and the status LEDs on the drive magazine are blinking slowly (Figure 10-1).

Disk Status LEDs

Hot-Plug LED
3 2 1 0
!

Drive Magazine Status LED


0587_L_R1

DC4

Figure 10-1. DC4 Drive Magazine Status LEDs

NOTE: Servicemag cannot bypass and set the hot-plug LED on the last drive magazine because the system does not want to lose communication with the cage. Consequently, the last ESI drive magazine will not have the hot-plug LED illuminated, but three of the four disks should be spundown. If this is the case and all other servicemag operations in the cage are successful, the midplane may be replaced.

10.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

10.4 Midplane Assembly Replacement Procedure


To replace a drive cage midplane assembly: 1 2 Set the power supplies at the rear of the drive cage to the OFF position. Disconnect the AC cords from the power supplies in the drive cage. a Loosen the power supply cord lock screw with a #1 Phillips screwdriver, as shown in Figure 10-2 and rotate the retaining latch counter clock wise. b Disconnect the AC cord.

Cord Lock Screw

0634_L_R1

Figure 10-2. Power Supply Cord Lock

10.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Remove the power supplies from the rear of the drive cage: a Use a #1 Phillips screw drive to remove two screws securing each power supply to the chassis (Figure 10-3). b Pull the handle to remove the power supply from the drive cage.

Screws (2x)
0635_L_R1

Figure 10-3. Power Supply Screws

At the front of the server, note the imprinted Fibre Channel cable labels on the cables that connect to the front of the FC-AL modules, recording the locations of all cables.

Detach the Fibre Channel cables from the FC-AL modules by squeezing the tabs on the sides of the cables and pulling to remove.

Use a #2 Phillips screwdriver to loosen the screws that secure the two FC-AL modules to the drive cage and then slide the boards out slightly to disengage from the midplane.

Use a #2 Phillips screwdriver to loosen the captive screws securing the drive magazines to the drive cage and pull each magazine out slightly to disengage from the drive cage.

10.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

At the rear of the server, use a #1 Phillips screwdriver to remove the four screws and spacers that secure the midplane assembly to the drive chassis housing, see Figure 10-4.

Grasp the midplane bracket at the middle and pull the assembly out of the drive chassis, see Figure 10-4.

Midplane Bracket

Midplane Assembly Screws (4) & Spacers (4)


0797_L_R1

Figure 10-4. Removing the Midplane Assembly

10.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

10 Use a #1 Phillips screwdriver to remove the eight screws that attach the midplane to the midplane assembly, see Figure 10-5.

Midplane Screws (8)


0798_L_R1

Figure 10-5. Midplane Removal

11 Remove the replacement midplane from its shipping container.

10.9
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

12 Verify the replacement midplane speed is switched to 4GB, see Figure 10-6.
Midplane Switch

4GB 2GB

0678_L_R2

Figure 10-6. Midplane Switch

13 Place the removed midplane into the container for return to 3PAR. 14 Use a #1 Phillips screwdriver to attach the new midplane to the midplane assembly by securing the eight screws previously removed. 15 Slide the replacement drive cage midplane assembly into the drive chassis until it is fully seated. Reinstall and tighten the screws that secure the assembly to the drive chassis housing. Do not overtighten the screws. 16 At the front of the server, slide each drive magazine back into the drive cage and tighten the screws securing them to the drive cage. Do not overtighten the screws. 17 Slide the two FC-AL cards back into the drive cage and tighten the screws securing them to the drive cage. Do not overtighten the screws. 18 Reconnect the Fibre Channel cables to their respective FC-AL modules in the drive cage. 19 Replace the power supplies at the rear of the drive cage. a b Slide the power supply into the rear of the drive cage until fully seated. Use a #1 Phillips screwdriver to tighten the M3 screws that secure the power supply to the drive chassis housing. Do not overtighten the screws. 20 Reconnect the AC cords and tighten the cord lock screws on the power supplies to prevent accidental disconnection.

10.10
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

21 Set the power supplies to the ON position and verify all power supply status LEDs appear green. 22 Return to the front of the drive chassis to verify all LEDs in the drive magazines and FC-AL modules appear green or flashing green and that the hot-plug LEDs on the drive magazines and drive cage FC-AL modules are not lit.

NOTE: Allow two minutes for the disks on the magazine to spin up before checking the magazine LEDs.

10.5 Migrating Data Back to the Drive Cage


NOTE: The replacement of a midplane will give the cage a new number because the midplane serial number is different.

To migrate data back to the drive cage: 1 In the SP window, issue the showcage command and note the new cage number to be used with the servicemag resume command. Because the old cage number (name) will no longer exist, servicemag resume must be issued to the new cage number (name). cli% showcage Id Name LoopA Pos.A LoopB Pos.B Drives 0 cage0 0:0:1 0 2:0:1 0 16 1 cage1 0:0:2 0 2:0:2 0 16 2 cage2 0:2:1 0 2:2:1 0 16 3 cage3 0:2:2 0 2:2:2 0 16
...

Temp 31-34 31-36 26-29 29-32

RevA 08 08 08 08

RevB 08 08 08 08

Model DC4 DC4 DC4 DC4

Side n/a n/a n/a n/a

10.11
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Issue the showpd command and check that all drive magazines are in a valid state.

cli% showpd Id 0 1 2 3
...

CagePos 0:0:0 0:1:0 0:2:0 0:3:0

Type Speed(K) State FC 15 normal FC 15 normal FC 15 normal FC 15 normal

---Size(MB)---Total Free 139520 0 139520 0 139520 0 139520 0

-----------Ports----------A0 B0 A1 B1 0:0:1* 2:0:1 1:0:1 3:0:1 0:0:1* 2:0:1 1:0:1 3:0:1 0:0:1* 2:0:1 1:0:1 3:0:1 0:0:1* 2:0:1 1:0:1 3:0:1

Issue the servicemag resume <X Z> command, where X is the new drive cage number and Z is the location of the drive magazine in the drive chassis.

cli% servicemag resume 4 0 Are you sure you want to run servicemag? select q=quit y=yes n=no: y servicemag resume 4 0 ... onlooping mag 4 0 ... checking for valid disks... ... disks in mag : 4 0 ... valid disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not valid disks: ... firmware is current on pd WWN [5000C50002841761] Id [56] ... firmware is current on pd WWN [5000C500028486F2] Id [57] ... firmware is current on pd WWN [5000C5000284173F] Id [58] ... firmware is current on pd WWN [5000C50002841675] Id [59] ... verifying disk 56 ... verifying spare space for disks 56 and 56 ... verifying disk 57 ... verifying spare space for disks 57 and 57 ... verifying disk 58 ... verifying spare space for disks 58 and 58 ... verifying disk 59 ... verifying spare space for disks 59 and 59 ... playback chunklets from pd WWN [5000C50002841761] Id [56] ... playback chunklets from pd WWN [5000C500028486F2] Id [57] ... playback chunklets from pd WWN [5000C5000284173F] Id [58] ... playback chunklets from pd WWN [5000C50002841675] Id [59] The servicemag resume operation will continue in the background.

10.12
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

The servicemag resume process can take several hours or more to complete, depending on the number of chunklets to be relocated. Once servicemag status shows that chunklets are being relocated from spare space, continue to start the next servicemag. Servicemag completion may be monitored with the servicemag status command.

NOTE: Up to five servicemag -resume operations may be running at once.

10.13
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Issue the servicemag status -d <X Z> command where X is the drive cage number and Z is the location of the drive magazine in the drive chassis from the previously issued

servicemag start command.


cli% servicemag status -d 4 0 The magazine was brought online by a successful servicemag resume command. The command completed at Wed Nov 21 07:57:38 2007. The output of the servicemag resume was: servicemag resume 4 0 ... onlooping mag 4 0 ... checking for valid disks... ... disks in mag : 4 0 ... valid disks: WWN [5000C50002841761] Id [56] diskpos [0] .................... WWN [5000C500028486F2] Id [57] diskpos [1] .................... WWN [5000C5000284173F] Id [58] diskpos [2] .................... WWN [5000C50002841675] Id [59] diskpos [3] ... not valid disks: ... firmware is current on pd WWN [5000C50002841761] Id [56] ... firmware is current on pd WWN [5000C500028486F2] Id [57] ... firmware is current on pd WWN [5000C5000284173F] Id [58] ... firmware is current on pd WWN [5000C50002841675] Id [59] ... verifying disk 56 ... verifying spare space for disks 56 and 56 ... verifying disk 57 ... verifying spare space for disks 57 and 57 ... verifying disk 58 ... verifying spare space for disks 58 and 58 ... verifying disk 59 ... verifying spare space for disks 59 and 59 ... playback chunklets from pd WWN [5000C50002841761] Id [56] ... playback chunklets from pd WWN [5000C500028486F2] Id [57] ... playback chunklets from pd WWN [5000C5000284173F] Id [58] ... playback chunklets from pd WWN [5000C50002841675] Id [59] ... All chunklets played back / relocated. ... no chunklets to move servicemag resume 4 0 -- Succeeded When the command completes successfully, Succeeded is returned on the display.

10.14
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Repeat step 3 until all drive magazines in the cage have been restored then continue to the next step.

Issue the showcage -d command and check all the ports and connections are in operable condition.

cli% showcage -d cage0 Id Name LoopA Pos.A LoopB Pos.B Drives Temp RevA RevB Model Side 0 cage1 2:0:2 0 3:0:2 0 16 23-36 2.14 2.14 DC4 n/a 1 cage2 2:0:3 0 3:0:1 0 16 23-35 2.14 2.14 DC4 n/a ... 7 When all servicemag -resume operations have successfully completed, the old cage name should be removed from the systems memory by entering servicecage remove <cage_name> where cage_name is the old (missing) cage number (name). 8 9 Issue the checkhealth -svc command to verify the system is healthy. Re-connect the customers Ethernet cable, if applicable, and all other cables to the node once the node has rebooted. 10 In the SP window, issue the exit command to stop the CLI session. 11 Log out of the spmaint session by selecting X to exit from the 3PAR Service Processor Menu. 12 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 13 Remove the red crossover Ethernet cable from the laptop and coil and replace the cable behind the SP. 14 Close and lock the rear door of the InServ. 15 Replace the bezel that covers the front of the InServ. 16 Replace and secure the front fascias on the storage server frame if applicable.

10.15
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

10.16
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

11 Replacing a Controller Node


In this chapter
11.1 General Precautions 11.2 Controller Node Replacement Procedure 11.1 11.2

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

11.1 General Precautions


When handling controller nodes, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing a Controller Node

11.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

11.2 Controller Node Replacement Procedure


To replace a controller node:

NOTE: If the failed node is already offline, it is not necessary to shutdown the node because it is already not part of the cluster. Skip to step 11 on page 11.3.

Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP), using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the SP by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 4 Select option 7 , Interactive CLI for an InServ. Select the desired InServ. Issue the showversion b command to display the version of the InForm OS currently in use by the cluster. Make note of the Release version. cli% showversion b Release version 2.3.1.180 Patches: None Component Name CLI Server CLI Client System Manager Kernel TPD Kernel Code Utilities Software Updater Version 2.3.1.180 2.3.1.180 2.3.1.180 2.3.1.180 2.3.1.180 2.3.1.180 2.3.1.180

5 6 7

Type exit to end the CLI session and to return to the 3PAR Service Processor Menu Select option 4 , InServ Product Maintenance . Select option 6 , Halt an InServ cluster/node .

11.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

8 9

Select the desired InServ. Select the desired node and confirm all prompts to halt the node.

10 Allow 2 to 3 minutes for the node to halt, then verify the node status LED is flashing green and the node hot-plug LED is solid amber indicating the node has been halted. 11 Disconnect the cables from the front of the controller node, noting the locations of all cables. If necessary, mark the cables that connect to the controller nodes before removing them. The drive-side Fibre Channel cables are marked to simplify this task. 12 Wearing a wrist grounding strap, use a #2 Phillips screwdriver to loosen the captive screw that secures the insertion/removal lever of the controller node (Figure 11-1).

Captive Screw

0570_L_R1

Figure 11-1. Loosening the Captive Screw on a Controller Node

13 Pull the controller node insertion/removal lever (1) out to disengage the node from the chassis midplane, see Figure 11-2.

11.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

14 With one hand on the handle (2) of the controller node and the other hand supporting the controller node from the bottom, slide the node out of the chassis, as shown in Figure 11-2, and place it on an Electrostatic Discharge-safe (ESD-safe) work surface.

1
0569_L_R2

Figure 11-2. Removing the Controller Node from the Chassis

CAUTION: Always use a wrist grounding strap to perform this procedure. A wrist grounding strap is provided with the InServ Storage Server. Attach the grounding strap clip directly to an unpainted surface of the rack.

15 Remove the replacement controller node from its protective packaging and place it onto an ESD-safe work surface next to the failed node.

11.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

16 Use a #2 Phillips screwdriver to remove the two screws securing the lid covers at the rear of the nodes and remove the covers of both nodes (Figure 11-3).

Screws (2x)

Rear of Node
0567_L_R1

Figure 11-3. Controller Node Lid Screws

17 Use a #2 Phillips screwdriver to loosen the captive screw securing the PCI retention bar to the node housing and remove the retention bar on both nodes, as shown in Figure 11-4.

0644_L_R2

Figure 11-4. Removing the PCI Adapter Retention Bar

11.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

18 Remove each PCI card by grasping the sides of each card and pulling upward, noting the position of each removed card in the node. For a 3PAR Fibre Channel adapter, use the attached loop handle to remove the card. 19 Install the removed PCI cards into the same slot number of the replacement node. Push down on each card until fully seated. 20 Replace the PCI adapter retention bar by carefully aligning the notches in the retention bar with the PCI cards. 21 At the front of the nodes, examine the part numbers of the old and new controller nodes. If the part numbers are the same, the riser cards with DIMMs may be moved intact. The data cache riser cards in older nodes are not interchangeable with newer nodes, and the DIMMs must be removed from the older riser cards and moved to the new riser cards. 22 Remove both data cache riser card retainers by pulling upward (Figure 11-5).
Riser Card Retainers

Guides

0602_L_R1

Figure 11-5. Removing the Data Cache Riser Card Retainers

11.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

23 Remove the data cache riser cards from the failed node by grasping the lift holes of the card and pulling upward (Figure 11-6). Avoid touching the surface of the data cache DIMMs when handling the riser card.

Loop Handle (2x)

0564_L_R2

Figure 11-6. Removing the Data Cache Riser Card

NOTE: If the data cache riser cards in the old and new nodes have the same part numbers, they may be moved between nodes (with DIMMs intact). If they are different, the DIMMs must be removed and installed in the new node's riser cards.

24 Install the data cache riser cards into the replacement node by inserting them into the slots on the node and pushing down on the cards until they are fully seated.

NOTE: Installing the 4-slot riser card takes much more force than the 2-slot riser does. Two audible pops should be heard when seating it and the top of the riser should be flush with the top of the bulkhead guide brackets.

11.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

The data cache riser cards need to be inserted between the staggered guides in the bulkhead of the controller node, see Figure 11-7.
4-Slot Data Cache Riser Card Guide 2-Slot Data Cache Riser Card Guide

0603_L_R3

Figure 11-7. Staggered Guides for the Data Cache Riser Card

25 Reinstall the riser card retainers into the controller node. Be sure to slide the riser card retainers between the parallel guides of the bulkhead (Figure 11-8).
Riser Card Retainer (2x)

0604_L_R1

Figure 11-8. Parallel Guides for the Riser Card Retainer

11.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

26 You may be able to swap the internal node disk between nodes to shorten replacement time, provided the disk in the failed node is expected to be good. If the disk in the outgoing node is questionable, do not swap the disks. See Chapter 17, Replacing a Disk in a Node for additional information for replacing and rebuilding a disk. a If the disks were swapped: 1) It is not necessary to perform the node-rescue procedure to install the software on the node disk. 2) Properly install the blank disk into the failed node to prevent damage during shipping. b If the disks were not swapped, it is necessary to install software on the blank disk by performing the node-rescue procedure. 27 Use a #2 Phillips screwdriver to install the lid cover on the replacement node with the two screws previously removed. 28 Properly secure the parts and cover on the failed controller node then place it into the protective packaging for return to 3PAR. 29 Insert the replacement controller node into the chassis. Do not push the node lever all the way in at this time. a b If the node-rescue procedure must be performed, see Appendix D, Node Rescue. If a node-rescue is not needed because the node-disks were swapped, continue to step 30.

WARNING: After the new node is installed, do not connect the cables at this time.

11.9
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

30 While applying mild pressure to handle (1) push the insertion lever (2) in quickly until it is flush with the node. The quick insertion of (2) helps to overcome the initial insertion force of the connector (Figure 11-9).

NOTE: Quick does not mean pushing more forcefully or harder.

0641_L_R2

Figure 11-9. Replacing the Controller Node

11.10
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

31 Use a #2 Phillips screwdriver to tighten the captive screw that secures the lever to the controller node chassis. Do not overtighten the screw (Figure 11-10). The node will boot one or two times depending on the BIOS level (the node requires approximately seven minutes per boot cycle).

Captive Screw

0570_L_R1

Figure 11-10. Node Captive Screw

32 Verify the node LED is blinking green indicating that the node has joined the cluster. 33 Select option 7 , Interactive CLI for an InServ from the spmaint session. 34 Select the desired InServ. 35 Verify the node has joined the cluster by issuing the shownode command. cli% shownode Control Data Cache Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100 36 Reboot the replaced node one more time to synchronize software and hardware values by issuing the shutdownnode reboot <node_ID> command.

11.11
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

37 After the node reboots (5 -10 minutes), monitor the node status LED and verify again that all nodes joined the cluster by issuing the shownode command. cli% shownode Control Data Cache Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100 38 Issue the checkhealth -svc command to verify the system is healthy. 39 Re-connect the customers Ethernet cable, if applicable, and all other cables to the node once the node has rebooted.

CAUTION: Do not reconnect host cables without verifying the controller node is functioning properly.

40 In the SP window, issue the exit command to stop the CLI session. 41 Log out of the spmaint session by selecting X to exit from the 3PAR Service Processor Menu. 42 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 43 Remove the red crossover Ethernet cable from the laptop and coil and replace the cable behind the SP. 44 Close and lock the rear door of the InServ. 45 Replace the bezel that covers the front of the InServ. 46 Replace and secure the front fascias on the storage server frame if applicable.

11.12
3PAR Confidential

Controller Node Maintenance Procedures

3PAR Confidential

3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

12 Replacing an SFP on a PCI Adapter


In this chapter
12.1 General Precautions 12.2 SFP Module Replacement Procedure 12.1 12.2

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

12.1 General Precautions


When handling SFP modules, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing an SFP on a PCI Adapter

12.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

12.2 SFP Module Replacement Procedure


This section describes the procedure for replacing an SFP module in a 3PAR fibre channel adapter. A maximum of four SFP modules are located in the 3PAR adapter located at the front of the controller node (Figure 12-1). To replace an SFP module: 1 Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the SP by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 4 Select option 7 , Interactive CLI for an InServ. Select the desired InServ. Issue the CLI command showport and verify which port has the degraded SFP. cli% showport N:S:P Mode 0:0:1 initiator 0:0:2 initiator 0:0:3 initiator 0:0:4 initiator 0:6:1 peer 1:0:1 initiator 1:0:2 initiator 1:6:1 peer

State offline ready ready ready ready ready ready ready

----Node_WWN---- -Port_WWN/HW_Addr- Type 2FF70002AC0000A3 20010002AC0000A3 disk 2FF70002AC0000A3 20020002AC0000A3 free 2FF70002AC0000A3 20030002AC0000A3 free 2FF70002AC0000A3 20040002AC0000A3 free 2FF70002AC0000A3 0002AC530016 rcip 2FF70002AC0000A3 21010002AC0000A3 disk 2FF70002AC0000A3 21020002AC0000A3 free 2FF70002AC0000A3 0002AC530019 rcip

12.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Issue the showport -sfp command and verify the SFP that requires replacement. See Figure 12-1 for SFP numbering. cli% showport -sfp N:S:P -State- -Manufacturer- MaxSpeed(Gbps) TXDisable 0:0:1 Degraded FINISAR_CORP. 4.20 No 0:0:2 OK FINISAR_CORP. 4.20 No 0:0:3 OK FINISAR_CORP. 4.20 No 0:0:4 OK FINISAR_CORP. 4.20 No

TXFault No No No No

RXLoss No Yes Yes Yes

DDM Yes Yes Yes Yes

Port 1

1 2 3 4

Port 4

0796_L_R1

Figure 12-1. 3PAR Fibre Channel Adapter

To replace a 3PAR fibre channel adapter SFP: 1 2 Remove the bezel at the front of the storage server. Wearing a wrist grounding strap, identify the SFP module that requires replacement and disconnect the cable from the SFP. 3 Lift out on the retaining clip of the defective SFP module and carefully slide the SFP out of the slot.

12.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

4 5 6

Remove the replacement SFP module from its protective packaging. Place the defective SFP module into the protective packaging for return to 3PAR. Carefully slide the replacement SFP module into the fibre channel adapter until fully seated and close the wire handle to secure it in place.

7 8

Reconnect the cable to the SFP module. Issue the CLI command showport and verify that the ports are in good condition. cli% showport N:S:P Mode 0:0:1 initiator 0:0:2 initiator 0:0:3 initiator 0:0:4 initiator 0:6:1 peer 1:0:1 initiator 1:0:2 initiator 1:6:1 peer

State ready loss_sync loss_sync loss_sync offline ready loss_sync offline

----Node_WWN---- -Port_WWN/HW_Addr- Type 2FF70002AC0000A3 20010002AC0000A3 disk 2FF70002AC0000A3 20020002AC0000A3 free 2FF70002AC0000A3 20030002AC0000A3 free 2FF70002AC0000A3 20040002AC0000A3 free 0002AC530016 rcip 2FF70002AC0000A3 21010002AC0000A3 disk 2FF70002AC0000A3 21020002AC0000A3 free 0002AC530019 rcip

Issue the showport -sfp command and verify the replaced SFP is connected. cli% showport N:S:P -State0:0:1 OK 0:0:2 OK 0:0:3 OK 0:0:4 OK -sfp -Manufacturer- MaxSpeed(Gbps) TXDisable FINISAR_CORP. 4.20 No FINISAR_CORP. 4.20 No FINISAR_CORP. 4.20 No FINISAR_CORP. 4.20 No

TXFault No No No No

RXLoss No No No No

DDM Yes Yes Yes Yes

10 Issue the checkhealth -svc command to verify your system is healthy. 11 In the SP window issue the exit command to stop the CLI session. 12 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu .

12.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

13 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 14 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 15 Close and lock the rear door of the InServ. 16 Replace the bezel that covers the front of the InServ. 17 Replace and secure the front fascia on the storage server if applicable.

12.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

12.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

13 Replacing a PCI Adapter


In this chapter
13.1 General Precautions 13.2 PCI Adapter Replacement Procedure 13.1 13.2

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

13.1 General Precautions


When handling PCI adapters, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing a PCI Adapter

13.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

13.2 PCI Adapter Replacement Procedure


This section describes the procedure for replacing a PCI adapter.

NOTE: The GUI, as well as the CLI command showport -i, will display the PCI card brand and model.

A maximum of six PCI adapters are located at the front of the controller nodes (Figure 13-1).

PCI Slots
0593_L_R1

Figure 13-1. PCI Adapters in the Controller Node

13.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

To replace a PCI adapter inside the controller node:

NOTE: If the node previously halted due to a PCI adapter problem, it is not necessary to shutdown the node because it is already not part of the cluster.

Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the SP by entering your login name and password.

2 3 4 5 6

Select option 4 , InServ Product Maintenance . Select option 6 , Halt an InServ cluster/node . Select the desired InServ. Select the desired node and confirm all prompts to halt the node. Allow 2 to 3 minutes for the node to halt, then verify the node status LED is flashing green and the node hot-plug LED is solid amber indicating that the node has been halted.

Disconnect the cables from the front of the controller node, noting the locations of all cables. If necessary, mark the cables that connect to the controller nodes before removing them. The drive-side Fibre Channel cables are marked to simplify this task.

Remove the controller node from the node chassis by following the procedure described in Removing a Controller Node on page C.2.

Place the controller node on an ESD-safe, level work surface.

13.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

10 Use a #2 Phillips screwdriver to loosen the captive screw securing the PCI retention bar to the node housing and remove the retention bar, as shown in Figure 13-2.

0644_L_R2

Figure 13-2. Removing the PCI Adapter Retention Bar

11 Locate the PCI adapter that requires replacement and remove the adapter by grasping the sides of the card and pulling upward. For a 3PAR Fibre Channel adapter, use the attached loop handle to remove the card. 12 Remove the replacement adapter from its protective packaging and insert it into the same PCI slot that held the removed adapter. 13 Push down on the adapter until it is fully seated. Reinstall the PCI retention bracket and tighten the screw that secures the PCI retention bar to the controller node housing.

NOTE: When replacing adapters, make sure that the EMI gasketing material is aligned properly and does not obscure the adapter LEDs at the front of the controller node.

13.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

14 Replace the PCI adapter retention bar by carefully aligning the notches in the retention bar with the PCI cards. 15 Reinstall the controller node by following the procedures described in Replacing a Serviced Controller Node on page C.5. Once installed, allow approximately 5 minutes for the node to boot. When the node has rebooted, the node status LED will flash green (1 blink per second). 16 In the SP window, select option 7, Interactive CLI for an InServ. 17 Select the desired InServ. 18 Issue the shownode command and verify the node has joined the cluster. cli% shownode Control Data Cache Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 0 1000163-0 OK No Yes GreenBlnk 4096 6144 100 1 1000163-1 OK Yes Yes GreenBlnk 4096 6144 100 19 Issue the showport command and verify the port is ready as shown in the example below: NOTE: A port must be connected and correctly communicating to be ready. Verify if the port (State column) is ready.

cli% showport N:S:P Mode 0:0:1 initiator 0:0:2 initiator 0:2:1 initiator 0:2:2 initiator ...

State ready ready ready ready

----Node_WWN---- -Port_WWN/HW_Addr- Type 2FF70002AC000074 20010002AC000074 free 2FF70002AC000074 20020002AC000074 disk 2FF70002AC000074 20210002AC000074 free 2FF70002AC000074 20220002AC000074 free

13.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

20 Issue the showport -i command and verify the correct card is installed in the correct slot as shown in the example below: cli% showport -i N:S:P Brand Model 0:0:1 3PAR FC044X 0:0:2 3PAR FC044X 0:2:1 3PAR FC044X 0:2:2 3PAR FC044X ...

Rev Firmware Serial 02 2.00.17.00 5972662003 02 2.00.17.00 5972662003 02 2.00.17.00 3986183102 02 2.00.17.00 3986183102

21 Issue the checkhealth -svc command to verify your system is healthy. 22 In the service processor window issue the exit command to stop the CLI session. 23 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 24 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 25 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 26 Close and lock the rear door of the InServ. 27 Replace the bezel that covers the front of the InServ. 28 Replace and secure the front fascia on the storage server if applicable.

13.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

14 Replacing Control Cache


In this chapter
14.1 General Precautions 14.2 Control Cache Replacement Procedure 14.1 14.2

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

14.1 General Precautions


When handling control cache, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing Control Cache

14.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

14.2 Control Cache Replacement Procedure


This section describes the procedure for replacing a control cache DIMM. Controller nodes contain two control cache DIMMs to support the node microprocessors.

NOTE: The replacement DIMM must be from the same manufacturer and must have the same manufacturer part number as the failed DIMM. The DIMM manufacturer and part number can be found using shownode -i and shownode -mem. You can also visually inspect the DIMM.

To replace a control cache DIMM inside a controller node:

NOTE: If the failed node is already halted, it is not necessary to shutdown the node because it is already not part of the cluster.

Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the service processor by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 Select option 7 , Interactive CLI for an InServ. Select the desired InServ.

14.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Issue the shownode -i command to identify the DIMM manufacturer and manufacturer part number.

cli% shownode -i -------------------------------------------Physical Memory---------------------------------Node Riser Slot SlotID Name Type --Manufacturer--- ----PartNumber---- -Serial--Rev-Size(MB) 2 n/a 0 J4200 DIMM0 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A4 4431 2048 2 n/a 1 J4300 DIMM1 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A7 4431 2048 2 2-slot 0 J0901 DIMM0.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B12 0300 2048 2 4-slot 1 J0900 DIMM1.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B1A 0300 2048 2 4-slot 2 J1300 DIMM2.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49A7 0300 2048 2 2-slot 3 J0801 DIMM0.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49CE 0300 2048 2 4-slot 4 J0800 DIMM1.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4ABE 0300 2048 2 4-slot 5 J1200 DIMM2.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4A6D 0300 2048

5 6 7 8 9

Type exit to end the CLI session and to return to the 3PAR Service Processor Menu Select option 4 , InServ Product Maintenance . Select option 6 , Halt an InServ cluster/node . Select the desired InServ. Select the desired node and confirm all prompts to halt the node.

10 Allow 2 to 3 minutes for the node to halt, then verify the node status LED is flashing green and the node hot-plug LED is solid amber indicating that the node has been halted. 11 Disconnect the cables from the front of the controller node, noting the locations of all cables. If necessary, mark the cables that connect to the controller nodes before removing them. The drive-side Fibre Channel cables are marked to simplify this task. 12 Remove the controller node from the node chassis by following the procedure described in Removing a Controller Node on page C.2. 13 Place the controller node on an ESD-safe, level work surface.

14.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

14 Use a #2 Phillips screwdriver to remove the two screws securing the lid cover at the rear of the node and remove the cover (Figure 14-1).

Screws (2x)

Rear of Node
0567_L_R1

Figure 14-1. Removing the Node Cover

15 Locate the control cache DIMM that requires replacement (Figure 14-2).

Control Cache DIMMs: DIMM 0 DIMM 1


0574_L_R2

Figure 14-2. Controller Node Control Cache Locations

14.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

16 Release the control cache DIMM by pressing outward on the two tabs on the sides of the DIMM, as shown in Figure 14-3.

0026_L_R1

Figure 14-3. Releasing a Control Cache DIMM

17 Physically inspect the DIMM to make sure the manufacturer and manufacturer part number match the failed DIMM. Use the following descriptions to identify the DIMM by manufacturer:

Simple TechIdentified by STEC on top surface at the edge of the DIMM. MicronIdentified by M inside an ellipse on top surface at the edge of the DIMM.

18 Remove the replacement DIMM from its protective packaging.

14.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

19 Avoid touching the surface of the DIMM when inserting it into the vacant slot in the controller node (Figure 14-4).

0027_L_R1

Figure 14-4. Inserting a Replacement Control Cache DIMM

20 Insert the control cache DIMM by pushing downward on the edge of the DIMM until the tabs on both sides snap into place. 21 Use a #2 Phillips screwdriver to install the lid cover on the replacement node with the two screws previously removed. 22 Replace the controller node by following the procedures described in Replacing a Serviced Controller Node on page C.5. 23 In the service processor window, select option 7, Interactive CLI for an InServ from the 3PAR Service Processor Menu . 24 Select the desired InServ. 25 Issue the shownode command and verify the node has joined the cluster. cli% shownode Control Data Cache Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100

14.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

26 Issue the shownode -i command and verify the control cache is operational.
cli% shownode -i -------------------------------------------Physical Memory---------------------------------Node Riser Slot SlotID Name Type --Manufacturer--- ----PartNumber---- -Serial--Rev-Size(MB) 2 n/a 0 J4200 DIMM0 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A4 4431 2048 2 n/a 1 J4300 DIMM1 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A7 4431 2048 2 2-slot 0 J0901 DIMM0.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B12 0300 2048 2 4-slot 1 J0900 DIMM1.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B1A 0300 2048 2 4-slot 2 J1300 DIMM2.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49A7 0300 2048 2 2-slot 3 J0801 DIMM0.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49CE 0300 2048 2 4-slot 4 J0800 DIMM1.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4ABE 0300 2048 2 4-slot 5 J1200 DIMM2.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4A6D 0300 2048

27 Issue the checkhealth -svc command to verify your system is healthy. 28 In the service processor window issue the exit command to stop the CLI session. 29 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 30 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 31 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 32 Close and lock the rear door of the InServ. 33 Replace and secure the front fascia on the storage server if applicable.

14.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

14.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

15 Replacing Data Cache


In this chapter
15.1 General Precautions 15.2 Data Cache Replacement Procedure 15.1 15.2

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

15.1 General Precautions


When handling data cache, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing Data Cache

15.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

15.2 Data Cache Replacement Procedure


This section describes the procedure for replacing a data cache DIMM. Data cache DIMMs are located on two data cache riser cards within the nodes. One riser card holds four data cache DIMMs and the second riser card holds two data cache DIMMs. To replace a data cache DIMM inside the controller node:

NOTE: Data cache DIMMs must be replaced by the DIMMs with the same manufacturing part number.

NOTE: If the failed node is already halted, it is not necessary to shutdown the node because it is already not part of the cluster.

Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the SP by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 4 Select option 4 , InServ Product Maintenance . Select option 6 , Halt an InServ cluster/node . Select the desired InServ.

15.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Issue the shownode -i command to identify the DIMM manufacturer and the manufacturer part number.

cli% shownode -i -------------------------------------------Physical Memory---------------------------------Node Riser Slot SlotID Name Type --Manufacturer--- ----PartNumber---- -Serial--Rev-Size(MB) 2 n/a 0 J4200 DIMM0 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A4 4431 2048 2 n/a 1 J4300 DIMM1 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A7 4431 2048 2 2-slot 0 J0901 DIMM0.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B12 0300 2048 2 4-slot 1 J0900 DIMM1.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B1A 0300 2048 2 4-slot 2 J1300 DIMM2.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49A7 0300 2048 2 2-slot 3 J0801 DIMM0.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49CE 0300 2048 2 4-slot 4 J0800 DIMM1.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4ABE 0300 2048 2 4-slot 5 J1200 DIMM2.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4A6D 0300 2048 3 n/a 0 J4200 DIMM0 FB-DIMM Micron Technology 36HTF25672F667D1D4 E215539C 4431 2048 3 n/a 1 J4300 DIMM1 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A1 4431 2048 3 2-slot 0 J0901 DIMM0.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8125 0300 2048 3 4-slot 1 J0900 DIMM1.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8132 0300 2048 3 4-slot 2 J1300 DIMM2.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8149 0300 2048 3 2-slot 3 J0801 DIMM0.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8148 0300 2048 3 4-slot 4 J0800 DIMM1.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A812D 0300 2048 3 4-slot 5 J1200 DIMM2.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8164 0300 2048

6 7

Select the desired node and confirm all prompts to halt the node. Allow 2 to 3 minutes for the node to halt, then verify the node status LED is flashing green and the node hot-plug LED is solid amber indicating that the node has been halted.

Disconnect the cables from the front of the controller node, noting the locations of all cables. If necessary, mark the cables that connect to the controller nodes before removing them. The drive-side Fibre Channel cables are marked to simplify this task.

Remove the controller node from the node chassis by following the procedure described in Removing a Controller Node on page C.2.

10 Place the controller node on an ESD-safe, level work surface.

15.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

11 Use a #2 Phillips screwdriver to remove the two screws securing the lid cover at the rear of the node and remove the cover (Figure 15-1).

Screws (2x)

Rear of Node
0567_L_R1

Figure 15-1. Removing the Node Cover

12 Locate the data cache riser cards in the controller node (Figure 15-2).
4-Slot Riser Card 2-Slot Riser Card

0573_L_R2

Figure 15-2. Data Cache Riser Cards

15.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

13 Identify the DIMM(s) requiring replacement and remove the appropriate data cache riser card (Figure 15-3).

Bank 0

DIMM 0.0 (J0901) DIMM 0.1 (J0801)

Data Cache 2-Slot Riser Card

Bank 2

DIMM 2.0 (J1300) DIMM 2.1 (J1200) DIMM 1.0 (J0900) DIMM 1.1 (J0800)

Bank 1

Data Cache 4-Slot Riser Card


0563_L_R3

Figure 15-3. Data Cache DIMMs

15.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

14 Remove the appropriate data cache riser card retainer to access the data cache riser card by pulling it upward (Figure 15-4).
Riser Card Retainers Guide

0566_L_R2

Figure 15-4. Removing the Data Cache Riser Card Retainers

15 Remove the appropriate data cache riser card by grasping the lift holes of the card and pulling upward as shown in Figure 15-5. Avoid touching the surface of the data cache DIMMs when handling the riser card.

Loop Handle (2x)

0564_L_R2

Figure 15-5. Removing the Data Cache Riser Card

15.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

16 Place the data cache riser card on an ESD-safe, level work surface. 17 Release the data cache DIMM by pressing outward on the two tabs on the sides of the DIMM, as shown in Figure 15-6.

0026_L_R1

Figure 15-6. Releasing the Data Cache DIMM from the Riser Card

18 Physically inspect the DIMM to make sure the manufacturer and manufacturer part number match the failed DIMM. Use the following descriptions to identify the DIMM by manufacturer:

Simple TechIdentified by STEC on top surface at the edge of the DIMM. MicronIdentified by M inside an ellipse on top surface at the edge of the DIMM.

15.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

19 Remove the replacement data cache DIMM from its protective packaging. 20 Insert the replacement data cache DIMM into the slot that held the failed DIMM (Figure 15-7).

0027_L_R1

Figure 15-7. Inserting Replacement Data Cache into the Riser Card

Avoid touching the surface of the data cache DIMMs. 21 Insert each data cache DIMM by pushing downward on the edge of the DIMM until the tabs on both sides snap into place.

15.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

22 Install the data cache riser card into the node by inserting it into the slot on the node and pushing down on the card until it is fully seated.

NOTE: Installing the 4-slot riser card requires more force than the 2-slot riser. Two audible pops sounds when seating it and the top of the riser should be flush with the top of the bulkhead guide brackets.

The data cache riser cards need to be inserted between the staggered guides in the bulkhead of the controller node, see Figure 15-8.
4-Slot Data Cache Riser Card Guide 2-Slot Data Cache Riser Card Guide

0603_L_R3

Figure 15-8. Staggered Guides for the Data Cache Riser Card

15.9
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

23 Replace the riser card retainer in the controller node. Be sure to slide the riser card retainer between the parallel guides of the bulkhead, see Figure 15-9.
Riser Card Retainer (2x)

0604_L_R1

Figure 15-9. Parallel Guides for the Riser Card Retainer

24 Use a #2 Phillips screwdriver to install the lid cover on the replacement node with the two screws previously removed. 25 Replace the controller node by following the procedures described in Replacing a Serviced Controller Node on page C.5. 26 In the SP window, select option 7, Interactive CLI for an InServ from the 3PAR Service Processor Menu . 27 Select the desired InServ. 28 Issue the shownode command and verify the node has joined the cluster. cli% shownode Control Data Cache Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100

15.10
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

29 Issue the shownode -i command and verify the memory is operational.


cli% shownode -i -------------------------------------------Physical Memory---------------------------------Node Riser Slot SlotID Name Type --Manufacturer--- ----PartNumber---- -Serial--Rev-Size(MB) 2 n/a 0 J4200 DIMM0 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A4 4431 2048 2 n/a 1 J4300 DIMM1 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A7 4431 2048 2 2-slot 0 J0901 DIMM0.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B12 0300 2048 2 4-slot 1 J0900 DIMM1.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4B1A 0300 2048 2 4-slot 2 J1300 DIMM2.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49A7 0300 2048 2 2-slot 3 J0801 DIMM0.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A49CE 0300 2048 2 4-slot 4 J0800 DIMM1.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4ABE 0300 2048 2 4-slot 5 J1200 DIMM2.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 DF1A4A6D 0300 2048 3 n/a 0 J4200 DIMM0 FB-DIMM Micron Technology 36HTF25672F667D1D4 E215539C 4431 2048 3 n/a 1 J4300 DIMM1 FB-DIMM Micron Technology 36HTF25672F667D1D4 E21553A1 4431 2048 3 2-slot 0 J0901 DIMM0.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8125 0300 2048 3 4-slot 1 J0900 DIMM1.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8132 0300 2048 3 4-slot 2 J1300 DIMM2.0 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8149 0300 2048 3 2-slot 3 J0801 DIMM0.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8148 0300 2048 3 4-slot 4 J0800 DIMM1.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A812D 0300 2048 3 4-slot 5 J1200 DIMM2.1 DDR_SDRAM Micron Technology 36VDDF25672Y-335F3 E70A8164 0300 2048

30 Issue the checkhealth -svc command to verify your system is healthy. 31 In the SP window issue the exit command to stop the CLI session. 32 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 33 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 34 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 35 Close and lock the rear door of the InServ. 36 Replace and secure the front fascia on the storage server if applicable.

15.11
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

15.12
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

16 Replacing a Data Cache Riser Card


In this chapter
16.1 General Precautions 16.2 Data Cache Riser Card Replacement Procedure 16.1 16.2

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

16.1 General Precautions


When handling data cache riser cards, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing a Data Cache Riser Card

16.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

16.2 Data Cache Riser Card Replacement Procedure


This section describes the procedure for replacing a data cache riser card. The controller node contains two data cache riser cards. One riser card holds up to four data cache DIMMs and the second riser card holds up to two data cache DIMMs.

NOTE: There are different versions of riser cards, which are NOT interchangeable between the original node (P/N 970-200006) and the second-generation node (P/N 970-200067). Verify the replacement riser card is the same version as the riser card being replaced.

To replace a data cache riser card inside the controller node: 1 Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the SP by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 Select option 4 , InServ Product Maintenance . Select option 6 , Halt an InServ cluster/node .

NOTE: If the failed node is already halted, it is not necessary to shutdown the node because it is already not part of the cluster.

4 5

Select the desired InServ and confirm all prompts to halt the node. Allow 2 to 3 minutes for the node to halt, then verify the node status LED is flashing green and the node hot-plug LED is solid amber which indicates the node has been halted.

Remove the controller node from the node chassis by following the procedure described in Removing a Controller Node on page C.2.

Place the controller node on an ESD-safe, level work surface.

16.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Use a #2 Phillips screwdriver to remove the two screws securing the lid cover at the rear of the node and remove the lid (Figure 16-1).
Screws (2x)

Rear of Node
0567_L_R1

Figure 16-1. Removing the Node Cover

Locate the data cache riser card that needs replacement (Figure 16-2).
4-Slot Riser Card 2-Slot Riser Card

0573_L_R2

Figure 16-2. Data Cache Riser Card

16.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

10 Remove the appropriate data cache riser card retainer to access the data cache riser card by pulling it upward (Figure 16-3).
Riser Card Retainers

Guides

0602_L_R1

Figure 16-3. Removing the Data Cache Riser Card Retainers

11 Remove the appropriate data cache riser card by grasping the lift holes of the card and pulling upward as shown in Figure 16-4. Avoid touching the surface of the data cache DIMMs when handling the riser card.

Loop Handle (2x)

0564_L_R2

Figure 16-4. Removing the Data Cache Riser Card (2-Slot Card Shown)

12 Place the riser card on an ESD-safe, level work surface.

16.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

13 Remove the replacement data cache riser card from its protective packaging and place it next to the removed riser card. 14 Release the data cache DIMMs by pressing outward on the two tabs on the sides of the DIMM (Figure 16-5). Note which slots contain DIMMs.

0026_L_R1

Figure 16-5. Releasing a Data Cache DIMM

15 Insert the DIMMs into the same slot of the replacement data cache riser card by pushing downward on the edge of the DIMM until the tabs on both sides snap into place (Figure 16-6). Repeat for each DIMM. Avoid touching the surface of the data cache DIMMs.

0027_L_R1

Figure 16-6. Inserting a Data Cache DIMM

16.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

16 Replace the data cache riser card by inserting it into the slot in the controller node and pushing down on the riser card until it is fully seated (Figure 16-7).

NOTE: Installing the 4-slot riser card takes much more force than the 2-slot riser does. Two audible pops should be heard when seating it and the top of the riser should be flush with the top of the bulkhead guide brackets.

The data cache riser cards need to be inserted between the staggered guides in the bulkhead of the controller node.
4-Slot Data Cache Riser Card Guide 2-Slot Data Cache Riser Card Guide

0603_L_R3

Figure 16-7. Staggered Guides for the Data Cache Riser Card

16.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

17 Replace the riser card retainer in the controller node. Be sure to slide the riser card retainer between the parallel guides of the bulkhead, see Figure 16-8.
Riser Card Retainer (2x)

0604_L_R1

Figure 16-8. Parallel Guides for the Riser Card Retainer

18 Use a #2 Phillips screwdriver to install the lid cover on the replacement node with the two screws previously removed. 19 Replace the controller node by following the procedures described in Replacing a Serviced Controller Node on page C.5. 20 In the SP window, select option 7, Interactive CLI for an InServ from the 3PAR Service Processor Menu . 21 Select the desired InServ. 22 Issue the shownode command and verify the node has joined the cluster. cli% shownode Control Data Cache Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100

16.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

23 Issue the shownode -mem command and verify the memory is operational.
cli% Node 0 0 0 0 0 1 1 1 1 1 shownode -mem Riser Slot SlotID n/a 0 J4200 n/a 1 J4300 2-slot 0 J0901 4-slot 1 J0900 4-slot 2 J1300 n/a 0 J4200 n/a 1 J4300 2-slot 0 J0901 4-slot 1 J0900 4-slot 2 J1300

-Name-DIMM0 DIMM1 DIMM0.0 DIMM1.0 DIMM2.0 DIMM0 DIMM1 DIMM0.0 DIMM1.0 DIMM2.0

-UsageControl Control Data Data Data Control Control Data Data Data

--Type--FB-DIMM FB-DIMM DDR_SDRAM DDR_SDRAM DDR_SDRAM FB-DIMM FB-DIMM DDR_SDRAM DDR_SDRAM DDR_SDRAM

--Manufacturer--Micron Technology Micron Technology Micron Technology Micron Technology Micron Technology Micron Technology Micron Technology Micron Technology Micron Technology Micron Technology

-SerialE20BC997 E20BC996 E010DF65 E010DF98 E010DF64 E20BC995 E20BC992 E010DF6A E010DF6F E010DF69

-Latency- Size(MB) CL5.0/5.0 2048 CL5.0/5.0 2048 CL2.0/2.5 2048 CL2.0/2.5 2048 CL2.0/2.5 2048 CL5.0/5.0 2048 CL5.0/5.0 2048 CL2.0/2.5 2048 CL2.0/2.5 2048 CL2.0/2.5 2048

24 Issue the checkhealth -svc command to verify your system is healthy. 25 In the SP window issue the exit command to stop the CLI session. 26 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 27 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 28 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 29 Close and lock the rear door of the InServ. 30 Replace the bezel that covers the front of the InServ. 31 Replace and secure the front fascia on the storage server if applicable.

16.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

17 Replacing a Disk in a Node


In this chapter
17.1 General Precautions 17.2 Node Disk Replacement Procedure 17.2.1 Performing Node Rescue 17.1 17.2 17.4

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

17.1 General Precautions


When handling a node disk, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing a Disk in a Node

17.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

17.2 Node Disk Replacement Procedure


To replace the node disk assembly:

NOTE: If the failed node is already offline, it is not necessary to shutdown the node because it is not part of the cluster.

Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the service processor by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 4 Select option 7, Interactive CLI for an InServ. Select the desired InServ. Issue the showversion b command to display the version of the InForm OS currently in use in the cluster. You will need to know the InForm OS version when running node rescue. cli% showversion b Release version 2.3.1.180 Patches: None Component Name CLI Server CLI Client System Manager Kernel TPD Kernel Code Utilities Software Updater Version 2.3.1.180 2.3.1.180 2.3.1.180 2.3.1.180 2.3.1.180 2.3.1.180 2.3.1.180

17.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

5 6 7 8 9

Type exit to end the CLI session and to return to the 3PAR Service Processor Menu . Select option 4 , InServ Product Maintenance . Select option 6 , Halt an InServ cluster/node . Select the desired InServ. Select the desired node and confirm all prompts to halt the node.

10 Allow 2 to 3 minutes for the node to halt, then verify the node status LED is rapidly flashing green (3 blinks per second) and the node hot-plug LED is steady amber. The disk hot-plug LED should be a steady or solid amber to indicate the node has been halted.

Disk Hot-plug LED Node Hot-plug LED Node Status LED


0601_L_R3

Figure 17-1. Node LEDs

11 Use a #2 Phillips screwdriver to loosen the captive screw on the disk assembly.
Captive Screw

0578 _L_R1

Figure 17-2. Disk Assembly Captive Screw

17.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

12 Slide the handle out then carefully slide the disk assembly out of the controller node. 13 Remove the replacement disk assembly from its protective packaging and set aside the electrostatic preventative packing material that surrounds the carrier. 14 Place the failed disk assembly in the electrostatic packaging for return to 3PAR. 15 If necessary, use a #2 Phillips screwdriver to release the captive screw on the disk assembly handle. Let the handle extend all the way out. 16 Hold the disk assembly by the handle and slide the assembly into the node. Be sure to carefully slide the assembly tab past the node disk notch, as shown in Figure 17-3.

Disk Carrier Slot

0577 _L_R1

Figure 17-3. Disk Carrier Tab

17 Use a #2 Phillips screwdriver to secure the captive screw of the disk carrier handle. Do not over tighten the screw.

17.2.1 Performing Node Rescue


To rebuild the internal drive in the controller node: 1 Prepare the maintenance PC as described in Chapter 3, Connecting the Maintenance PC.

NOTE: The Auto-Rescue utility of the service processor requires a functional connection to the InServ Storage Server cluster that can process CLI commands. Auto-Rescue builds the disk of the node so it contains the proper software for the cluster.

17.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

At the rear of the storage server, uncoil the red crossover Ethernet cable connected to the 3PAR private network connection of the service processor (Figure 17-4).
Service Processor Ethernet 1 Crossover Cable Ethernet 0

Node
0299_L_R1

Figure 17-4. Connecting the Crossover Cable

Connect ETH1 of the SP to the ETH0 (E0) port of the node that is being rescued through the crossover cable. Depending on the location of the service processor and the nodes, route the cable under or around the side of the storage server cabinet.

If necessary, log in to the SP to start an spmaint session by entering your login name and password.

5 6 7 8 9

Select option 4 , InServ Product Maintenance .

Select option 11, Node Rescue.


Select option 1, Configure Node Rescue. Select the desired InServ Storage Server. Select option 3, Automatic Node Rescue.

10 Enter the desired node number. 11 Select y to confirm the correct node number.

17.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Result: When communication from the SP to the node is established, the following appears on the SP: root@1200163-0 Tue Apr 01 16:53:19:~# beginning rescue function... .255.248 -s 10.255.155.54155.53 -m 255.255 Informing system manager to not autoreset node1 Resetting node 1 Attempting to contact node 1 via internal serial port Waiting for node to respond (10 seconds elapsed)... Waiting for node to respond (20 seconds elapsed)... Waiting for node to respond (30 seconds elapsed)... =Successfully started inter-node serial link communication Starting Whack, setting values, and loading image: Interacting with CBIOS on the node... . . . Booting from net... TFTP "install" from 10.255.155.54................................complete mknbi-1.2-7/first32.c (GPL) Top of ramdisk is 0X1FFFF000 Ramdisk at 0X00800000, size 0X00500000 . . . Kernel on remote node has been started. Waiting for node to join cluster. This usually takes around 10 minutes, but may take 20 minutes or longer. Install kernel is running - please wait... Waiting for node to join cluster (0 minutes and 15 seconds elapsed) =Waiting for node to join cluster (0 minutes and 30 seconds elapsed) . . . Waiting for node to join cluster (13 minutes and 15 seconds elapsed) =Node 1 has joined the cluster; node rescue successful. . . . Please wait... Starting SP tasks.....

17.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

NOTE: This process takes approximately 10 minutes. When complete, the node reboots and becomes part of the cluster. If this takes longer than 20 minutes, problems may exist and the node rescue process needs to be corrected.

12 Verify the node status LED is blinking green which indicates the node has joined the cluster. 13 Select 1, Deconfigure (name of cluster) Node Rescue. 14 Select x, Return to previous menu. 15 Select option 7, Interactive CLI for an InServ. 16 Select the desired InServ. 17 Verify that the node has joined the cluster by issuing the shownode command. cli% shownode Control Data Cache Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100 18 Issue the checkhealth -svc command to verify your system is healthy. 19 In the SP window issue the exit command to stop the CLI session. 20 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 21 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 22 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 23 Close and lock the rear door of the InServ. 24 Replace the bezel that covers the front of the InServ. 25 Replace and secure the front fascia on the storage server if applicable.

17.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

17.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

18 Replacing a Clock Battery


In this chapter
18.1 General Precautions 18.2 Clock Battery Replacement Procedure 18.1 18.1

18.1 General Precautions


When handling a clock battery, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

18.2 Clock Battery Replacement Procedure


The clock inside the controller node uses a 3-V lithium coin battery that requires periodic replacement.

NOTE: Contact 3PAR to obtain batteries and other replacement parts for InServ Storage Servers.

Replacing a Clock Battery

18.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

To replace the clock battery inside the controller node:

NOTE: If the failed node is already offline, it is not necessary to shutdown the node because it is already not part of the cluster.

Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the service processor by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 4 5 Select option 4 , InServ Product Maintenance . Select option 6 , Halt an InServ cluster/node . Select the desired InServ and confirm all prompts to halt the node. Allow 2 to 3 minutes for the node to halt, then verify the node status LED is rapidly flashing green (3 blinks per second) and the node hot-plug LED is steady amber indicating that the node has been halted.

Disk Hot-plug LED Node Hot-plug LED Node Status LED


0601_L_R3

Figure 18-1. Controller Node LED

18.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Remove the controller node from the node chassis by following the procedure described in Removing a Controller Node on page C.2.

Place the controller node on an ESD-safe, level work surface. It may be necessary, remove PCI adapters from slots four and five for easier access to replace the clock battery.

Use a #2 Phillips screwdriver to loosen the captive screw securing the PCI retention bar to the node housing and remove the retention bar, as shown in Figure 18-2.

0644_L_R2

Figure 18-2. Removing the PCI Adapter Retention Bar

18.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Remove the PCI adapters closest to the clock battery by grasping the sides of the card and pulling upward. For a 3PAR Fibre Channel adapter, use the attached loop handle to remove the card.

10 Place the PCI adapters on an ESD-safe surface. Locate the clock battery, see Figure 18-3.

TOD Battery
0596_L_R1

Figure 18-3. Controller Node Clock Battery

18.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

11 Remove the clock battery by pulling aside the retainer clip and pulling the battery up from the battery holder, see Figure 18-4. Avoid touching the internal node components when removing the battery.

Retainer Clip

0646_L_R1

Figure 18-4. Removing the Clock Battery

12 Insert the replacement 3-V lithium coin battery into the clock battery slot with the positiveside facing the node disk. 13 Replace the PCI adapters in the same slots they were removed from by pressing firmly on the top edge of the card until they are fully seated. 14 Replace the PCI adapter retention bar by carefully aligning the notches in the retention bar with the PCI cards. 15 Replace the controller node by following the procedures described in Replacing a Serviced Controller Node on page C.5. 16 In the service processor window, select option 7, Interactive CLI for an InServ from the 3PAR Service Processor Menu. 17 Select the desired InServ.

18.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

18 Issue the shownode command and verify that the node has joined the cluster. cli% shownode Control Data Cache Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 0 1000163-0 OK No Yes GreenBlnk 4096 6144 100 1 1000163-1 OK Yes Yes GreenBlnk 4096 6144 100 19 Issue the showdate command and confirm the clock setting is correct. 20 Issue the checkhealth -svc command to verify your system is healthy. 21 In the SP window issue the exit command to stop the CLI session. 22 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 23 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 24 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 25 Close and lock the rear door of the InServ. 26 Replace the bezel that covers the front of the InServ. 27 Replace and secure the front fascia on the storage server if applicable.

18.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

19 Replacing a Controller Node Chassis


In this chapter
19.1 General Precautions 19.2 Removing a Controller Node Chassis 19.3 Unpacking a Controller Node Chassis 19.4 Installing a Replacement Controller Node Chassis This chapter includes instructions for removing a controller node chassis, unpacking a replacement chassis, and installing a replacement chassis into the storage server. 19.1 19.2 19.7 19.9

19.1 General Precautions


When handling a controller node chassis, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing a Controller Node Chassis

19.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

19.2 Removing a Controller Node Chassis


To remove a controller node chassis, perform the following: 1 Remove power from the storage server. See Power-Down Procedure on page 5.2 for instructions.

CAUTION: To avoid damage to hardware and the loss of data, never power off or remove a controller node from an InServ Storage Server without confirming the hot-plug LED on the node appears amber.

Detach the AC cords from the power supplies at the rear of the chassis. To detach an AC cord, first loosen the power supply cord lock screw with a #1 Phillips screwdriver, as shown in Figure 19-1.

Cord Lock Screw

AC Cord

Screw (2x)
0054_L_R2

Figure 19-1. Loosening the Cord Lock Screw on a Power Supply (Typical)

19.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

3 4

Detach the battery cables from the node power supplies. Remove all the power supplies from the rear of the node chassis. Use a #1 Phillips screwdriver to remove the screws on the power supply and then slide out the power supply by pulling the handle (Figure 19-2).

Screws (2x)
0273_L_R3

Figure 19-2. Releasing a Power Supply

Disconnect the cables from the front of the controller nodes, noting the locations of all cables. If necessary, mark the cables that connect to the controller nodes before removing them. The drive-side Fibre Channel cables are marked to simplify this task.

Use a #2 Phillips screwdriver to remove the four screws securing the retainer bracket for the chassis being replaced.

Note the location of all controller nodes in the chassis and mark the controller nodes with these locations.

Use a #2 Phillips screwdriver to turn each screw 1 /4 turn counterclockwise to remove the front fascias of the storage server frame.

19.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Remove the outer half of the cable manager by pulling the cable manager out toward you (Figure 19-3).

0493_L_R1

Figure 19-3. Disassembling the Cable Manager

Repeat this step to remove each cable manager obstructing the path of the chassis you are removing. 10 Wearing a wrist grounding strap, use a #2 Phillips screwdriver to loosen the captive screws that secure the release levers (Figure 19-4).

Captive Screw

0570_L_R1

Figure 19-4. Loosening the Screw on a Controller Node Release Lever

19.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

11 Pull the node lever out to disengage the controller node from the chassis midplane, see (Figure 19-5). 12 With one hand on the handle of the controller node and the other hand supporting the controller node from the bottom, slide the node out of the chassis, as shown in Figure 19-5. and place it on an Electrostatic Discharge-safe (ESD-safe) work surface. Repeat this procedure until you have removed all controller nodes from the chassis.

1
0569_L_R2

Figure 19-5. Removing the Controller Node from the Chassis

19.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

13 Use an adjustable wrench to loosen the ball stud standoffs that secure the chassis to the rack (Figure 19-6).

0606_L_R1

Figure 19-6. Loosening the Ball Stud Standoffs that Secure the Node-Chassis

CAUTION: To prevent damage to the controller node chassis, do not hold or lift the chassis by the top cover.

14 Carefully slide out the controller node chassis. Use caution when lifting as the chassis is heavy. If necessary, enlist the help of another person.

19.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

19.3 Unpacking a Controller Node Chassis


InServ T-Series Storage Server chassis arrive in wooden shipping crates due to their weight.

WARNING: The shipping crates are heavy. Do not attempt to move a crate without using a pallet jack or fork lift.

To unpack a controller node chassis from a crate: 1 Use a slotted screwdriver or crow bar to pry off the four spring clamps that secure the crate door (Figure 19-7).

0102_L_R1

Figure 19-7. Removing the Spring Clamps that Secure the Crate Top

19.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

2 3

Remove the crate cover from the base by using the wooden side rails. Remove any packing material that surrounds the controller node chassis.

CAUTION: To prevent damage to the controller node chassis, do not hold or lift the chassis by the top cover.

With the help of another person, if necessary, lift the chassis to remove it from the container. Remove any slot filler panels and remaining packing materials and plastic covering from the chassis, if necessary.

NOTE: After unpacking the replacement controller node chassis, place the failed node-chassis into the crate for return to 3PAR.

19.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

19.4 Installing a Replacement Controller Node Chassis


To install a replacement controller node chassis: 1 Slide the replacement controller node chassis into the rack until it rests flush against the rack and the screw holes in the chassis align with the screw holes in the rack (Figure 19-9).

0606_L_R1

Figure 19-8. Inserting the Node Chassis into the Cabinet

Use an adjustable wrench to tighten the ball stud standoffs that secure the chassis to the rack. Do not overtighten.

19.9
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

At the front of the storage server, slide the node halfway into the chassis. Pull the insertion/ extraction lever (2) out all the way. Using the larger handle (1) push the node into the chassis until it stops (Figure 19-9).

While applying mild pressure to handle (1) push the insertion lever (2) in quickly until it is flush with the node. The quick insertion of (2) helps to overcome the initial insertion force of the connector.

NOTE: Quick does not mean pushing more forcefully or harder.

If the power supplies are ON, the PCI adapter LEDs and the node hot-plug LED should illuminate within a few seconds of when the node is inserted.

0641_L_R2

Figure 19-9. Inserting the Controller Node into the Chassis

19.10
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Use a #2 Phillips screwdriver to tighten the captive screw that secures the controller node lever to the controller node chassis (Figure 19-10). Do not overtighten the screw. Repeat this step as necessary to replace each node in the chassis.

6 7

Replace slot filler panels over any empty node slots, if necessary. Replace the outer half of the cable managers by pushing them into the inner half of the cable manager until the outer half is fully seated (Figure 19-10).

0308_L_R2

Figure 19-10. Reassembling the Cable Manager

Repeat this step for each cable manager removed. 8 Reattach the Ethernet and Fibre Channel cables that connect to the front of the controller nodes. 9 Replace the retainer bracket. Secure the bracket using the four previously removed screws.

10 Replace the power supplies at the rear of the controller node chassis by sliding each power supply into the rear of the chassis until fully seated.

19.11
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

11 Reconnect the AC cords and battery cables, and tighten all screws on the power supplies with a #1 Phillips screwdriver (Figure 19-11). Do not overtighten the screws.

Screws (2x)
0274_L_R1

Figure 19-11. Securing a Power Supply

12 Tighten the cord lock screw on the AC cords with a #1 Phillips screwdriver (Figure 19-12). Do not overtighten the screw.

Cord Lock Screw

AC Cord

Screw (2x)
0054_L_R2

Figure 19-12. Tightening the Cord Lock Screw on the Power Supply (Typical)

19.12
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

13 Turn on AC power to the storage server by turning on the servers PDU circuit breakers (Figure 19-13).

Circuit Breaker CB-1

Circuit Breaker CB-2


0295_L_R2

Figure 19-13. PDU Circuit Breakers

14 Wait approximately 5 to 7 minutes for the nodes to boot then verify that all controller node status LEDs are blinking in unison. 15 Issue a shownode command to verify all nodes are present. cli% shownode Control Data Cache Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 0 1000163-0 OK No Yes GreenBlnk 4096 6144 100 1 1000163-1 OK Yes Yes GreenBlnk 4096 6144 100 ... 16 Issue the checkhealth -svc command to verify your system is healthy. 17 In the SP window issue the exit command to stop the CLI session. 18 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 19 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 20 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 21 Close and lock the rear door of the InServ. 22 Replace the bezel that covers the front of the InServ. 23 Replace and secure the front fascia on the storage server if applicable.

19.13
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

19.14
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

20 Replacing a Controller Node Power Supply


In this chapter
20.1 General Precautions 20.2 Controller Node Power Supply Replacement Procedure 20.1 20.2

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

20.1 General Precautions


When handling the power supply, observe the precautions as described in Chapter 2, Precautions.

Replacing a Controller Node Power Supply

20.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

20.2 Controller Node Power Supply Replacement Procedure


To replace a power supply in a controller node chassis: 1 Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the SP by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 4 Select option 7 , Interactive CLI for an InServ. Select the desired InServ. Issue the shownode -ps command and confirm the node power supplys LEDs and power supply state. cli% shownode -ps Node PS -Serial- -PSState0 0 730D0036 OK 0 1 730D0019 OK 1 0 0000 Failed 1 1 730D0085 OK 5

FanState OK OK OK OK

ACState OK OK OK OK

DCState OK OK Failed OK

-BatState- ChrgLvl(%) OK 100 OK 100 OK 100 OK 100

At the rear of the controller node chassis, identify the power supply that requires replacement and set it to the OFF position.

20.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Disconnect the AC cord from the power supply by loosening the power supply cord lock screw with a #1 Phillips screwdriver, as shown in Figure 20-1, and disconnect the cord from the power supply.

Cord Lock Screw

0531_L_R2

Figure 20-1. Loosening the Cord Lock Screw on the Power Supply (Typical)

Disconnect the battery backup unit cable from the power supply.

20.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Use a #1 Phillips screwdriver to remove the screws on the power supply and then slide out the power supply by pulling the handle (Figure 20-2).

Screws (2x)
0273_L_R3

Figure 20-2. Releasing a Power Supply

Remove the replacement power supply from its protective packaging.

10 Place the removed power supply into the protective packaging for return to 3PAR. 11 Verify the replacement power supply is set to the OFF position. 12 Slide the replacement power supply into the rear of the controller node chassis until it is fully seated, aligning the screw holes on the power supply with the holes in the chassis. 13 Use a #1 Phillips screwdriver to tighten the screws securing the power supply to the chassis. Do not overtighten the screws. 14 Reconnect the AC cord and tighten the cord lock screw to prevent accidental disconnection of the AC cord. 15 Reconnect the battery cable. 16 Set the power supply to the ON position.

20.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

17 Confirm the power supplies and battery backup units show all power status LEDs as green. In the service processor window, issue the shownode -ps command and verify the power supply state. cli% shownode -ps Node PS -Serial- -PSState0 0 730D0036 OK 0 1 730D0019 OK 1 0 730D0090 OK 1 1 730D0085 OK

FanState OK OK OK OK

ACState OK OK OK OK

DCState OK OK OK OK

-BatState- ChrgLvl(%) OK 100 OK 100 OK 100 OK 100

18 Issue the checkhealth -svc command to verify your system is healthy. 19 In the SP window issue the exit command to stop the CLI session. 20 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 21 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 22 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 23 Close and lock the rear door of the InServ. 24 Replace the bezel that covers the front of the InServ. 25 Replace and secure the front fascia on the storage server if applicable.

20.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

20.6
3PAR Confidential

Power System Maintenance Procedures

3PAR Confidential

3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

21 Replacing a Drive Chassis Power Supply


In this chapter
21.1 General Precautions 21.2 Drive Chassis Power Supply Replacement Procedure 21.2 21.2

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

Replacing a Drive Chassis Power Supply

21.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

21.1 General Precautions


When handling a power supply, observe the precautions as described in Chapter 2, Precautions.

21.2 Drive Chassis Power Supply Replacement Procedure


To replace a power supply in a drive chassis: 1 Start an spmaint session. a Connect the maintenance PC to the Service Processor (SP), using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the service processor by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 Select option 7 , Interactive CLI for an InServ. Select the desired InServ.

21.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Issue the showcage d <cage> command, where <cage> is the specific cage number, and verify the power supply LED and power supply state as shown in the following screen.

cli% showcage -d cage0 -----LoopA----- -----LoopB----Id Name A0 A1 Pos B0 B1 Pos Drives Temp RevA RevB Model Side 0 cage0 0:0:1 1:0:1 0 2:0:1 3:0:1 0 16 31-35 08 08 DC4 n/a -----------Cage detail info for cage0 --------Position: -------------Midplane Info-----------VendorId,ProductId 3PARdata,DC4 Serial_Num OPS69907C0149F3 Node_WWN 20000050CC0149F3 TempSensor_State OK TempSensor_Value 39 OpsPanel_State OK Audible_Alarm_State Muted ID_Switch 1 Cage_State OK Interface Board Info LoopA LoopB Firmware_status Current Current Product_Rev 08 08 IFC_State OK OK ESH_State OK OK Master_CPU Yes No Loop_Map valid valid Link_Speed 4Gbps 4Gbps Port0_State OK OK Port1_State No_SFP No_SFP Port2_State No_SFP No_SFP Port3_State OK OK Power Supply Info State Fan State AC Model ps0 Failed Med Speed Failed -ps1 OK Med Speed OK -. . .

21.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Identify the power supply requiring replacement. Set it to the OFF position (Figure 21-1).

0671_L_R1

Figure 21-1. Drive Chassis Power Supply Numbering

Disconnect the AC cord from the failed power supply. a Loosen the power supply cord lock screw with a #1 Phillips screwdriver, as shown in Figure 21-2 and rotate the retaining latch counter clock wise. b Disconnect the AC cord.

Cord Lock Screw

0634_L_R1

Figure 21-2. Loosening the Cord Lock Screw on a Power Supply

21.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Remove the power supplies from the rear of the drive cage: a Use a #1 Phillips screw drive to remove two screws securing each power supply to the chassis (Figure 21-3). b Pull the handle to remove the power supply from the drive cage.

Screws (2x)
0635_L_R1

Figure 21-3. Releasing a Drive Chassis Power Supply

Remove the replacement power supply from its protective packaging and verify that the power supply is set to the OFF position.

Place the removed power supply into the protective packaging for return to 3PAR.

10 Slide the replacement power supply into the rear of the drive chassis until fully seated. 11 Use a #1 Phillips screwdriver to tighten the screws that secure the power supply to the drive chassis housing. Do not overtighten the screws. 12 Reconnect the AC cord and tighten the cord lock screw with a #1 Phillips screwdriver. Do not overtighten the screw. 13 Set the power supply to the ON position and verify that the power supply LED is green.

21.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

14 In the service processor window, issue the showcage d <cage> command, where

<cage> is the specified cage, and verify the power status of the drive cage power supply is
OK. cli% showcage -d cage0 -----LoopA----- -----LoopB----Id Name A0 A1 Pos B0 B1 Pos Drives Temp RevA RevB Model Side 0 cage0 0:0:1 1:0:1 0 2:0:1 3:0:1 0 16 31-35 08 08 DC4 n/a -----------Cage detail info for cage0 --------Position: -------------Midplane Info-----------VendorId,ProductId 3PARdata,DC4 Serial_Num OPS69907C0149F3 Node_WWN 20000050CC0149F3 TempSensor_State OK TempSensor_Value 39 OpsPanel_State OK Audible_Alarm_State Muted ID_Switch 1 Cage_State OK Interface Board Info LoopA LoopB Firmware_status Current Current Product_Rev 08 08 IFC_State OK OK ESH_State OK OK Master_CPU Yes No Loop_Map valid valid Link_Speed 4Gbps 4Gbps Port0_State OK OK Port1_State No_SFP No_SFP Port2_State No_SFP No_SFP Port3_State OK OK Power Supply Info State Fan State AC Model ps0 OK MedSpeed OK -ps1 OK MedSpeed OK --

21.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

15 Issue the checkhealth -svc command to verify your system is healthy. 16 In the SP window issue the exit command to stop the CLI session. 17 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 18 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 19 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 20 Close and lock the rear door of the InServ. 21 Replace and secure the front fascia on the storage server if applicable.

21.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

21.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

22 Replacing a Battery Backup Unit


In this chapter
22.1 General Precautions 22.2 Battery Backup Unit Replacement Procedure 22.1 22.2

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

22.1 General Precautions


When handling batteries, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing a Battery Backup Unit

22.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

22.2 Battery Backup Unit Replacement Procedure


To replace a Battery Backup Unit (BBU): 1 Start an spmaint session: a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the SP by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 4 Select option 7 , Interactive CLI for an InServ. Select the desired InServ. Issue the showbattery command to verify the batterys information has failed.

cli% showbattery Node PS Bat Serial -State- ChrgLvl(%) -ExpDate-- Expired Testing 0 0 0 60308100 Fail 0 04/01/2007 Yes No 1 1 0 60308192 OK 100 10/11/2009 No No 5 6 Unlock and open the rear door of the storage server. Locate the battery tray and identify the BBU that requires replacement, noting its location in the battery tray. 7 At the front of the storage server, remove the bezel that covers the battery tray.

22.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

At the rear of the storage server and use a #1 Phillips screwdriver to remove the M3 screws that secure the BBU in the battery tray (Figure 22-1).

0328_L_R1

Figure 22-1. Releasing the BBU

Set the affected BBU power switches for both BATTERY A and BATTERY B to the OFF position.

10 Note the location of each battery cable and then disconnect the battery cables from the BBU to be replaced. To disconnect the cables, press the white tab on the cable connector and pull to remove.

22.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

11 Remove the battery from the front of the storage server by pulling firmly on the handle (Figure 22-2).

0329_L_R1

Figure 22-2. Removing BBU from the Battery Tray

CAUTION: The BBU weighs approximately 50 pounds. Use caution when removing the BBU from the battery tray.

12 Remove the replacement BBU from its protective packaging and verify that the power switches are set to the OFF position. 13 Slide the replacement battery into the battery tray from the front of the storage server until firmly seated. 14 Use a #1 Phillips screwdriver to tighten the screws that secure the BBU in the battery tray. Do not overtighten the screws. 15 Place the removed BBU into the protective packaging for return to 3PAR.

CAUTION: BBUs contain hazardous materials and should not be discarded. Return used batteries to 3PAR for proper disposal.

22.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

16 Reconnect all battery cables. Each controller node must connect to two separate BBUs to provide redundancy. For valid cable configurations, see Figure 22-3.
Battery Backup Units Battery Backup Units

1
3 5

0 2

1
3

0
2

Empty Node Slots

Controller Node Power Supplies

4 6

Controller Node Power Supplies

7
Battery Backup Units InServ T800 (8 nodes)

6
Battery Backup Units InServ T800 (6 nodes)

1
5* 3 7*

0 4* 2 6*

1
Controller Node Power Supplies

5* 3 7*

0 4* 2 6*

Empty Node Slots


Controller Node Power Supplies Battery Backup Units

Battery Backup Units InServ T400 or T800* (4 nodes) InServ T400 or T800* (2 nodes)

0662_L_R4

Figure 22-3. Valid BBU Cable Configurations

22.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

17 Set the power switches to the ON position for both BATTERY A and BATTERY B in the replacement BBU and verify that the battery status LEDs on all BBUs are green.

NOTE: If the battery status LEDs are amber, turn off the battery, reconnect the cables, and then power-on the battery.

18 Replace the bezel that covers the front of the battery tray. 19 Issue the showbattery command to verify that the batterys information is properly set. cli% showbattery Node PS Bat Serial -State- ChrgLvl(%) -ExpDate-- Expired Testing 0 0 0 60308194 OK 100 05/15/2010 No No 1 1 0 60308192 OK 100 10/11/2009 No No

NOTE: The serial number and expiration date is read by the InServ and automatically set.

20 Issue the checkhealth -svc command to verify your system is healthy. 21 In the SP window issue the exit command to stop the CLI session. 22 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 23 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 24 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 25 Close and lock the rear door of the InServ. 26 Replace the bezel that covers the front of the InServ. 27 Replace and secure the front fascia on the storage server if applicable.

22.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

23 Replacing a Power Distribution Unit


In this chapter
23.1 General Precautions 23.2 Replacing PDUs in Cabinets that only have Rear PDUs 23.3 Replacing PDUs in Cabinets that have Front and Rear PDUs 23.1 23.2 23.8

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

23.1 General Precautions


When handling a power distribution unit, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing a Power Distribution Unit

23.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

23.2 Replacing PDUs in Cabinets that only have Rear PDUs


Before replacing a PDU that has one or more unlit indicators, verify proper functioning of the power source at the operating site by using a volt meter to test the AC line that services the PDU. A properly functioning AC line supplies between 200 and 240 VAC +/ 10 percent (180 and 264 VAC). Upon testing, if the AC line is:

not delivering between 200 and 240 VAC +/ 10 percent (180 and 264 VAC), consult a qualified electrician.

not functioning properly, replace the failing PDU.

Depending on your systems configuration, PDUs can be located at the rear of the storage server, or located at the front and rear of the server.

NOTE: If the status LED for more than one power supply is off, the cause may be a failed Power Distribution Unit (PDU). Confirm the PDUs are functioning properly by verifying that all power indicators on the PDUs appear blue.

To replace a PDU, perform the following: 1 2 Unlock and open the rear door of the storage server. Confirm that the storage server has a valid redundant power configuration. To support redundant power, each power domain must include two power supplies that connect to separate PDUs, and each PDU must connect to an independent AC circuit (Four PDUs are required for redundancy for each cabinet).

23.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Figure 23-1 illustrates a valid redundant power configuration for a storage server in a 2M (40U) cabinet. For more information on redundant power, see the 3PAR InServ T-Class Storage Server Installation and Deinstallation Guide.

0-L

0-R

1-L

1-R

2-L

2-R

3-L

3-R

4-L

4-R

5-L

5-R

6-L

6-R

7-L Power Bank 1 1-L 0-L 3-L 2-L Power Bank 2

7-R

PDU 0 PDU 1

3-R 2-R 1-R 0-R

5-L 4-L 7-L 6-L

PDU 2 7-R 6-R PDU 3 5-R 4-R


0202_L_R3

Figure 23-1. T400 or Drive Chassis Cabinet Valid Redundant Power Configuration (1U PDUs)

23.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Set the power breakers on the failed PDU to the OFF position (Figure 23-2), and unplug the PDU main power cord.

0083_L_R2

Figure 23-2. Setting the Power Breakers on the PDU to the OFF Position

Disconnect the PDU main AC cord from the customers power receptacle (Figure 23-3).

0080_L_R1

Figure 23-3. Unplugging the Power Receptacle Connector (Typical)

23.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Disconnect the AC cords that connect the power supplies to the failed PDU as follows: a Note the numbers indicated on the AC cord labels and the PDU circuit breakers to which they connect. Figure 23-4 shows the location and order of the two circuit breakers in the PDU.

Circuit Breaker CB-1

Circuit Breaker CB-2


0295_L_R2

Figure 23-4. Location and Order of the Circuit Breakers in the PDU

Cut the plastic tie-wraps that secure the AC cords to the PDU, using care not to cut the cords.

c 6

Unplug all AC cords from the PDU that requires replacement.

Use an adjustable wrench to disconnect the ground wire from the cabinet, as shown in Figure 23-5.

0094_L_R1

Figure 23-5. Disconnecting the Ground Wire from the Cabinet

23.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

7 8 9

Go to the front of the storage server and remove the bezel covering the failed PDU. Use a #2 Phillips screwdriver to remove the four screws securing the filler panel to the rack. Remove the screws that secure the PDU to the rack using a #2 Phillips screwdriver (Figure 23-6).

0315_L_R1

Figure 23-6. Removing the PDU from the Rack

10 If the PDU connector does not fit through the 1U opening, pull the PDU partly out from the back of the rack and rotate the PDU 90 degrees. 11 Push the PDU back into the rack. Go to the front of the storage server and pull the PDU out from the front of the rack. 12 Remove the replacement PDU from its protective packaging. 13 Place the failed PDU into the packaging for return to 3PAR. 14 At the front of the storage server, rotate the replacement PDU 90 degrees and slide it into the front of the rack. 15 Route the replacement PDUs power cable through the cabinet in a similar manner as the other cables. 16 Go to the rear of the storage server and pull the PDU through the rear opening. 17 Rotate the PDU 90 degrees so that the PDUs receptacles are facing you. 18 Slide the unit into the rack until the screw holes in the front of the PDU align with the screw holes in the rack.

23.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

19 Install the screws that secure the PDU to the rack using a #2 Phillips screwdriver. Do not overtighten. 20 Locate the green ground wire on the PDU and attach it to the grounding terminal on the cabinet where the failed PDUs ground wire was attached using an adjustable wrench. 21 Confirm that the breakers on the replacement PDU are set to the OFF position before reconnecting the AC cords that run from the power supplies to the PDU. 22 Secure the AC cords to the PDU. a b Position the AC cords between two holes in the cord retention bracket of the PDU. Route plastic tie-wraps through the holes in the bracket on either side of the AC cords and tighten. c Push on the AC cord connectors to ensure they are fully seated.

23 Go to the front of the storage server and reinstall the filler panel covering the PDU. Tighten the four screws securing the panel to the rack. 24 Plug the replacement PDUs main power cord into the customers grounded electrical circuit.

WARNING: The main power cords for InServ Storage Servers include safety features to prevent them from being plugged into electrical circuits that are not compatible with the storage server. To prevent serious injury to people and damage to equipment, do not override this feature by using outlet adapters or by altering the power cord.

25 Set the circuit breakers on the PDU to the ON position. Verify that the power indicator LEDs appear blue. 26 Verify that all power supply status LEDs appear green. 27 Replace the bezel that covers the front of the storage server. 28 Close and lock the rear door of the storage server.

23.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

23.3 Replacing PDUs in Cabinets that have Front and Rear PDUs
1 2 Unlock and open the rear door of the storage server. Confirm that the storage server has a valid redundant power configuration. To support redundant power, each power domain must include two power supplies that connect to separate PDUs. Each PDU must connect to an independent AC circuit (Four PDUs are required for redundancy for each cabinet). Figure 23-7 illustrates a valid redundant power configuration for a storage server in a 2M (40U) cabinet. For more information on redundant power, see the 3PAR InServ T-Class Storage Server Installation and Deinstallation Guide.

23.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

0-L

0-R

1-L

1-R

2-L

2-R

3-L

3-R

5-L

5-R

6-L

6-R

7-L

7-R

8-L

8-R

1-L 0-L 3-L 2-L Rear View of Cabinet PDU 0 PDU 1 3-R 2-R 1-R 0-R

PDU 2 7-L 5-R Front View of Cabinet 6-R 8-L

PDU 3 5-L

6-L

7-R 8-R

Power Bank 1

Power Bank 2
0211_L_R3

Figure 23-7. T800 Node Cabinet Valid Redundant Power Configuration

23.9
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Go the front of the storage server and remove the bezel covering the failed PDU. Depending on the location of the failed PDU, either stay at the front of the storage server or move to the back of the server.

Set the power breakers on the failed PDU to the OFF position, and unplug the PDU main power cord (Figure 23-8).

0083_L_R2

Figure 23-8. Setting the Power Breakers on the PDU to the OFF Position

23.10
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Disconnect the PDU main AC cord from the customers power receptacle (Figure 23-3).

0080_L_R1

Figure 23-9. Unplugging the Power Receptacle Connector (Typical)

Disconnect the AC cords that connect the power supplies to the failed PDU as follows: a Note the numbers indicated on the AC cord labels and the PDU circuit breakers to which they connect. Figure 23-10 shows the location and order of the two circuit breakers in the PDU.

Circuit Breaker CB-1

Circuit Breaker CB-2


0295_L_R2

Figure 23-10. Location and Order of the Circuit Breakers in the PDU

Cut the plastic tie-wraps that secure the AC cords to the PDU, using care not to cut the cords.

Unplug all AC cords from the PDU that requires replacement.

23.11
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

7 8

Use a #2 Phillips screwdriver to remove the ground wire from the PDU. Remove the screws securing the PDU to the rack using a #2 Phillips screwdriver (Figure 23-6).

0315_L_R1

Figure 23-11. Removing the PDU from the Rack

Pull the failed PDU out from the rack.

10 Remove the replacement PDU from its protective packaging. 11 Place the failed PDU into the protective packaging for return to 3PAR. 12 Slide the replacement PDU into the rack until the screw holes in the front of the PDU align with the screw holes in the rack. 13 Install the screws that secure the PDU to the rack using a #2 Phillips screwdriver. Do not overtighten. 14 Locate the green ground wire on the rack and attach it to the PDU where the failed PDUs ground wire was attached. 15 Confirm that the breakers on the replacement PDU are set to the OFF position before reconnecting the AC cords that run from the power supplies to the PDU.

23.12
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

16 Secure the AC cords to the PDU. a b Position the AC cords between two holes in the cord retention bracket of the PDU. Route plastic tie-wraps through the holes in the bracket on either side of the AC cords and tighten. c Push on the AC cord connectors to ensure they are fully seated.

17 Plug the replacement PDUs main power cord into the customers grounded electrical circuit.

WARNING: The main power cords for InServ Storage Servers include safety features to prevent them from being plugged into electrical circuits that are not compatible with the storage server. To prevent serious injury to people and damage to equipment, do not override this feature by using outlet adapters or by altering the power cord.

18 Set the circuit breakers on the PDU to the ON position. Verify that the power indicator LEDs appear blue. 19 Verify that all power supply status LEDs appear green. 20 Replace the bezel that covers the front of the storage server. 21 Replace and secure the front fascias on the storage server frame if applicable. 22 Close and lock the rear door of the storage server.

23.13
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

23.14
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

24 Replacing an AC Cord
In this chapter
24.1 General Precautions 24.2 AC Cord Replacement Procedure 24.1 24.2

NOTE: Guided maintenance scripts are available to facilitate this procedure. See Appendix B, Guided Maintenance for additional information.

24.1 General Precautions


When handling an AC cord, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Replacing an AC Cord

24.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

24.2 AC Cord Replacement Procedure


To replace an AC cord: 1 2 Turn off the two power supplies the AC Y-cord is connected to. If possible, remove the side cover of the server to have sufficient access for the removal of the power cord. For instructions to remove the side panel of the storage server, see Chapter 4 in the 3PAR InServ T-Class Storage Server Installation, Deinstallation Guide. 3 Locate the faulty cable in the cable bundles secured to the storage server frame and make note of its location. 4 Remove the plastic tie-wraps that secure the faulty cable bundle to the storage server frame using wire cutters or equivalent. 5 6 7 Remove the plastic tie-wrap that secures the AC cord to the PDU. Unplug the AC cord from the PDU. Disconnect the damaged AC cord from the power supplies. To disconnect the AC cord, first loosen the screws on the power supply cord locks with a #1 Phillips screwdriver, as shown in Figure 24-1.

Cord Lock Screw

AC Cord

Screw (2x)
0054_L_R2

Figure 24-1. Loosening the Cord Lock Screw on the Power Supply

24.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Disconnect the damaged AC cord from the cable stud in the rack by using an adjustable wrench to loosen the nut that secures the cable on the stud (Figure 24-2).

0095_L_R1

Figure 24-2. Disconnecting the AC Cord from the Stud

Remove the faulty Y-cord from the cabinet.

10 Remove the replacement AC cord from its packaging. 11 Locate the cable bundle from which the faulty cable was removed and add the replacement cable to the bundle. 12 Label the replacement cable to correspond with the cable being replaced and then route the replacement through the storage server frame. If possible, reuse the labels from the failed AC cords.

24.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

13 Secure the replacement AC cord to the rack by placing it on an available stud and tightening the nut that holds the cable on the stud using an adjustable wrench. 14 Connect the replacement AC cord to the power supplies and tighten the cord lock screws using a #1 Phillips screwdriver to prevent accidental disconnection. 15 Connect the replacement AC cord to the PDU receptacle previously occupied by the damaged cord 16 Secure the AC cord to the PDU. a b Position the AC cord between two holes in the cord retention bracket of the PDU. Route a plastic tie-wrap through the holes in the bracket on either side of the AC cord and tighten. c Push on the AC cord connector to ensure it is fully seated.

17 Secure the bundle to its original location on the storage server frame using plastic tie-wraps. 18 Turn on the two power supplies and ensure the power supply LEDs are green. 19 If removed, replace the side panel on the storage server frame. 20 Close and lock the rear door of the storage server.

24.4
3PAR Confidential

Service Processor Maintenance Procedures

3PAR Confidential

3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

25 Service Processor Replacement and Upgrade


In this chapter
25.1 General Precautions 25.2 Replacing a Service Processor 25.2.1 Replacing a Service Processor 25.1 25.2 25.2

25.1 General Precautions


When handling a service processor, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Service Processor Replacement and Upgrade

25.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

25.2 Replacing a Service Processor


The following section describes how to replace a service processor. If a functioning service processor needs to be replaced due to a defective modem, CD, or serial and ethernet port, the service processor configuration information can be retrieved prior to removing the component. This expedites rebuilding a new service processor. See Retrieving the Rescue File From the Service Processor on page 3.1 of the 3PAR Service Processor Software Rebuild Instructions guide for additional information.

NOTE: A replacement SP FRU with 2.3.1 software installed can be used on an InServ running InForm OS 2.2.4 or 2.3.1 and should not require rebuilding. Configuration is required only.

NOTE: A replacement SP FRU with installed software 2.2.4.GA-28 or higher should not require a base image installation. The base image should already be at 3.1-5.

25.2.1 Replacing a Service Processor


To replace a 1U Service Processor: 1 2 3 Unlock and open the rear door of the storage server. At the front of the storage server, remove the bezel covering the service processor. Power down the service processor by starting an spmaint session.

NOTE: If the service processor is not functional, power down from the power switch.

At the rear of the server, connect the maintenance PC to the service processor. See Connecting to the Service Processor on page 3.9 for additional information.

Log in to the service processor by entering your login name and password.

25.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

4 5 6 7 8

In the service processor window, issue the spmaint command. Select option 1 , SP Control/Status. Select option 3 , Halt SP and confirm all prompts to halt the SP. Verify the power LED on the front of the service processor is no longer illuminated. At the rear of the storage server, disconnect all cables from the service processor making note of their locations so they can be reconnected later.

At the front of the storage server, use a #2 Phillips screwdriver to remove the two captive screws securing the service processor to the storage server.

10 Remove the service processor. 11 Remove the replacement service processor from its packaging. Insert the failed service processor into the packaging for return to 3PAR. 12 Remove the SP-ID label from the old SP and affix the label onto the replacement SP. 13 Align the replacement service processor with its shelf on the storage server chassis. Push the service processor into position until it locks into place. 14 Using a #2 Phillips screwdriver, secure the two screws. 15 Open the AC cord lock and place it around the cord end that connects to the SP and use a #1 Phillips screwdriver to secure the captive screw (Figure 25-1).

0817_L_R1

Figure 25-1. Attaching the AC Cord Lock

25.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

16 At the rear of the storage server, replace the AC cord and any removed cabling. 17 Secure the AC cord lock to the rear of the SP with a #2 Phillips screwdriver (Figure 25-2).

Captive Screw
0818_L_R1

Figure 25-2. Connecting the AC Cord Lock to the Service Processor

18 At the front of the storage server, press the power button. Verify the power LED is illuminated. For information about rebuilding the software on a service processor, see the 3PAR Service Processor Software Rebuild Instructions guide.

25.4
3PAR Confidential

Appendices

3PAR Confidential

3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

A Tools
A.1 Tools Required for Performing Maintenance
The following tools are required to perform the maintenance procedures on an InServ Storage Server as described in this manual:

Electrostatic discharge (ESD) wrist grounding strap (provided with cabinet) Electrostatic discharge (ESD) mat #1 Phillips screwdriver #2 Phillips screwdriver
1 /8 -in.

(3 mm) slotted screwdriver (5 mm) slotted screwdriver

3/ -in. 16

Diagonal cutting pliers Adjustable wrench

Tools

A.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

A.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

B Guided Maintenance
B.1 Overview
Guided maintenance scripts are provided with the service processor to help facilitate the removal and replacement of Field Replaceable Units (FRUs). The maintenance scripts execute all CLI commands and, in some cases, select the appropriate failed component to minimize user error when performing maintenance procedures. Guided maintenance is currently available for the following FRUs:

Controller node FRUs:


Controller node Internal node disk Battery backup unit Control cache DIMMs Data cache DIMMs Data cache riser card PCI adapter cards Controller node power supply SFP

Guided Maintenance

B.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Drive cage FRUs:


Drive magazine Power supply FC-AL module SFP Drive

Power system FRUs:


AC power cord Power distribution unit

B.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

B.2 Accessing Guided Maintenance


To access the guided maintenance scripts: 1 Log in to SPOCC. See Logging into the SP Onsite Customer Care Interface (SPOCC) on page 3.22 for further instructions. 2 Click Support to access the guided maintenance procedures (Figure B-1).

0674_S_R2

Figure B-1. SPOCC Home Page

B.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

On the Service Processor - Support page, click Guided Maintenance for the cluster to perform maintenance (Figure B-2).

0676_S_R2

Figure B-2. SPOCC Support Page

A new browser window is launched from which you select a specific maintenance procedure.

B.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

In the Guided Maintenance window, select the guided maintenance procedure to start a replacement activity (Figure B-3).

0675_S_R2

Figure B-3. Guided Maintenance Window

B.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

B.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

C Removing and Replacing a Controller Node


In this appendix
C.1 General Precautions C.2 Removing a Controller Node C.3 Replacing a Serviced Controller Node This chapter only provides instructions on the physical removal and replacement of the controller node. Other chapters will refer to these instructions after the node has been halted. C.1 C.2 C.5

C.1 General Precautions


When handling controller nodes, observe the precautions as described in Chapter 2, Precautions.

NOTE: If your storage server is equipped with an optional locking fascia kit, see Appendix E, Locking Fascia for additional information on removal and replacement.

Removing and Replacing a Controller Node

C.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

C.2 Removing a Controller Node


To remove a controller node: 1 At the front of the storage server, remove the bezel that covers the controller node and confirm that the hot-plug LED appears solid amber on the controller node that requires removal (Figure C-1).

CAUTION: To avoid damage to hardware and the loss of data, never power off or remove a controller node from the storage server without confirming that the hot-plug LED on the node appears solid amber.

Hot-plug LED

0619_L_R1

Figure C-1. The Hot-Plug LED on a Controller Node

NOTE: If the Fibre Channel cables are in a large bundle, it might be helpful to remove the front fascia next to the node before unplugging any cables to provide adequate space for removing the controller node. See Removing the Locking Fascia on page E.3 for instructions on removing the front fascias.

C.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Disconnect the cables from the front of the controller node, noting the locations of all cables. If necessary, mark the cables that connect to the controller nodes before removing them. The drive-side Fibre Channel cables are marked to simplify this task.

Wearing a wrist grounding strap, use a #2 Phillips screwdriver to loosen the captive screw that secures the lever of the controller node (Figure C-2).

Captive Screw

0570_L_R1

Figure C-2. Loosening the Captive Screw on a Controller Node

Pull the node insertion/removal lever (1) out to disengage the controller node from the chassis midplane, see Figure C-3.

C.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

With one hand on the handle of the controller node and the other hand supporting the controller node from the bottom, slide the node out of the chassis, as shown in Figure C-3, and place it on an Electrostatic Discharge-safe (ESD-safe) work surface.

1
0569_L_R2

Figure C-3. Removing the Controller Node from the Chassis

C.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

C.3 Replacing a Serviced Controller Node


To replace a controller node after servicing: 1 At the front of the storage server, slide the node halfway into the chassis. Pull the insertion/ extraction lever (2) out all the way. Using the larger handle (1) push the node into the chassis until it stops (Figure C-4). 2 While applying mild pressure to handle (1) push the insertion lever (2) in quickly until it is flush with the node. The quick insertion of (2) helps to overcome the initial insertion force of the connector.

NOTE: Quick does not mean pushing more forcefully or harder.

If the power supplies are ON, the PCI adapter LEDs and the node hot-plug LED should illuminate within a few seconds of when the node is inserted.

0641_L_R2

Figure C-4. Replacing the Controller Node

C.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Use a #2 Phillips screwdriver to tighten the captive screw that secures the lever to the controller node chassis. Do not overtighten the screw (Figure C-5).

Captive Screw

0570_L_R1

Figure C-5. Node Captive Screw

4 5 6 7

Reconnect the cables that connect to the front of the controller node. Verify that the power status LED on the controller node appears green. Replace the bezel at the front of the server. Replace and secure the front fascias on the storage server frame if applicable.

C.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

D Node Rescue
In this appendix
D.1 Performing an Auto-Node Rescue D.2 Performing Manual Node Rescue D.2 D.7

This appendix provides instructions on performing both auto-node and manual node rescue. Always perform the auto-node rescue procedure unless otherwise instructed.

Node Rescue

D.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

D.1 Performing an Auto-Node Rescue


To perform an Auto-Node Rescue: 1 Start an spmaint session: a Connect the maintenance PC to the Service Processor (SP) using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the service processor by entering your login name and password.

The 3PAR Service Processor Menu appears: 2 3 4 5 6 7 8 Select option 4 , InServ Product Maintenance . Select option 11, Node Rescue. Select option 1, Configure Node Rescue. Select the desired InServ. Select option 3, Automatic Node Rescue. Enter the desired node number. Select y to confirm the correct node number. After the SP communicates with the controller node, continue to the next step. 9 At the front of the storage server, gently slide the node into the chassis until it stops while keeping the insertion/removal lever fully extended.

D.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

10 At the rear of the storage server, uncoil the red crossover Ethernet cable connected to the 3PAR private network connection of the service processor.
Service Processor Ethernet 1 Crossover Cable Ethernet 0

Node
0299_L_R1

11 Connect ETH1 of the service processor to the Ethernet port (ETH0) port of the node that is being rescued through the crossover cable. Depending on the location of the service processor and the nodes, route the cable under or around the side of the storage server cabinet.

NOTE: Closing the insertion handle immediately supplies power to the controller node.

12 Push the nodes insertion/removal lever in to cam the node into the midplane and close the handle quickly.

D.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Result: When communication from the SP to the node is established, the following appears on the service processor: root@1200163-0 Tue Apr 01 16:53:19:~# beginning rescue function... .255.248 -s 10.255.155.54155.53 -m 255.255 Informing system manager to not autoreset node1 Resetting node 1 Attempting to contact node 1 via internal serial port Waiting for node to respond (10 seconds elapsed)... Waiting for node to respond (20 seconds elapsed)... Waiting for node to respond (30 seconds elapsed)... =Successfully started inter-node serial link communication Starting Whack, setting values, and loading image: Interacting with CBIOS on the node... . . . Booting from net... TFTP "install" from 10.255.155.54................................complete mknbi-1.2-7/first32.c (GPL) Top of ramdisk is 0X1FFFF000 Ramdisk at 0X00800000, size 0X00500000 . . . Kernel on remote node has been started. Waiting for node to join cluster. This usually takes around 10 minutes, but may take 20 minutes or longer. Install kernel is running - please wait... Waiting for node to join cluster (0 minutes and 15 seconds elapsed) =Waiting for node to join cluster (0 minutes and 30 seconds elapsed) . . . Waiting for node to join cluster (13 minutes and 15 seconds elapsed) =Node 1 has joined the cluster; node rescue successful. . . . Please wait... Starting SP tasks.....

D.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

NOTE: This process takes approximately fifteen minutes. When complete, the node reboots and becomes part of the cluster. If this takes longer than twenty minutes, problems may exist and the node rescue process needs to be corrected.

13 Verify that the node status LED is blinking green indicating that the node has joined the cluster, then press Enter to continue. 14 Select 1, Deconfigure <name of cluster> Node Rescue. 15 Select x, Return to previous menu until you return to the main menu. 16 Select option 7, Interactive CLI for an InServ. 17 Select the desired InServ. 18 Verify that all nodes have joined the cluster by issuing the shownode command. cli% shownode Control Data Cache Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 2 1201553-2 OK No Yes GreenBlnk 4096 12288 100 3 1201553-3 OK Yes Yes GreenBlnk 4096 12288 100 19 Issue the checkhealth -svc command to verify your system is healthy. If the system is running OS 2.2.4 or earlier, complete the following steps. a Connect the red crossover Ethernet cable to your laptop. This connects the maintenance PC to the SP private (ETH1) network. b c Type in the IP address (10.255.155.54) of the SP in the Web browser and press ENTER. Log in to the Service Processor Onsite Customer Care (SPOCC) interface from the maintenance PC using a supported Web browser. d e f g h Type your user name and password and click OK . From the SPOCC Homepage, click Support from the left column menu. Click CSStatus on the InServs Action menu. Verify CSStatus indicates the system is healthy. Log out of SPOCC by clicking Log Out on the upper right window.

D.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

20 In the service processor window issue the exit command to stop the CLI session. 21 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 22 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 23 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 24 Close and lock the rear door of the InServ. 25 Replace the bezel that covers the front of the InServ. 26 Replace and secure the front fascia on the storage server if applicable.

D.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

D.2 Performing Manual Node Rescue


The following instructions describe how to perform a manual controller node rescue using the maintenance PC: 1 Start an spmaint session: a Connect the maintenance PC to the SP using the serial connection. Refer to Connecting to the Service Processor on page 3.9 for additional information. b Log in to the service processor by entering your login name and password.

The 3PAR Service Processor Menu appears:

NOTE: Manual-Rescue builds the node disk, so it contains the proper software for the cluster.

2 3 4 5 6 7 8

In the service processor window, issue the spmaint command (if necessary). Select option 4 , InServ Product Maintenance . Select option 11 , Node Rescue . Select option 1 , Configure Node Rescue . Select the desired InServ. Select option 2 , Manual Node Rescue . Enter y to stop all service processor tasks.

D.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

At the rear of the storage server, uncoil the red crossover Ethernet cable connected to the SP (ETH1) private network connection of the service processor.
Service Processor Ethernet 1 Crossover Cable Ethernet 0

Node
0299_L_R1

10 Connect ETH1 of the service processor to the E0 port of the node that is being rescued through the crossover cable.

D.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

A screen appears displaying the steps to perform a manual node rescue. Continue to the next step.

This is the procedure for manually rescuing node(s) in InServ <name> 1. connect the node to be rescued to the SP's private network NOTE: this requires a hub or crossover cable 2. connect a laptop to the serial interface on the node to be rescued NOTE: 57600,N,8,1,XON/XOFF 3. reset, or power cycle, the node to be rescued 4. on the serial interface press ctrl-w after the 'PCI Fibre Channel Adapter Test' have started. 5. BIOS levels higher than 2.1.x support the "boot rescue" command which will automate the manual-rescue entries. FRU nodes have lower and higher levels of BIOS, however. type: boot rescue<enter> and if the node says it is an "unknown option", enter the manual-rescue information as indicated below, otherwise when the node asks for confirmation to erase the disk type: y<enter> 6. type: net netmask 255.255.255.248<enter> 7. type: net server 10.255.155.54<enter> 8. type: boot net install edit<enter> NOTE: the node will begin booting and then pause for input. 9. press the SPACEBAR once, and then type: ip=10.255.155.53 nm=255.255.255.248 rp=10.255.155.54::rescueide and press <enter> NOTE: type this line exactly!! The system will install the base OS,InFormOS, and reboot before joining the cluster. Wait for this before proceeding. There may be additional instructions from 3PAR support if you are rescuing multiple nodes. 11 Disconnect the blue ethernet (serial) cable from the adapter on the SP.

D.9
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

12 Connect the cable to the serial port (C0) on the node being rescued.

Node E0 C0

Eth1

Service Processor

Field Engineer Laptop


0661_L_R2

13 Change the baud rate to 57,600. 14 Insert the node into the chassis with the Ethernet cable connected. It will begin to boot and run tests. 15 Perform the following on the serial interface after the PCI Adapter tests (POST diagnostic test #38) have been completed: a b c Press CTRL+w. Type boot rescue and press ENTER. Select y to continue. The system installs the base OS and InForm OS. See the following for typical output.

D.10
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

NOTE: This process takes approximately 10 to 15 minutes (rescue and rebuild of disk = five minutes) + (reboot = 5-10 minutes). When complete, the node restarts and becomes part of the cluster.

Whack>boot rescue This is the procedure for manually rescuing a 3PAR InServ node (i.e., rebuilding the software on the node's internal disk). The system will install the base OS, BIOS, and InForm OS for the node before it joins the cluster. You must first connect a Category 5 crossover Ethernet cable between the SP's private/internal network (ETH-1) and the "E0" Ethernet port of the node to be rescued. Note that the diagram below does not represent the physical port numbers or configuration of all node types. New Node Service Processor +------------+ +-----------------+ ||||||| | | | ||||||| | |ETH-0 ETH-1(Int) | ||||||| E0 C0| +-----------------+ +------------+ ^ ^ ^ |____Crossover ETH____| |__Maintenance PC (serial connection) This procedure will execute the following Whack commands: 1. net addr 10.255.155.53 2. net netmask 255.255.255.248 3. net server 10.255.155.54 4. boot net install ipaddr=10.255.155.53 nm=255.255.255.248 rp=10.255.155.54::rescueide This operation will completely erase and reinstall the node's local disk. Are you sure? (Y/N) Yes TFTP "install" from 10.255.155.54..................................................................... .......................................

D.11
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

16 After 10 to 15 minutes, verify if the node LED is slowly blinking green which indicates the node has joined the cluster. 17 Disconnect the blue Ethernet cable (serial) from the node and reconnect to the adapter on the SP. 18 Change the baud rate to 38,400. 19 Log into spmaint. When you log in, you are prompted to confirm that Node Rescue is complete. 20 Select option 1, Deconfigure Node Rescue. 21 Select option x , Return to previous menu until you return to the main menu. 22 Select option 7 , Interactive CLI for an InServ. 23 Select the desired InServ Storage Server. 24 Verify that all nodes have joined the cluster by issuing the shownode command. cli% shownode Control Data Cache Node --Name--- -State- Master InCluster ---LED--- Mem(MB) Mem(MB) Available(%) 0 1000163-0 OK No Yes GreenBlnk 4096 6144 100 1 1000163-1 OK Yes Yes GreenBlnk 4096 6144 100 25 Issue the checkhealth -svc command to verify your system is healthy. If the system is running OS 2.2.4 or earlier, complete the following steps: a Connect the red crossover Ethernet cable to your laptop. This connects the maintenance PC to the SP private (ETH1) network. b c Type in the IP address (10.255.155.54) of the SP in the Web browser and press ENTER. Log in to the Service Processor Onsite Customer Care (SPOCC) interface from the maintenance PC using a supported Web browser. d e f g h Type your user name and password and click OK . From the SPOCC Homepage, click Support from the left column menu. Click CSStatus on the InServs Action menu. Verify CSStatus indicates the system is healthy. Log out of SPOCC by clicking Log Out on the upper right window.

D.12
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

26 In the service processor window issue the exit command to stop the CLI session. 27 Log out of the spmaint session by selecting X Exit to exit from the 3PAR Service Processor Menu . 28 Disconnect the serial cable from the maintenance PC and coil and place the cable behind the SP. 29 Disconnect the red cross-over Ethernet cable from the laptop and coil and replace the cable behind the SP, and if applicable, reconnect the customers Ethernet cable and all other cables to the node. 30 Close and lock the rear door of the InServ. 31 Replace the bezel that covers the front of the InServ. 32 Replace and secure the front fascia on the storage server if applicable.

D.13
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

D.14
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

E Locking Fascia
In this appendix
E.1 Locking Fascia E.1.1 Converting a Cabinet from Standard to Locking Fascias E.1.2 Removing the Locking Fascia E.1.3 Replacing the Locking Fascia E.2 Locking Fascia II E.2.1 Converting a Standard Cabinet to a Locking Fascia II E.2.2 Removing the Locking Fascia E.2.3 Replacing the Locking Fascia This appendix provides instructions on converting a standard fascia to a locking fascia including instructions for removal and replacement of a locking fascia. E.2 E.2 E.3 E.4 E.6 E.6 E.8 E.10

Locking Fascia

E.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

E.1 Locking Fascia


E.1.1 Converting a Cabinet from Standard to Locking Fascias
To convert a standard cabinet with standard fascias to one with locking fascias: 1 2 Remove the standard fascias from the cabinet. Remove the four mounting brackets located at each inner corner of the cabinet, setting the screws aside.

Brackets (2x)

Brackets (2x)

0793_L_R1

Figure E-1. Removing Locking Brackets

E.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Using the old screws, attach the new mounting brackets in place by inserting the guiding pin to hold the bracket in place. Repeat for each bracket. Extra screws and PEM nuts are included if the old screws or nuts are damaged.

NOTE: If the PEM nut is stripped, use the longer screws and washers that accompany the mounting brackets in the locking fascia kit.

Install the fascia and use the key to lock it in place.

E.1.2 Removing the Locking Fascia


To remove the locking fascias: 1 2 3 Unlock the bottom lock of the fascia. With one hand supporting the fascia in place, unlock the top lock. Carefully set the fascia aside so it does not interfere with the maintenance of the storage server.

E.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Repeat the same procedure with the second fascia.

Lock (2x)

Fascia

0672_L_R2

Figure E-2. Removing the Locking Fascia

E.1.3 Replacing the Locking Fascia


To replace the locking fascias: 1 Set the fascia in place and support it with one hand while locking the upper lock.

E.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Continue to support the fascia while locking the lower lock.

Lock (2x)

Fascia

0794_L_R1

Figure E-3. Replacing the Locking Fascia

E.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

E.2 Locking Fascia II


E.2.1 Converting a Standard Cabinet to a Locking Fascia II
To convert a standard cabinet with standard fascias to one with locking fascias: 1 2 Remove the standard fascias from the cabinet. Remove the four mounting brackets located at each inner corner of the cabinet, setting the screws aside.

Brackets (2x)

Brackets (2x)

0793_L_R1

Figure E-4. Removing Locking Brackets

E.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Use a #2 Phillips screw driver to install the universal cosmetic/mounting bracket to the upper and lower section of the cabinet. Screw the 10-32 x 1/2 screw and washer to the nut under the cabinet. Repeat on other side of bracket.

0810_L_R1

Figure E-5. Installing Universal Cosmetic/Mounting Brackets

E.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

Install the locking fascia by holding the pocket handles and locking both locks to the brackets.

Lock (2)

Pocket Handles (2x)

Quarter-Turn Screw

0811_L_R1

Figure E-6. Installing the Locking Fascia

5 6

Use a #2 Phillips screwdriver to secure the Quarter-Turn screw. Repeat for second fascia.

E.2.2 Removing the Locking Fascia


To remove the locking fascia: 1 2 3 Turn the pocket handles out. Unlock the bottom lock of the fascia. With one hand supporting the fascia in place, unlock the top lock.

E.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Supporting the fascia by the pocket handles, set the fascia aside so it does not interfere with the maintenance of the storage server.

Repeat the same procedure with the second fascia.

Lock (2)

Pocket Handles (2x)

Quarter-Turn Screw

0812_L_R1

Figure E-7. Removing the Locking Fascia

E.9
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

E.2.3 Replacing the Locking Fascia


To replace the locking fascias: 1 Turn the pocket handles out, while holding the handles set the fascia in place and support it with one hand while locking the upper lock. 2 3 Continue to support the fascia while locking the lower lock. Use a #2 Phillips screwdriver to secure the Quarter-Turn screw on the center of the fascia.

Lock (2)

Pocket Handles (2x)

Quarter-Turn Screw

0811_L_R1

Figure E-8. Replacing the Locking Fascia

4 5

Turn the pocket handles in so they are flush with the fascia and out of the way. Repeat with other fascia.

E.10
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

F Illustrated Parts Catalog


In this appendix
F.1 Storage Server Frame Components F.2 Drive Chassis Components F.3 Internal Node Components F.4 Miscellaneous Components F.2 F.6 F.10 F.14

This appendix contains the illustrated parts catalog for all Field Replaceable Units (FRUs) and replaceable hardware. Following each page of illustrated parts is a parts list containing part numbers and quantities. Part numbers that are preceded with an F are identified as FRUs.

NOTE: For the most current and complete information about FRU part numbers, see the FRU Parts Database in 3PARs STATS application.

Illustrated Parts Catalog

F.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

F.1 Storage Server Frame Components


1

0325_L_R1

Figure F-1. Storage Server Frame FRUs Table F-1. Storage Server Frame FRUs

Ref. Number 1 2

Base Part Number F8000013 F9700012 F9700016 Description Battery Backup Unit PDU, 1U, NEMA L630 cord PDU, 1U, IEC60309 cord Qty. up to 8 4

F.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

2
0520_L_R1

0642_L_R1

0808_L_R1

Figure F-2. Service Processor FRU Table F-2. Service Processor FRUs

Ref. Number 1 2

Part Number F9750009 F975-200035 F979-200051 Description Service Processor, 1U (Wintec) Service Processor, 1U (Supermicro) Qty. 1 1

F975-200010

Service Processor, 1U (Supermicro II)

F.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

0327_L_R1

Figure F-3. Node Chassis Table F-3. Node Chassis

Ref. Number 1 2

Part Number F970200004 F970200005 Description T400 Node Chassis T800 Node Chassis Qty. 1 1

F.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

0454_L_R1

Figure F-4. Controller Node Power Supply


BD

Table F-4. Controller Node Power Supply

Ref. Number 1

Part Number F8000019 Description Power Supply, Node Qty. 2 per node

F.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

F.2 Drive Chassis Components

15 5 6 7

9 8 12

10 13

11 14

1 2

16 4
0627_L_R5

Figure F-5. Drive Chassis Component FRUs


BD

Table F-5. Drive Chassis FRUs

Ref. Number 1 2

Part Number F970200008 F9700135 Description Drive Magazine, DC4, NL-SATA, 4GBIT Drive Magazine, DC4, FC, 4GBIT Qty Per Chassis up to 10 up to 10

F.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Table F-5. Drive Chassis FRUs (continued)

Ref. Number 3 4 5

Part Number F970-200094 F9700136 F810200000 F810200006 Description Drive Magazine, DC4, FC, TYPE-2, 4GBIT FC-AL Module, DC4, 4GBIT FC Disk, 146 GB, 15K RPM, Seagate, ROHS Qty Per Chassis up to 10 2 up to 40

F810-200008 F810-200012

FC Disk, 300 GB, 15K RPM, SeagateST3300656FC FC Disk, 300 GB, 15K RPM, SeagateST3300657FC

up to 40

7 8

F810-200004 F810-200016

FC Disk, 400 GB, 10K RPM, Seagate, ROHS FC Disk, 450 GB, 15K RPM, Seagate (ST3450856FC)

up to 40 up to 40

9 10 11 12 13 14 15 16

F810-200013 F810-0020-02-R5 F810-200007 F810-200021 F810-200022 F810-200018 F970-200017 F1800093

FC Disk, 600 GB, 15K RPM, Seagate NL-SATA Disk, 750 GB, 7.2 RPM, Seagate NL-SATA Disk, 1TB, 7.2K RPM, Seagate FC Disk, 300 GB, 15K RPM, Hitachi FC Disk, 600 GB, 15K RPM, Hitachi NL-SATA, 2TB, 7K RPM, Hitachi SSD-SATA Drive, 50 GB, STEC SFP Transceiver (Small Form-factor Pluggable) 4GBIT, Finisar

up to 40 up to 40 up to 40 up to 40 up to 40 up to 40 up to 40 up to 4

F.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

0626_L_R1

Figure F-6. Drive Chassis Midplane Table F-6. Drive Chassis Midplane

Ref. Number 1

Part Number F920-1062-03 Description DC4 Drive Chassis Midplane Assembly Qty. 1

F.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

0643_L_R1

Figure F-7. Drive Chassis Power Supply


BD

Table F-7. Drive Chassis Power Supply

Ref. Number 1

Part Number F800200000 Description Power Supply, Drive Cage, Power-One Qty per Chassis 4

F.9
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

F.3 Internal Node Components

or

0645_L_R2

Figure F-8. Internal Node FRUs

F.10
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Table F-8. Internal Node FRUs

Ref. Number 1

Part Number F970200006 F970200067

Description Type-1, 2.33 GHz Node with SATA Disk Type-2, 2.33 GHz Node with SATA Disk iSCSI Adapter, 2 Port, (QLA4052C) Fibre Channel Adapter, 4 Port, 4Gbit, (3PAR) SATA Disk, Node, 100 GB

Qty. 1

2 3 4

F9250027 F9700130 F970200024 F970200074

up to 2 up to 6 1

F.11
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

DIMM 2.0 DIMM 2.1 DIMM 0.0 DIMM 0.1 3 DIMM 1.0 DIMM 1.1

Data Cache 2-Slot Riser Card

Data Cache 4-Slot Riser Card

Control Cache DIMMs: DIMM 0 DIMM 1

5
0639_L_R3

Figure F-9. DIMMs and Clock Battery

F.12
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Table F-9. DIMMs and TOD Battery for the Controller Node

Ref. Number 1

Part Number F920-1058 F970-200065 Description 2-Slot Data Cache Riser Card, Node 2-Slot Data Cache Riser Card, Node (Type 2) - Used in Type-2 nodes (P/N F970-200067) Qty. 1

F9201059 F970-200066

4-Slot Data Cache Riser Card, Node 4-Slot Data Cache Riser Card, Node (Type 2)

F922200003 F922-200008 F922-200010

SDRAM, DDR, 2 GB DIMM (Data Cache-STEC) SDRAM, DDR, 2 GB DIMM (Data Cache-Micron) SDRAM, DDR, 2 GB DIMM (Data Cache-Micron) TOD Battery, BR2032 SDRAM, DDR2, 2 GB FBDIMM (Control Cache-STEC) SDRAM, DDR2, 2 GB FBDIMM (Control Cache-Micron) SDRAM, DDR2, 2 GB FBDIMM (Control Cache-Micron)

4 5

F1700012 F922200001 F922-200009 F922-200013

1 2

NOTE: Both control cache and data cache DIMMs must be replaced by DIMMs with the same manufacturing part number. The T-Class Storage Server use DIMMs from the following manufacturers:

SimpleTechIdentified by STEC on top surface at the edge of the DIMM. MicronIdentified by M inside an ellipse on the edge of the DIMM.

F.13
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

F.4 Miscellaneous Components

0340_L_R2

Figure F-10. Storage Server Cables

F.14
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Table F-10. Storage Server Cables

Ref. Number 1

Part Number F850200000 F850200001 F8500034 F8500035 F8500036 Description FC Cable, 2 m, LC-LC, 50 micron FC Cable, 4 m, LC-LC, 50 micron FC Cable, 10 m, LC-LC, 50 micron FC Cable, 50 m, LC-LC, 50 micron FC Cable, 100 m, LC-LC, 50 micron Cable, Battery Back Up Unit RJ45 to DB9 Adapter, crossover RJ45 to DB9 Adapter, straight Ethernet Cable, crossover, 20 ft Qty.

2 Not shown Not shown Not shown

F8500030 F1800055 F1800059 F8500033

F.15
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

F.16
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

G Agency Compliance Statements


In this appendix
G.1 Safety Precautions G.2 Safety Agency Compliance Notices G.2.1 System Placement and Security G.2.2 Battery Replacement and Disposal G.2.3 Controller Nodes G.2.4 Drive Chassis G.3 3PAR Power Cables G.4 Japan Green Law Statement of Compliance G.2 G.2 G.2 G.5 G.8 G.13 G.16 G.16

This appendix contains safety precautions and agency compliance notices for InServ Storage Servers and their components. Read this section before beginning any of the procedures described in this guide.

Agency Compliance Statements

G.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

G.1 Safety Precautions


To be safe and to protect system data and equipment, always follow the instructions in this manual when installing, maintaining, troubleshooting, and upgrading InServ Storage Servers and their components. In addition, please take the following precautions:

Install and maintain storage servers and their components in a restricted access location, limiting access to storage server equipment, software, and documentation.

Follow all instructions, warnings, and cautions printed on individual storage server components. Those instructions take precedence over statements made in this guide.

Before installing a storage server, verify that the voltage and frequency of the power sources at the operating sites matches the voltage and frequency indicated on the systems electrical rating label.

G.2 Safety Agency Compliance Notices


InServ Storage Servers comply with safety standards for ITE equipment. For your safety, observe the notices that follow.

G.2.1 System Placement and Security


Install and maintain storage servers and their components in a restricted access location, limiting access to storage server equipment, software, and documentation. Each power supply cord is to be connected to separate 30A branch circuits.

WARNING: Install this unit in a restricted access location.

ACHTUNG: Diese Einheit darf nicht frei zugnglich installiert werden.

G.2
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

AVERTISSEMENT: Installer cette unit dans un endroit restreint d'accs.

WAARSCHUWING: Deze eenheid dient te worden genstalleerd op een beperkt toegankelijke locatie.

ADVERTENCIA: Est unidad deber ser instalada en una rea de acceso restringido.

G.3
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

For storage servers with 3PAR cabinets, secure the system by locking the rear doors on all cabinets.

WARNING: Hazardous energy is located behind the rear access door of the storage server cabinet.

ACHTUNG: Hinter der rckwrtigen Zugangstr des Storage-Server-Schranks liegen gefhrliche Spannungen an.

AVERTISSEMENT: nergie dangereuse situe derrire la porte d'accs arrire du coffret de serveur de stockage.

WAARSCHUWING: Achter de toegangsdeur van de opslagserverkast aan de achterzijde ontstaat gevaarlijke energie.

ADVERTENCIA: Energa peligrosa esta localizada detrs de la puerta de acceso trasera del gabinete del servidor de almacenamiento.

G.4
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

G.2.2 Battery Replacement and Disposal


Storage server controller nodes contain 3-V lithium coin batteries. These batteries require periodic replacement.

WARNING: There is danger of an explosion if the lithium coin battery inside the controller node is incorrectly replaced. Replace the coin battery only with the same or equivalent type recommended by the manufacturer.

ACHTUNG: Bei unsachgemem Austausch der Lithium-Knopfbatterie im Steuerknoten besteht Explosionsgefahr. Die Knopfbatterie darf nur durch eine gleiche bzw. vom Hersteller empfohlene gleichwertige Batterie ersetzt werden.

AVERTISSEMENT: Il y a un danger d'explosion si la batterie de lithium l'intrieur du contrleur est incorrectement positionne. Remplacez la batterie seulement avec le mme type ou quivalent recommand par le fabricant.

WAARSCHUWING: Er bestaat kans op explosies als de lithium muntbatterij in de controller node niet op de juiste wijze wordt vervangen. Vervang de muntbatterij alleen door een type dat equivalent is aan het type dat door de fabrikant wordt aanbevolen.

G.5
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

ADVERTENCIA: Existe el peligro de explosin si la batera de litio dentro del controlador del nodo es reemplazada incorrectamente. Reemplacela solamente con una batera del mismo tipo o con una de tipo equivalente recomendado por el fabricante.

CAUTION: Dispose of used batteries according to the manufacturers instructions.

G.6
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

VORSICHT: Gebrauchte Batterien nur gem Herstelleranweisung entsorgen.

ATTENTION: Dbarrassez-vous des batteries use selon les instructions de fabricant.

WAARSCHUWING: Verwijder gebruikte batterijen volgens de instructies van de fabrikant.

PRECAUCION: Deseche bateras usadas de acuerdo a las instrucciones del fabricante.

G.7
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

G.2.3 Controller Nodes


For controller nodes installed in cabinets not provided by 3PAR, please observe the following precautions:

WARNING: Install this unit in a restricted access location.

ACHTUNG: Diese Einheit darf nicht frei zugnglich installiert werden.

AVERTISSEMENT: Installer cette unit dans un endroit restreint d'accs.

WAARSCHUWING: Deze eenheid dient te worden genstalleerd op een beperkt toegankelijke locatie.

ADVERTENCIA: Est unidad deber ser instalada en una rea de acceso restringido.

G.8
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

WARNING: Hazardous energy located on rear connectors.

ACHTUNG: An den rckwrtigen Anschlssen liegen gefhrliche Spannungen an.

AVERTISSEMENT: nergie dangereuse situe sur les connecteurs arrire.

WAARSCHUWING: Gevaarlijke energievelden achter de aansluitingen aan de achterzijde.

G.9
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

ADVERTENCIA: Energa peligrosa localizada en los conectores traseros.

WARNING: There is danger of an explosion if the lithium coin battery inside the controller node is incorrectly replaced. Replace the coin battery only with the same or equivalent type recommended by the manufacturer.

ACHTUNG: Bei unsachgemem Austausch der Lithium-Knopfbatterie im Steuerknoten besteht Explosionsgefahr. Die Knopfbatterie darf nur durch eine gleiche bzw. vom Hersteller empfohlene gleichwertige Batterie ersetzt werden.

G.10
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

AVERTISSEMENT: Il y a un danger d'explosion si la batterie de lithium l'intrieur du contrleur est incorrectement positionne. Remplacez la batterie seulement avec le mme type ou quivalent recommand par le fabricant.

WAARSCHUWING: Er bestaat kans op explosies als de lithium muntbatterij in de controller node niet op de juiste wijze wordt vervangen. Vervang de muntbatterij alleen door een type dat equivalent is aan het type dat door de fabrikant wordt aanbevolen.

ADVERTENCIA: Existe el peligro de explosin si la batera de litio dentro del controlador del nodo es reemplazada incorrectamente. Reemplacela solamente con una batera del mismo tipo o con una de tipo equivalente recomendado por el fabricante.

G.11
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

CAUTION: Dispose of used batteries according to the manufacturers instructions.

VORSICHT: Gebrauchte Batterien nur gem Herstelleranweisung entsorgen.

ATTENTION: Dbarrassez-vous des batteries use selon les instructions de fabricant.

WAARSCHUWING: Verwijder gebruikte batterijen volgens de instructies van de fabrikant.

PRECAUCION: Deseche bateras usadas de acuerdo a las instrucciones del fabricante.

G.12
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

G.2.4 Drive Chassis


For drive chassis installed in cabinets not provided by 3PAR, observe the following precautions:

WARNING: Install this unit in a restricted access location.

ACHTUNG: Diese Einheit darf nicht frei zugnglich installiert werden.

AVERTISSEMENT: Installer cette unit dans un endroit restreint d'accs.

WAARSCHUWING: Deze eenheid dient te worden genstalleerd op een beperkt toegankelijke locatie.

ADVERTENCIA: Est unidad deber ser instalada en una rea de acceso restringido.

G.13
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

WARNING: There is danger of an explosion if the battery is incorrectly replaced. Replace only with the same or equivalent type recommended by the manufacturer.

ACHTUNG: Bei unsachgemem Austausch der Batterie besteht Explosionsgefahr. Sie darf nur durch eine gleiche bzw. vom Hersteller empfohlene gleichwertige Batterie ersetzt werden.

AVERTISSEMENT: Il y a un danger d'explosion si la batterie est incorrectement positionne. Remplacez la batterie seulement avec le mme type ou quivalent recommand par le fabricant.

G.14
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

WAARSCHUWING: Er bestaat kans op een explosie als de batterij niet op de juiste wijze wordt vervangen. Alleen te vervangen door een type dat equivalent is aan het type dat door de fabrikant wordt aanbevolen.

ADVERTENCIA: Existe el peligro de explosin si la batera es reemplazada incorrectamente. Reemplcela solamente con una batera del mismo tipo o un tipo equivalente recomendado por el fabricante.

G.15
3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

G.3 3PAR Power Cables


English Compliance Statement All power cables provided by 3PAR are for exclusive use for 3PAR products. Japanese Compliance Statement

G.4 Japan Green Law Statement of Compliance


Energy consumption efficiency*= 0.089 * Japan Green Law statement of compliance: The energy consumption efficiency value has been calculated per requirements for Category-G Magnetic Disk Drive Units by dividing the power consumption, measured according to the definition in the Law Concerning the Rational Use of Energy, by the storage capacity defined in the Energy Conservation Law. The efficiency value is based on a host-maximized T800 configuration using 750GB drives.

G.16
3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Index
NUMERICS
10 minute maximum before overheating, drive chassis 4 30 minute maximum before overheating drive replacement 3 3-V lithium coin battery 1 disconnecting the ground wire 5 drive chassis ground wire, disconnecting 5 non-3PAR, controller node warnings 8 cables 13 battery backup units (BBUs) configuration example 5 Maintenance PC connections, for 2 part numbers 13 cache memory. See control cache memory and data cache memory cautions, about 5 circuit breakers, power distribution units (PDUs) 5, 11 CLI commands, Maintenance PC for issuing 1 clock battery 3-V lithium coin battery 1 COM1, settings 13 commands exit 4, 11 shownode 10, 4, 11 spmaint 6 control cache memory inserting DIMMs 6 releasing DIMMs 5 replacing 2 controller node chassis amber status light 11 power supplies 5 part numbers 5 removing 26

A
AC line, testing 2 adapters, Fibre Channel location of 2 altitude requirements and specifications 2

B
batteries clock, replacing 1 disposing of 4 explosion warning for 4, 5 lithium, replacement and disposal of 5 battery backup units (BBUs) amber LEDs 6 cache memory and power failure 17 hazardous materials in 4 LEDs 17 status and error display 17

C
cabinets

Index

IX.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

two nodes part numbers 4 unpacking 78 controller nodes clock battery, replacing 1 connecting to Maintenance PC 29 control cache memory replacing 2 cover, removing 5 data cache memory replacing 2 Fibre Channel adapters location of 2 handling precautions 1 LEDs 9 hot-plug, location of 2 location of 9 status and error display 10 node disks, replacing 2 non-3PAR cabinets, warnings for 8 release lever 3 removing 2 cover of 4 replacing 4, 6 after servicing 4, 6 riser card, removing 6, 4 sliding out 4, 3 cord lock, tightening 12

D
data cache memory 5 DIMMs part numbers 11 inserting 8 inserting or releasing 7, 5 location and number of DIMMs 2 releasing 7, 5 replacing 2 data cache riser card replacing 2 DB9 to RJ45 adapter 29 DB9 to RJ54 crossover adapter 28 diagnostics storage server 20 DIMMs part numbers 11 disk drives

captive screws, loosening 7 drive replacement over 30 minutes 3 node disks replacing 2 numbering of 8 removing from the magazine 9, 8 replacing 3 spinning up before checking 11, 10, 7 dismisspd command 13 documentation, related 1 drive cages FC-AL modules LEDs, status and error displays 5 drive chassis cabinets, non-3PAR cabinets, warning for 13 drive magazines, inserting 10, 9 drive replacement, overheating at 30 minutes 3, 4 FRUs 6 power supplies 6 LEDs 38 midplane assembly part numbers 7 non-3PAR cabinets, warning for 13 power supplies part numbers 8 drive magazines disks numbering of 8 sliding out 9, 8 filler panels empty slot causing overheating 3 handling precautions 3, 3, 1, 2 inserting into the drive chassis 10, 9 LEDs location of 7, 6 power supplies 8 precautions when handling 2, 3, 1

E
Ethernet connections secure shell session 2227 service processor to Maintenance PC 1627 SPOCC, logging into 20 exit command 4, 11

IX.2

Index

3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

F
FC-AL modules handling precautions 2, 1 LEDs location of DC4 4 status and error displays 5 replacing 16, 1 Fibre Channel adapters location of 2 filler panels empty slot causing overheating 3

location of 7 status, location of 6 Ethernet adapter 12 power supplies 15 location of 15 server diagnostics 2 Wintec SP 19 lithium coin battery, explosion warning for 4

M
Maintenance PC cables for 2 connecting 127 IP addresses for 20 serial cable for 2 controller nodes, connecting to 29 required for maintenance 1 service processor secure shell session 2227 SPOCC, logging into 20 service processor, connecting 927 Ethernet connection 1620 serial connection 915 maintenance PC service processor serial connection to 9 maintenance port locating 2 midplane assembly loosening ball stud standoffs 6

G
ground wire, disconnecting 5 grounding strap 7, 6

H
handling precautions drive magazines 3, 3, 1, 2 FC-AL modules 2, 1 hazardous materials in BBUs 4 hot-plug status LEDs 6 controller nodes 10 humidity specifications for servers 2 HyperTerminal, connecting Maintenance PC with 315

I
internal node FRUs 9 part numbers 9 IP addresses, connecting Maintenance PC 20

N
nodes, internal, FRUs 9 part numbers 9 notes, about 5

L
LEDs battery backup units (BBUs) 17 status and error display 17 controller nodes 9 location of 9 status and error display 10 disks, status and error display 8 drive chassis 38 drive cage, FC-AL modules 4 drive magazines

O
overheating drive chassis 10 minute maximum 4 drive replacements 30 minute maximum 3 overview of this guide 24

P
pinout diagrams 28 power banks indicator lamps 18
Index

IX.3

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

location and order of 5, 11 power cords, AC disconnecting 3 evidence of damage or wear 6 replacing 4 power distribution units (PDUs) circuit breakers 5, 11 setting to OFF 4, 10 indicator lamps 18 power banks, location and order of 5, 11 removing from the rack 6, 12 replacing 13 power receptacle connector, unplugging 4, 11 power requirements AC line 2 power status LEDs, status and error display 10 power supplies AC cords, disconnecting 4, 3 cord lock, tightening 12 drive magazine 8 part numbers 8 LEDs 15 location of 15 redundant power configuration 3, 9 setting to OFF 4 procedures, overview of 24 PuTTY software, installing and using 25

R
racks filler panels empty slot causing overheating 3 redundant power, valid configuration example 3, 9 related documentation 1 revision history 1

servers redundant power, configuration example 3, 9 safety precautions 2 service processor 1-U replacing 2 backup script 5 connecting to Maintenance PC 927 Ethernet connection 1620 serial connection 915 connecting to maintenance PC serial connection 9 LEDs 12 user interfaces 20 setbattery command 6 showbattery command 3, 6 showcage command 2 shownode command 10, 4, 11 software Secure CRT, installing and using 25 spmaint command 2, 5, 6 SPOCC, logging into 20 storage server midplane replacing 7 storage servers cables 13 part numbers 13 frames FRUs 2 part listing 2 LEDs, for diagnostics 2 lithium battery replacement 5 placement and security 2 security of 2

T
temperature specifications for servers 2 troubleshooting storage server 20 TUV compliance 2

S
safety agency compliance notices 2 safety precautions 2 Secure CRT software, installing and using 25 security, of servers 2 serial cable pinouts 28 serial cable, connecting Maintenance PC with 2 serial port, settings 13 server maintenance required tools 1

U
UL compliance 2

V
voltage and frequency verification 2

IX.4

Index

3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

voltage regulator module replacing 2

W
warnings, about 5 Wintec LEDs 19, 20

Index

IX.5

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

IX.6

Index

3PAR Confidential

InForm OS Version 2.3.1

3PAR InServ T-Class Storage Server Maintenance Manual

Revision History
.

Release Level 325200090 Rev A October 2009 325-200090 Rev B February 2010 325-200090 Rev C August 2010

Revision Summary First release of this manual to support the release of 3PAR InForm OS 2.3.1. Second release of this manual to support a new service processor and Solid State Drives (SSD). Third release of this manual to support 3PAR Secure Service Agent (SSA) and new storage hard drives.

Revision History

RH.1

3PAR Confidential

3PAR InServ T-Class Storage Server Maintenance Manual

InForm OS Version 2.3.1

RH.2

Revision History

3PAR Confidential

Vous aimerez peut-être aussi