Hardware Validation & Verification Plan

for the

<Program Name>

Document No: <Doc Number>

Revision: -

__________________________________________________ ___________
<Name>, Program Manager Date

__________________________________________________ ___________
<Name>, Technical Project Lead Date

__________________________________________________ ___________
<Name>, Engineer Date

__________________________________________________ ___________
<Name>, Quality Engineer Date

Notice
This document and the information contained herein are the property of <Company
Name>. Any reproduction, disclosure or use thereof is prohibited except as
authorized in writing by <Company Name>. Recipient accepts the responsibility for
maintaining the confidentiality of the contents of this document.
Hardware Verification Plan

REVISIONS
Requested/
Rev. Reason/Description Changed By Date

<Doc Number> Page 2 of 116 Rev. -

Hardware Verification Plan

Table of Contents

SECTION PAGE

1.0 INTRODUCTION .............................................................................................. 7

1.1 Purpose...................................................................................................... 7
1.2 Scope ........................................................................................................ 7
1.3 Acronyms and Abbreviations ......................................................................... 8
1.4 Applicable Documents .................................................................................. 9
1.4.1 External Documents ................................................................................ 9
1.4.2 Internal Documents ................................................................................ 9

2.0 VALIDATION METHODS AND DATA ............................................................... 10

2.1 Validation Methods .................................................................................... 10
2.1.1 Requirements Elicitation ........................................................................ 10
2.1.1.1 Elicitation Techniques ....................................................................... 11
2.1.2 Requirements Analysis .......................................................................... 12
2.1.3 Requirements Document ........................................................................ 13
2.1.4 Requirements Validation ........................................................................ 14
2.1.4.1 Characteristics of a Validated Requirement .......................................... 15
2.1.4.2 Management of a Validated Requirement............................................. 15
2.1.4.3 Requirement Review Criteria ............................................................. 16
2.1.4.4 Requirements Traceability ................................................................. 16
2.2 Hardware Requirements Process Validation Activities and Data ......................... 17
2.2.1 Hardware Requirements Process Validation Objectives ............................... 17
2.2.2 Hardware Requirements Process Inputs ................................................... 17
2.2.3 Hardware Requirements Process Reviews and Analyses .............................. 17
2.2.3.1 Hardware Requirements Document Review .......................................... 19
2.2.3.2 Hardware Requirements Transition Review .......................................... 20
2.2.3.3 Analysis of Hardware Requirements .................................................... 21
2.2.3.4 System and Hardware Requirements Trace Analysis .............................. 21
2.3 Validation Independence ............................................................................. 22
2.3.1 Peer Reviews ....................................................................................... 22

3.0 VALIDATION ENVIRONMENT ........................................................................ 24

3.1 Tools ....................................................................................................... 24

<Doc Number> Page 3 of 116 Rev. -

Hardware Verification Plan

4.0 VERIFICATION METHODS AND DATA ............................................................ 25

4.1 V-Model Verification Approach ..................................................................... 25
4.2 Analysis of Outputs Methods ....................................................................... 27
4.3 Hardware Planning Process Verification Activities and Data .............................. 28
4.3.1 Hardware Planning Process Inputs ........................................................... 28
4.3.2 Hardware Planning Process Reviews and Analyses ..................................... 28
4.3.2.1 Hardware Verification Plan Review ...................................................... 28
4.3.2.2 Hardware Planning Review ................................................................ 29
4.4 Hardware Requirements Process Verification Activities and Data ....................... 31
4.4.1 Hardware Requirements Process Verification Objectives ............................. 31
4.4.2 Hardware Requirements Process Inputs ................................................... 31
4.4.3 Hardware Requirements Process Reviews and Analyses .............................. 31
4.4.3.1 Hardware Requirements Document Review .......................................... 33
4.4.3.2 Analysis of Hardware Requirements .................................................... 34
4.4.3.3 System and Hardware Requirements Trace Analysis .............................. 34
4.4.3.4 Hardware Requirements Transition Review .......................................... 35
4.5 Hardware Design Process Verification Activities and Data................................. 36
4.5.1 Hardware Design Process Verification Objectives ....................................... 36
4.5.2 Hardware Design Process Inputs ............................................................. 36
4.5.3 Hardware Design Process Reviews and Analyses........................................ 36
4.5.3.1 Functional Failure Path Analysis ......................................................... 37
4.5.3.2 Hardware Design Description Review .................................................. 38
4.5.3.3 Reviews and Analyses of Hardware Architecture ................................... 38
4.5.3.4 Hardware Preliminary Design Transition Review ................................... 39
4.5.3.5 Reviews and Analyses of Hardware Design .......................................... 39
4.5.3.6 Hardware Critical Design Transition Review ......................................... 40
4.6 Hardware Implementation Process Verification Activities and Data .................... 41
4.6.1 Hardware Implementation Process Verification Objectives ........................... 41
4.6.2 Hardware Implementation Process Inputs................................................. 41
4.6.2.1 Reviews and Analyses of Hardware Implementation .............................. 41
4.6.2.2 Hardware Implementation Transition Review ....................................... 42
4.6.3 Hardware Testing Verification Objectives .................................................. 43
4.6.4 Testing Inputs ...................................................................................... 43
4.6.5 Hardware Testing Reviews and Analyses .................................................. 43
4.6.5.1 Elemental Analysis ........................................................................... 44
4.6.5.2 Elemental Analysis Method ................................................................ 44
4.6.5.2.1 Statement Coverage ................................................................... 45
4.6.5.2.2 Branch Coverage ........................................................................ 45
4.6.5.2.3 Condition and Expression Coverage ............................................... 45
4.6.5.2.4 Directed and Focused Expression Coverage .................................... 45
4.6.5.2.5 Toggle Coverage ......................................................................... 46
4.6.5.3 Elemental Analysis Results Resolution ................................................. 46
4.6.5.4 Shortcomings in Verification Test Cases or Procedures .......................... 46
4.6.5.4.1 Inadequacies in Requirements ...................................................... 46
4.6.5.4.2 Unused Functions........................................................................ 46
4.6.5.5 Element of No Safety Consequence .................................................... 46
4.6.5.6 Elemental Analysis Lifecycle Data ....................................................... 47
4.6.5.7 Hardware Verification Cases and Procedures Document Review .............. 48
4.6.5.8 Hardware Verification Transition Review .............................................. 48
4.6.5.9 Reviews and Analyses of Test Cases, Test Procedures, and Results ......... 49
4.6.5.9.1 Review Checklists for Test Cases, Procedures, and Results ................ 50

<Doc Number> Page 4 of 116 Rev. -

Hardware Verification Plan

4.6.6 Hardware Test Execution ....................................................................... 50

4.6.6.1 Simulation and On-Target Testing ...................................................... 51
4.6.6.2 Test Environment ............................................................................ 52
4.6.6.3 Requirements-Based Test Cases ........................................................ 52
4.6.6.4 Normal Range Test Cases ................................................................. 53
4.6.6.5 Robustness Test Cases ..................................................................... 53
4.6.6.6 Requirements-Based System Verification Testing Methods ..................... 53
4.6.6.6.1 Assess results of requirements-based tests ..................................... 53
4.6.6.6.2 Assess failure explanations and rework .......................................... 54
4.6.7 Process-Specific Activities ...................................................................... 55
4.6.7.1 Test Case Development .................................................................... 55
4.6.7.2 Test Case Verification ....................................................................... 56
4.6.7.3 Test Procedure Development ............................................................. 56
4.6.7.4 Test Procedure Verification ................................................................ 57
4.6.7.5 Coverage Analysis Verification ........................................................... 57
4.6.7.6 Testing Environment ........................................................................ 58
4.6.7.7 Test Execution ................................................................................. 58
4.6.7.8 Test Results Verification .................................................................... 59
4.7 Production Transition Process Verification Activities and Data ........................... 60
4.7.1 Production Transition Process Verification Objectives.................................. 60
4.7.2 Production Transition Process Inputs ....................................................... 60
4.7.3 Production Transition Process Reviews and Analyses .................................. 60
4.7.3.1 Production Transition Review ............................................................. 60
4.7.3.2 Hardware Conformity Review ............................................................. 61

5.0 VERIFICATION INDEPENDENCE .................................................................... 62

5.1 Peer Reviews ............................................................................................ 63

6.0 VERIFICATION ENVIRONMENT ..................................................................... 64

6.1 Tools ....................................................................................................... 64
6.1.1 Qualification of Verification Tools............................................................. 64
6.2 Test Procedure Structure ............................................................................ 65

7.0 ORGANIZATIONAL RESPONSIBILITIES ......................................................... 67

7.1 Responsibilities ......................................................................................... 67
7.1.1 Program Manager ................................................................................. 67
7.1.2 Hardware Engineering ........................................................................... 68
7.1.3 Independent Verification and Validation (IV&V) ......................................... 68
7.1.4 Hardware Configuration Management ...................................................... 69
7.1.5 Hardware Process Assurance .................................................................. 70
7.1.6 FAA Hardware Designated Engineering Representative ............................... 71

<Doc Number> Page 5 of 116 Rev. -

Hardware Verification Plan

APPENDIX A: HARDWARE PLANNING REVIEW CHECKLIST ................................... 72

APPENDIX B: HARDWARE REQUIREMENTS REVIEW CHECKLIST .......................... 74

APPENDIX C: HARDWARE PRELIMINARY DESIGN REVIEW CHECKLIST ................ 76

APPENDIX D: HARDWARE CRITICAL DESIGN REVIEW CHECKLIST ....................... 78

APPENDIX E: HARDWARE IMPLEMENTATION REVIEW CHECKLIST ....................... 80

APPENDIX F: PRODUCTION TRANSITION REVIEW CHECKLIST ............................. 81

APPENDIX G: HARDWARE VERIFICATION REVIEW CHECKLIST ............................ 83

APPENDIX H: HARDWARE CONFORMITY REVIEW CHECKLIST .............................. 86

APPENDIX I: PEER REVIEW CHECKLIST - PLANNING ........................................... 91

APPENDIX J: PEER REVIEW CHECKLIST REQUIREMENTS .................................. 96

APPENDIX K: PEER REVIEW CHECKLIST CONCEPTUAL DESIGN ....................... 100

APPENDIX K: PEER REVIEW CHECKLIST DETAIL DESIGN ................................ 104

APPENDIX L: PEER REVIEW CHECKLIST PRODUCTION TRANSITION ............... 110

APPENDIX M: PEER REVIEW CHECKLIST TEST PROCEDURES ........................... 112

APPENDIX N: PEER REVIEW CHECKLIST TEST RESULTS .................................. 115

<Doc Number> Page 6 of 116 Rev. -