Académique Documents
Professionnel Documents
Culture Documents
R AUL S OTO, MS C, CQ E
IVT A PRIL 2015 P HILADELPHIA
Contact information:
Raul Soto
rasove_21@yahoo.com
2
TABLE OF CONTENTS
1. REGULATORY PERSPECTIVE
2. SPREADSHEET VALIDATION
3. BUILDING A COMPLIANT SPREADSHEET
4. HANDS-ON EXERCISES
SCOPE
SPREADSHEET
Microsoft Excel file that may contain:
mathematical calculations
Statistical analysis
Graphing
PART 1: REGULATORY
PERSPECTIVE
REGULATIONS GOVERNING SPREADSHEETS
FDA 483
Pharmaceuticals (Eli Lilly):
http://www.contractormisconduct.org/ass/contractors/18/cases/305/221/f
da-warning-letter.pdf
http://www.fda.gov/ICECI/EnforcementActions/WarningLetters/2013/ucm
369409.htm
http://www.fda.gov/ICECI/EnforcementActions/WarningLetters/2006/u
cm075766.htm
http://www.fda.gov/ICECI/EnforcementActions/WarningLetters/2011/ucm2
56498.htm
12
http://www.ofnisystems.com/media/g3667d.pdf
http://www.ofnisystems.com/Resources/Warning_Letters/g4452d.pdf
http://www.ofnisystems.com/media/g1483d.pdf
MEDICAL DEVICES
21 CFR 820.70(i): Automated processes
When computers or automated data processing
systems are used as part of production or the
quality system, the manufacturer shall validate
computer software for its intended use according
to an established protocol.
All software changes shall be validated before
approval and issuance.
These validation activities and results shall be
documented.
16
MEDICAL DEVICES
Lets take this apart:
Applies to computer / data processing systems used for
production or quality
The manufacturer is responsible for validation
17
MEDICAL DEVICES
Section 6.0
Many other commercial software
applications, such as word processors,
spreadsheets, databases, and
flowcharting software are used to
implement the quality system. All of
these applications are subject to the
requirement for software validation, but
the validation approach used for each
application can vary widely.
18
MEDICAL DEVICES
Section 6.1
Numerous commercial software
applications may be used as part of the
quality system (e.g., a spreadsheet or
statistical package used for quality system
calculations, a graphics package used for
trend analysis, or a commercial database
used for recording device history records or
for complaint management). The extent of
validation evidence needed for such
software depends on the device
manufacturer's documented intended use of
that software.
19
PHARMACEUTICALS
21 CFR 211.165(e): Testing and Release
for Distribution
(e) The accuracy, sensitivity, specificity, and
reproducibility of test methods employed by the
firm shall be established and documented. Such
validation and documentation may be
accomplished in accordance with 211.194(a)(2).
20
BIOLOGICS
21 CFR 606.140: Laboratory Controls
Laboratory control procedures shall include:
(a) The establishment of scientifically sound and appropriate
specifications, standards and test procedures to assure that
blood and blood components are safe, pure, potent and
effective.
(b) Adequate provisions for monitoring the reliability,
accuracy, precision and performance of laboratory test
procedures and instruments.
(c) Adequate identification and handling of all test samples so
that they are accurately related to the specific unit of product
being tested, or to its donor, or to the specific recipient, where
applicable.
21
ISO 13485
Clause 7.5.2.1
The organization shall establish documented
procedures for the validation of the application of
computer software (and changes to such software
and/or its application) for production and service
provision that affect the ability of the product to
conform to specified requirements.
Such software applications shall be validated prior
to initial use.
22
24
25
29
Validation Plan
Requirements Specification
Design Specification
Traceability Matrix
Testing
Development
Installation Qualification
OQ / PQ
-orSystem / User Acceptance
Validation Report
Procedures & Governance
Templates
GOVERNANCE
Spreadsheet Validation Procedure
Outlines HOW spreadsheets will be validated
What document(s) need to be produced
Roles and responsibilities, Authors and Approvers, etc.
GENERAL INFORMATION
Spreadsheet name
Description and Purpose
What the spreadsheet will be used for
Process(es) supported
Where it will be used
References
Analytical methods, SOPs, etc.
33
REQUIREMENTS
Describes, with detail, WHAT you want the
spreadsheet to do.
Requirements should be numbered
MS Excel version required
Excel Add-Ins required, if any
OS version in which it is developed
For example: MS Windows 7 SP1, Mac OS X 10.10
Include OS service pack, if applicable
34
REQUIREMENTS
Input cell and formula cell requirements
Formatting (colors, font size and type, etc.)
Data validation (field type, size, etc.)
35
REQUIREMENTS
Charts and Graphs
Title and Description of each
Required labels for each axis
Security requirements
Password protection
Output requirements
Color printer, PDF-creating software
Specific folder in a specific shared drive
Automatic eMail to specific people
36
DESIGN SPECIFICATION
Describes, with details, HOW the spreadsheet will
comply with the Requirements
38
TRACEABILITY MATRIX
Traces every requirement to its
corresponding design
element, and to the test
script(s) where the
requirement is challenged and
tested.
39
45
http://academic.evergreen.edu/projects/biophysics/technotes/program/ascii_ctr
l.htm
Field size test: ensure user can only enter the specified
number of characters in a field
46
49
OQ SECURITY TESTING
Security testing:
Ensure it is not possible to:
Unlock locked cells / worksheets
Alter formulas, output results,
output graphs /charts/ tables
Add or remove worksheets
50
OQ PERFORMANCE TESTING
Output issues : ensure the spreadsheet behaves as
expected when you
disconnect printer
close the PDF-rendering application
Performance :
Multiple users simultaneously
Open multiple instances of the spreadsheet at the
same time
Execute spreadsheet while various other
applications are running
51
OPERATIONAL QUALIFICATION
Formula Auditing
Excels Formula Auditing tools allows us to demonstrate that
the inputs come from the expected cells
52
TEST EXECUTION
Ensure test scripts are
executed in the appropriate
sequence.
Document deviations when
actual results do not match
expected results
Take screenshots and printouts
as documented evidence
53
TEST EXECUTION
Include all executed test scripts
Include all screenshots, printed
outputs, manual calculations
Post-approvals
54
Update Testing
New or updated test scripts
Test new functionality (i.e. new/updated formula)
Regression testing: ensure areas not changed still work
correctly
56
PART 3:
BUILDING THE SPREADSHEET
DESIGN A COMPLIANT SPREADSHEET
57
CHANGE CONTROL
Spreadsheets used for GxP processes should be
subjected to formal version control and validation.
The organizations change management system
should be used to document whenever we:
Create a new spreadsheet for regulated / validated uses
Make changes to a validated spreadsheet
Retire/decommission a validated spreadsheet
Move a validated spreadsheet to a different version of
Excel (i.e. from Excel 2007 to Excel 2010) from the one used
in development and validation
Move a validated spreadsheet to a different operating
system (i.e. from Windows to Linux or MacOS)
58
59
61
UNITS CONVERSION
You can use the Excel CONVERT function to convert
values from one unit to another in your formulas
Click HELP in Excel for a list of all units included.
62
CHANGE HISTORY
Each spreadsheet should have a Change History
worksheet (a.k.a. Revision History)
Every time the spreadsheet is updated, an entry
should be made in this Change History:
SECURITY LAYERS
Lock all cells except user input cells.
HOME tab/ CELLS group/ Format / Protection
IMPORTANT !!!
Locking / unlocking cells
Protect spreadsheets /worksheets
Cell formatting:
Data types
Look and feel : Font, Colors
65
PART 4: WORKSHOP
HANDS-ON SPREADSHEET WORKSHOP
66
SPREADSHEET CREATION
Once you create your spreadsheet
1. ID cell types, by color
2. Conditional formatting for displaying results
3. Data validation
4. Formula auditing
SPREADSHEET SECURITY
6. Protect the Worksheet
7. Unprotect input cells
8. Protect the Workbook
9. Protect and SHARE the Workbook
10. Tracking Changes
68
69
2. CONDITIONAL FORMATTING
Conditional formatting can be used to change the
formatting of a cell (background color, text color,
text properties, etc.) depending on its content, or
on the content of another cell
70
2. CONDITIONAL FORMATTING
You can apply multiple formatting rules
to a single cell
Use Manage Rules to keep track of the
rules you are applying.
71
2. CONDITIONAL FORMATTING
Example 1
Minimum spec value is 14, maximum is 17
We want cells to be:
Lt Green fill and Dk Green text IF value is between min and max
Lt Red fill and Dk Red text IF value is outside min and max
72
2. CONDITIONAL FORMATTING
Example 1 (cont.)
3. Home / Styles / Conditional Formatting/ Highlight Cell Rules/ Greater
Than => dialog box
4. Select cell where maximum value is listed, and desired formatting:
73
2. CONDITIONAL FORMATTING
Example 2:
Have a cell that shows PASS or FAIL depending on the value of
another cell
We want
PASS: Lt Green fill and Dk Green text
FAIL: Lt Red fill and Dk Red text
1. = IF ({cell} <= {min value}, FAIL,PASS)
2. = IF ({cell} >= {max value}, FAIL,PASS)
3. Home / Styles / Conditional Formatting/ Highlight Cell Rules/ Text that
Contains => dialog box
4. Format Cells that contain: FAIL
with Lt Red Fill with Dk Red Text
5. Format Cells that contain: PASS
with Lt Green Fill with Dk Green Text
74
2. CONDITIONAL FORMATTING
3. DATA VALIDATION
Use Excels Data Validation tools to enforce limits in
input fields.
Examples:
79
80
81
82
Any value
Whole number
Decimal
List
restrict input to items from a specified list
List should be included in a protected
column in the spreadsheet
Date
Time
Text length
Custom
83
3. DATA VALIDATION
Example: restrict field to specific length
84
3. DATA VALIDATION
Example: restrict possible values of a cell to those in
drop-down list
85
3. DATA VALIDATION
Example: prevent future dating
Allow:
Data:
End Date:
Date
less than or equal to
=INT(NOW())
86
3. DATA VALIDATION
Custom:
Example: ensure the entry in a column is a number
1.
2.
3.
4.
5.
6.
4. FORMULA AUDITING
4. FORMULA AUDITING
4.1 How to prevent your formulas from being displayed in the formula bar:
89
4. FORMULA AUDITING
4.1 How to prevent your formulas from being
displayed in the formula bar:
1. Select formula cell
2. Right click and select Format Cell
-OR- Home / Cells / Format / Format Cells
3. Protection:
[] Locked
[] Hidden
4. OK
5. Review / Changes / Protect Sheet
=> your formula will not be visible in the formula bar any longer
90
4. FORMULA AUDITING
4.2 How to trace Precedents and
Dependents in your formulas:
Precedents
1. Select formula cell
2. Formulas / Formula
Auditing / Trace Precedents
4. FORMULA AUDITING
4.2 How to trace Precedents and
Dependents in your formulas:
Dependents
1. Select formula cell
2. Formulas / Formula
Auditing / Trace Dependents
Excel will display arrows
showing which cells your
formula sends outputs to
Remove arrows deletes the
arrows
92
4. FORMULA AUDITING
4.3 How to show and evaluate your formulas:
93
4. FORMULA AUDITING
94
4. FORMULA AUDITING
95
4. FORMULA AUDITING
4.3 How to show and evaluate your formulas:
96
4. FORMULA AUDITING
97
4. FORMULA AUDITING
4.4 Formula Error Checking
If there are errors in a formula
(for example, entering a letter in
a numerical input cell), Excel will
show a #VALUE! error message
Click on Formula / Formula
Auditing / Error Checking
98
4. FORMULA AUDITING
Error Checking will display the cause of the error (wrong data
type in this example)
99
4. FORMULA AUDITING
From this dialog box you can:
Get HELP on the error type
Show calculation steps (same as Evaluate Formula).
You can see the step-by-step calculations Excel is
performing to evaluate your formula
Ignore Error:
error checking will continue checking the rest of your
spreadsheet and stop at all errors until its done
Edit in formula bar:
Edit the formula cell
100
Page x of xx
Worksheet name and version
Date and time
101
102
103
105
106
107
108
109
110
111
113
114
Cells changed
Date and time
User who changed it
Old and new value
117
118
119
QUESTIONS
120
Thank You !
121