Académique Documents
Professionnel Documents
Culture Documents
Introduction Software
Production Process
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
Agenda
1. S. Passova & D. Shier. Sofea an industry leader in Requirements
Lifecycle Acceleration
2. Russian Team. Introduction to Sofea-Russia Software Production
Process
Standard Software Engineering Process based CMMI
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
People
Process
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
Technology
Overview of SPP
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
ORGANIZATION PROCESS
Policies
organizations expectations
Processes
working instructions
Assets
Templates
supporting elements
L
E
V
E
L5
o
p
tim
izin
g
Guidelines
L
E
V
E
L4
m
an
age
d
Metrics
Standards
Checklists
L
E
V
E
L3
d
e
fin
e
d
L
E
V
E
L2
re
p
e
atab
le
Tools
L
E
V
E
L1
in
itial
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
Kick-off
Develop
ment
Coding&UT
Req Gathering
& Planning
Integration
Testing
Test Planning
Estimates
Planning
Phase Kick-Off
Reviews
System
Release Maintenance
Testing
Automated
Test Generation
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
Postmortem
Audits
Metrics Analysis
Causal Analysis
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
Quality Process
Testing Process
Organizational Innovation
Training Process
Documentation Process
Maintenance Process
Supplier Agreement Process
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
Requirements Analysis,
Design
Coding & Unit Testing
Test Planning&Development
Testing
Release
Maintenance
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
Pre-planning
Project Ticket
Official Project Start
Notification of project stakeholders
Planning of Pre-planning activities
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
10
Typical Outputs
Requirements Book
Planning Docs
Software Project Management Plan
Risk Management Forms
Software Quality Assurance Plan
Software Configuration Management Plan
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
11
Business
Architectural
Concepts and scenarios
Features/Functions
Target/Host Platform
Interfaces
Installation
Legal
Performance
Test
Documentation
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
12
Project Plans
Software Project Management Plan (SPMP)
Software Configuration Management Plan (SCMP)
Configuration items
Baselines
Change Control Board
Integration Sequence
Metrics
Project Audit Plan
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
13
Requirements Analysis
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
14
Design
Architecture Meetings
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
15
Coding & UT
Source Code
Must be compliant with Coding Standards
Must pass walkthrough review
Must be traced to HLD/DD
Build Report
Documented Handover to Test Team
Build Procedure
Verification of Integration Readiness
Features implemented
Defects fixed
Results of Unit Testing
HLD/DD -> Code traceability
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
16
Test Plan
Test Strategy and Approach
Features to be Tested
Test Procedures
Description about how to run the Test Suites
Test Suites
A set of tests to run
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
17
Testing
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
18
Maintenance
Maintenance Plan
Similar to SPMP content
Maintenance Report
Releases with bug fixes/enhancements
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
19
Baselines
snapshot of project configuration items
Versions of docs passed reviews (approved)
Builds (Build Report)
Releases
Special Labels/Tags assigned to revisions of Configuration Items
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
20
Defect Lifecycle
Submitted
Assigned
Open
Resolved
Verified
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
21
Reviews
Agreement of affected people on content of the doc
Focus on problem identification not problem resolution
Artifact (document) passed review is baselined
Review Procedure in Brief
Notify in advance
Send material in advance
Prepare Review Notes
Assign Moderator, Recorder, Time Keeper
Go thru doc
Record the problems (Review Notes)
Gather metrics (Review Notes)
Agree upon Review Results (Review Notes Sign-off)
Review Follow-Up
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
22
Project Management
SPMP development
SCMP&SQAP
Planning of Configuration Management and Quality Management
Activities
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
23
Risk Management
Identify potential problem
E.g. Staffing Re-allocation, External HW/SW Delivery
Abatement/Mitigation Plan
Risk Trigger
What to do if triggers
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
---------- I m
pact --------->
LOW
MEDIUM
HIGH
HIGH(7-9)
(medium)
(high)
(unacceptable)
MEDIUM(4-6)
(low)
(high)
(unacceptable)
(medium)
(high)
LOW (1-3)
(low)
24
Project Metrics
Project Quality Tracking Tool (PQTT)
Tracked Parameters
Defect Rate, Code Progress, Test Progress, Staffing, Slippage
Other Quality Attributes
Requirements Volatility, Phase Containment Effectiveness, Schedule
Estimation Accuracy
Update by SQA
Analyzed by PLs
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
25
Defect Prevention
Purpose
To avoid the recurrence of problems
To prevent potential problems
Post-mortems
overview of passed activities
Causal Analysis
Critical investigation of root causes of the most critical defects
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
26
Defect Prevention
Use of Checklist
A list of typical problems and memory records
Most of project documents have an associated checklist
Accumulated experience of previous projects
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
27
Quality Assurance
Auditing
Use of Audit Checklists
Process Consulting
Tailoring/non-compliance issues
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
28
Tailored process
for Sofea-Russia team
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
29
Lifecycle Selection
Metrics selection
Project Documents Definition
Update Standard Software Development Process
Selection Needed Tools
Dependencies
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
30
Configuration Management
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
31
Configuration Management
Configuration Item (CI) - information created as part of the software
process (documents, source code, reports, etc.)
Configuration identification activities shall identify, name, and describe the
documented physical and functional characteristics of the code, specifications,
design, and data elements to be controlled for the project.
Baseline is a set of consistent CIs. Typically baselines are identified in RMS
by some rules, e.g. as snapshot in time of the current state of every item
related to the project.
Tag/label is used to identify CI baseline.
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
32
Configuration Management
<PROCESS> repository in SVN
proposed for storage of the process artifacts
process
Audits
Guidelines
Handbook
Procedures
Standards
Templates
Training
docs
fs
versions
testing
defects models plans reportsscenarios
emf
main
server
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
UAT
Bundle
33
Measurement Areas
Delivered defects and delivered defects per size
Total effectiveness throughout the process
Adherence to schedule
Accuracy of estimates
Number of open customer problems
Time that problems remain open
Metrics
Customer
Satisfaction
Software
Development
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
Testing
In-process
35
Customer
Satisfaction
NSI - Net
Satisfaction Index
Software
Development
Response for a class
(RFC)
Code Convention
Defect Rate (CDR
Number defects per
package)
Code Progress (CP)
Testing
Defects Density
(DD)
Defected rate (DR)
Software
Development
Effectiveness
(SDE):
Defect Removal
Effectiveness (DRE)
Mean Age of Open
Defects(AOD)
NRC number of
regression cycles
TCD Testing
Completeness
Degree
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
In-process
Schedule
Estimation
Accuracy (SEA)
36
Periodicity of Metrics
Development
Phase
Module Testing
Regression
Testing
Process
CP weekly
SDE cycle
SDE cycle
SEA weekly
Code Progress
Software Development
Effectiveness
Software
Development
Effectiveness
Schedule Estimation
Accuracy
CCD monthly
Code Convention Defect
Rate
RFC- monthly
Response for a class
AOD- cycle
Mean Age of Open
Defects
AOD- cycle
Mean Age of Open
Defects
DD - cycle
AOD - after
release
Mean Age of Open Defects
NSI-after release
Defect Density
TCD - cycle
DRE after
release
Testing Completeness
Degree
Defect Removal
Effectiveness
NRC after
release
Number of regression
cycles
DR after release
defect rate
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
37
Size (LOCs)
Effort (Hours)
Note: Assembler: 1 line loc, C 2,5 LOC, C++ - 6 LOC, Visual C 9 LOC, Java 6
TEST EFFORT:
Activity
Effort (Hours)
Plan
Actual
Delay
SCHEDULE STATUS:
CORRECTIVE ACTION TAKEN FOR SLIPPAGE:
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
38
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
39
NM
NT
NM
100%
NT
- Total defects opened for module
- Total open defects
N LOC
40
N DC
100 %
N DL
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
41
- Total
time N
for
open problems.
DO
- Total number of open problems.
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
42
TCD
Np
Nt
100%
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
43
In-process metrics
SEA
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
44
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
45
Realize
+
In-process
Projection of test errors and comparison between projected and actual numbers
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
46
No Release
Defect Rate
6.0
0.41
Level 1
0.75
6.1
0.42*
Level 2
0.44
6.2
0.15
Level 3
0.27
6.3
In-process
Level 4
0.14
Level 5
0.05
N LOC
DR
SEI CMMI
Level
Defect Rate
NM
1000
N LOC
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
47
Testing Process
Usability
Manual
Module
Manual
Code Convention
Manual
*Automated
Code Structure
Manual
zed
* Automated
Functional
Code Structure
Testing
Regression
Manual
*Automated
Stress
Installation
- Russian
Configuration
-Toronto Team
*
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
Team
-Planned to realize
48
Parameter
Manual
(actually)
Automated
(estimated)
340
340
0.7
0.25
Day
119
42.5
Persons
Months
2.9
1.06
To cover all test scenarios and to provide good quality of software product its
necessary to automate phase of testing. It should reduce period of testing.
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
49
Sofea-Russia Team
Sofea-Russia Team Staff and Experience in Profesy project
Education
44%
PHD 19%
PHD in progress -15%
Master 11%
Bachelor 11%
Students 44%
19%
11%
15%
Students
11%
Bachelor
Master
PHD in progress
PHD
Participation
51%
15%
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
19%
15%
1 -3 years
3-4 years
50
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
51
Basic processes
Release 6.3 Development
Customer
Request
Req Analysis
Requirements Definition
General Planning
Software Architecture Design
Development
Phase 0
Phase 1
SubProject 1
SubProject 2
SubSubProject 3 Project 4
Phase 2
Integration
Overall system and regression testing
Release
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
52
Configuration Management
Product Development
Use Case
Specification
Schedule,
QA doc
Test Report
from Test
Director
Test Report from Test
Director
Req
Analysis
Kick-off
Profesy
API (Javadoc)
Develop
Coding&UT
ment
Req Gathering
& Planning
Integration
Testing
Test
Planning
Profesy
API
(Javadoc)
System
Testing
Release Maintenance
Automated
Test Generation
QA doc
Test Plan
for Russian
team
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
53
Prototyping:
1. Sub-Project 1: EMF Integration
2. Sub-Project 2: SVN client prototype, Diff-Merge prototype
3. Sub-Project 4: Velocity HTML engine prototype
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
54
Assistance processes
Sub-Project Development
Prototyping
Refinement of requirements
for SubProject
Prototyping
Refining
Design
and Prototype
Sub-Project Coding
Sub-Project Testing
Building
Prototype
Customer evolution
of Prototype
Sub-Project Module
Phase 0,1
Phase 2
Customer satisfied
Prototype and report
Sub-Project Finish
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
55
Nov 10
2006
Phase 0
(Simple)
Phase 1 (Full
version)
Phase 2 (Final
Version)
Dec 01
2006
Jan 01
2007
Feb 01
2007
March 01
2007
April 01
2007
May 01
2007
June 01
2007
July 31
2007
Feb 16
2007
Apr 02
2007
May 16
2007
Testing
milestone
0
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
milestone
1
milestone 2
56
Dec 01 2006
Jan 01 2007
Feb 01 2007
March 01 2007
April 01 2007
Requirements
Specification
Multi-model
support
Requirements Specification
Project Explorer
Requirements
Specification
Requirements Specification
Preferences and
Settings
Requirements Specification
Design / Development
Clickable
Message Pane
Requirements Specification
Design / Development
Requirements Specification
Design / Development
May 01 2007
June 01 2007
Testing
Design / Development
Testing
Multi-model
Integration
Design/
Development
Multi-model
Integration
System
Testing
Release
Preparation
Setup
testing
Post Setup
Testing
Design / Development
Integration
Testing
Testing
Feb 16 2007
milestone 0
Apr 02 2007
milestone 1
May 16 2007
milestone 2
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
57
Dec 01 2006
Requirements
Specification
(Non EMF)
Compare / Diff /
Merge
Formal
Workspace
Jan 01 2007
Requirements
Specification
Configuration
Management
Version Control
Requirements Specification
User Interface
Requirements Specification
Feb 01 2007
Development
/ Design
(Non EMF)
March 01 2007
May 01 2007
June 01 2007
Design/Development (EMF)
Requirements
(EMF)
EMF
Integration
Design/Development
Design
/Development CM/SVN Library
standalone
Design /Development
MKS
April 01 2007
Testing
Design /Development
Synch/Merge/Diff.
Testing
Development
Synch/Merge/Diff
Integration
Testing
Testing
Design
/Development
prototype
System
Testing
Release
Preparation
Setup
testing
Post Setup
Testing
Testing
Feb 16 2007
milestone 0
Apr 02 2007
milestone 1
May 16 2007
milestone 2
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
58
Layout
improvements
UCG Editor GUI
Dec 01 2006
Jan 01 2007
Feb 01 2007
March 01 2007
Export to MS Visio
Requirements Specification
Design/Devel
EMF
providers
Devel of GUI
elements
Requirements Specification
Requirements Specification
Requirements Specification
May 01 2007
Design/Development
Layout algorithms improvements
Requirements Specification
UC Diagram
integration
April 01 2007
EMF
Integration
EMF
Integration
Design /Devel
Interaction engine
Design /Development
Export to MS Visio
Modular and
integration testing
June 01 2007
System
Testing
Release
Preparation
Setup
testing
Post Setup
Testing
Testing
Feb 16 2007
milestone 0
Apr 02 2007
milestone 1
May 16 2007
milestone 2
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
59
Profesy Reporting
Format (EMF)
Dec 01 2006
Requirements
Jan 01 2007
Feb 01 2007
PRF
Design
March 01 2007
Testing
April 01 2007
PRF
Generator
Engines Analysis
Testing
Testing
Publishing via
Templates
Prototyping
Requirements
Integration
Testing
May 01 2007
GUI
Wizard
Traceability
Preferences
Traceab.
June 01 2007
System
Testing
Release
Preparation
Setup
testing
Post Setup
Testing
Testing
Feb 16 2007
milestone 0
Apr 02 2007
milestone 1
May 16 2007
milestone 2
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
60
Dec 01 2006
Jan 01 2007
Feb 01 2007
March 01 2007
April 01 2007
May 01 2007
June 01 2007
Feb 16 2007
R6.3 Phase 0
Apr 02 2007
R6.3 Phase 1
May 16 2007
R6.3 Phase 2
Hiring Plan
Testing
Core team: 13
Students: 3
Hirig:
1 student,
3 engineers
Hiring:
2 students
Dismissed:
1 SE,
1 IT mgr
Hiring:
4 students
Hiring 3
students
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
61
Trainings
Training is an integral part of any organization and has special significance to organizations
dealing with knowledge-based products and services. All managers have to ensure that the
engineers assigned to the project receive sufficient training to improve their skills every year.
Trainings
Core Team
Internship Team
Code convention
Version control
New technologies
New libraries/tools
SW process improvement
Code Convention_
Version Control_
Defect Tracking_
Schedule and Time Tracking
Expectations:
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
62
Customer
Request
Request
analysis
Estimation
Coding
Testing
Build
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
63
Descriptions/Deliverables
Milestones and Outlook
Issues and Resolution
Plan
Risks and Mitigation
Strategies
Dependencies and Outlook
Budget and Actual/Outlook (estimated)
Metrics progress, quality
Visual Requirements Definition & Validation ::: Strictly Proprietary & Confidential :::
64