Verification and Validation

of Simulation Models
Group ID : 3
Divyesh Bhayani: 1324003
Priyanka Ghadi: 1324010
Jenil Gada: 1324011
Jigar Dhruv :

Abstract

Simulation helps in delivering some

very important decisions to be made by
the system.

One of the most difficult problems

facing the simulation analyst is
determining whether a simulation
model is an accurate representation of
the actual system being studied ( i.e.,
whether the model is valid).

 Verification: It is concerned with building

the model right.
It is utilized in the comparison of the
conceptual model to the computer
representation that implements that
conception.
It asks the questions: Is the model
implemented correctly in the computer?
Are the input parameters and logical
structure
of
the
model
correctly
represented?

 Validation: concerned with building the

right model.
It is utilized to determine that a model is an
accurate representation of the real system.
Validation is usually achieved through the
calibration of the model, an iterative
process of comparing the model to actual
system
behavior
and
using
the
discrepancies between the two, and the
insights gained, to improve the model.
This process is repeated until model
accuracy is judged to be acceptable.

Steps in Model Building

1.- Observe the real system
2.- Construct conceptual model and
perform conceptual validation
3.- Translate conceptual model into a
computer model and perform
verification
4.- Calibrate, verify and validate at every
step

Simplified version of the modeling

process

Verification of Simulation
Models
Many common sense suggestions can be
given for use in the verification process.
1. Have the code checked by someone other
than the programmer.
2. Make a flow diagram which includes each
logically possible action a system can take
when an event occurs, and follow the model
logic for each action for each event type.
3. Closely examine the model output for
reasonableness under a variety of settings
of the input parameters. Have the code
print out a wide variety of output statistics.

Validation Techniques

A combination of techniques is
generally used. These techniques are
used for verifying and validating the
sub models and the overall model
Animation.
Comparison to Other Models.
Event Validity.
Extreme Condition Tests.
Face Validity.
Historical Data Validation.

Validation of Model
Compare model
to reality

Initial
Model
Revise

Real
System

Compare
revised model
to reality

First revision
of model
Revise

Compare 2nd
revised model
to reality

Second
revision
of model

Revise

Face Validity
Face validity is concerned with the
reasonableness of the model to
knowledgeable peers.
Sensitivity analysis can help
checking for face validity.

Validating Transformations
The range of outputs of the model for
a given range of inputs must
resemble the one observed in the
real system.
Use historical data.
Validate on the main response
variables.
What to do if the model represents a
non-existing system?

Conclusion
Model verification and validation are
critical in the development of a
simulation model.
Unfortunately, no algorithm exists to
determine what techniques or
procedures to use.
Every simulation project presents a new
and unique challenge to the model
development team.