General recommended methodology and considerations for acceptance

of the calibration and validation of a hydrodynamic modeling.

DSR, 2011
System Performance Criteria
Model calibration should be performed generally in accordance with the criteria agreed.
The overall model performance for obtaining an acceptable calibration and validation of the model
would be based on a number of system performance criteria (an assessment of whether or not the
results obtained via the calibration and validation process of the model are satisfactory for a reliable
assessment). The main purpose is to ensure that controlling factors and processes for the
simulations are satisfactorily represented by the model.
It is noted that the system performance criteria are considered the most important elements for the
acceptance of the calibration and validation of the hydrodynamic modelling.
System Performance Criteria consist of:
1. Checking the calibrated models ability to represent the general and observed current patterns in
the study region comparison of simulated and measured snapshots of the currents for various
flow situations (both directions alongshore currents, on-offshore currents, calm conditions,
stormy conditions).
2. When relevant - check the calibrated models ability to represent the general and observed flow
patterns in the study region comparison of simulated stratification pattern with observed
vertical profiles (flow, temperature, salinity) represented in the model.
3. When relevant - check the calibrated models ability to properly simulate the transport of
pollutants comparison of measured and simulated concentration distribution (nitrogen,
phosphorous, TSS).
4. When relevant - check the calibrated models ability to reproduce observed variability in water
quality (Chlorophyll, nutrients, dissolved oxygen) in selected zones of the study region
comparison of simulated and measured ranges in dedicated zones.
5. When relevant - check the calibrated models ability to obtain expected residence times in
selected zones of the study region comparison against previous studies.
Supporting Performance Criteria
It is understood that specification of criteria for hydrodynamic and water quality calibration,
without provision of a detailed data set for the modelling (input data as well as calibration data),
may result in unrealistic model performance, hence the outcomes must be evaluated against the
system performance criteria as specified above.
However, as a supporting instrument, also quantitative performance criteria for certain
hydrodynamic and water quality selected parameters should be used in the assessment.

The quantitative performance criteria outlined below constitute the required performance for
stations/zones where sufficient data for both the measured parameters and the underlying
controlling input data (such as wind, solar radiation, fluxes and concentrations at model boundaries,
pollution loading etc.) exist.
Hydrodynamic parameters:
a.

Sea levels (RMS error between measured and simulated levels, corrected for datum
differences) within 15% of the monthly tide range, defined by the values of the monthly
averages of the daily measured tide lows and tide highs, provided the trends are similar. Timing
of highs and lows accurate to the hourly time.

b.

Current speeds (average deviation between measured and simulated speeds) within 20% of the
monthly average current speed. Current speeds below 1cm/s will not be included in the
computation.

c.

The current directions differences between the measured and simulated main monthly currents
should be confined within a 10 deg range. The main directional sectors to be identified from
current roses, and the main directions to be calculated as the mean direction in each directional
sector weighted with respect to the speed (both for measured and simulated data). This criterion
will apply to locations with pronounced and reasonably easyly identifiable main current
directions.

d.

Current speed and direction vertical profile distribution within the criteria under b and c,
provided also that measured and modelled currents profiles have in general similar trends.

e.

Timing of values accurate to the hour, months are defined by Gregorian calendar.

f.

The above sea level and current criteria are applied to the model calibration period as well as
the model validation period.

The cal/val process must be presented in a detailed report including reasoning and main results,
prior to cal/val acceptance of the model. Proper details for Initial Conditions and for Boundary
Conditions, including for wind, currents (including wave induced currents where relevant), sea
levels, etc.