Validation of Simulation, with and Without Real Data

Tilburg University, Center for Economic Research, Discussion Paper Series No. 1998-22

Posted: 1 Dec 1998

Date Written: 1998

Abstract

This paper gives a survey on how to validate simulation models through the application of mathematical statistics. The type of statistical test actually applied, depends on the availability of data on the real system: (i) no data, (ii) only output data, and (iii) both input and output data. In case (i), the system analysts can still experiment with the simulation model to obtain simulated data. Those experiments should be guided by the statistical theory on design of experiments (DOE); an inferior - but popular - approach is to change only one factor at a time. In case (ii), real and simulated output data may be compared through the well-known Student t statistic. In case (iii), trace-driven simulation becomes possible. Then validation, however, should not proceed as follows: make a scatter plot with real and simulated outputs, fit a line, and test whether that line has unit slope and passes through the origin. Instead, better tests are presented. Several case studies are summarized, to illustrate the three types of situations.

JEL Classification: C15

Suggested Citation

Kleijnen, Jack P.C., Validation of Simulation, with and Without Real Data (1998). Tilburg University, Center for Economic Research, Discussion Paper Series No. 1998-22, Available at SSRN: https://ssrn.com/abstract=138010

Jack P.C. Kleijnen (Contact Author)

Tilburg University, CentER ( email )

P.O. Box 90153
Tilburg, 5000 LE
Netherlands
+31 13 4662029 (Phone)
+31 13 4663377 (Fax)

HOME PAGE: http://https://sites.google.com/site/kleijnenjackpc/

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Abstract Views
616
PlumX Metrics