Abstract

http://ssrn.com/abstract=843
 
 

References (22)



 
 

Citations (1)



 


 



Validation of Simulation Models: Regression Analysis Revisited


Jack P. C. Kleijnen


Tilburg University, CentER

Bert Bettonvil


Tilburg University - Department of Economics

Willem J. H. Van Groenendaal


Tilburg University, CentER

Undated


Abstract:     
This paper proves that it is wrong to require that regressing a model's outputs on the observed real outcomes give a 45 line through the origin (unit slope, zero intercept). Therefore this paper proposes an alter-native requirement: the responses of the model and the real system should have the same means and the same variances. To test whether this requirement is satisfied, a novel statistical procedure is derived. This procedure regresses the differences of simulated and real responses on their sums. The old and the new procedures are investigated in an extensive Monte Carlo experiment that simulates queueing systems. The conclusions of this experiment are that (i) the old test rejects a valid simulation model substantially more often than the novel test does; (ii) the intuitive test shows 'perverse' behavior in a certain domain: the worse the simulation model, the higher its probability of acceptance; and (iii) the novel test does not reject a valid simulation model too often (its type I error probability is correct), provided the queueing response is transformed logarithmically.

Number of Pages in PDF File: 33

JEL Classification: C10, C15

working papers series


Download This Paper

Date posted: November 26, 1996  

Suggested Citation

Kleijnen, Jack P. C. and Bettonvil, Bert and van Groenendaal, Willem J. H., Validation of Simulation Models: Regression Analysis Revisited (Undated). Available at SSRN: http://ssrn.com/abstract=843 or http://dx.doi.org/10.2139/ssrn.843

Contact Information

Jack P.C. Kleijnen (Contact Author)
Tilburg University, CentER ( email )
P.O. Box 90153
Tilburg, 5000 LE
Netherlands
+31 13 4662029 (Phone)
+31 13 4663377 (Fax)
Bert W.M. Bettonvil
Tilburg University - Department of Economics ( email )
P.O. Box 90153
Tilburg, 5000 LE
Netherlands
+31 13 466 2359 (Phone)
Willem J.H. Van Groenendaal
Tilburg University, CentER ( email )
P.O. Box 90153
Tilburg, 5000 LE
Netherlands
+31 13 466 2423 (Phone)
Feedback to SSRN


Paper statistics
Abstract Views: 2,193
Downloads: 524
Download Rank: 28,220
References:  22
Citations:  1

© 2014 Social Science Electronic Publishing, Inc. All Rights Reserved.  FAQ   Terms of Use   Privacy Policy   Copyright   Contact Us
This page was processed by apollo2 in 0.297 seconds