Opening the ‘Black Box’ of Simulations: Transparency of Simulation Models and Effective Results Reports Through the Systematic Design of Experiments

Hamburg University of Technology (TUHH) , Research Paper Series No. 001

39 Pages Posted: 9 Jun 2011 Last revised: 25 Jan 2015

See all articles by Iris Lorscheid

Iris Lorscheid

Hamburg University of Technology

Heine Bernd-Oliver

affiliation not provided to SSRN

Matthias Meyer

Technical University Hamburg-Harburg (TUHH)

Date Written: May 1, 2011

Abstract

Many still view simulation models as a black box. This paper argues that perceptions could change if the systematic design of experiments (DOE) for simulation research was fully realized. DOE can increase (1) the transparency of simulation model behavior and (2) the effectiveness of reporting simulation results. Based on DOE principles, we develop a systematic procedure to guide the analysis of simulation models as well as concrete templates for sharing the results. A simulation model investigating the performance of learning algorithms in an economic mechanism design context illustrates our suggestions. Overall, the proposed systematic procedure for applying DOE principles complements current initiatives for a more standardized simulation research process.

Keywords: communication, design of experiments, simulation, standards, transparency

Suggested Citation

Lorscheid, Iris and Bernd-Oliver, Heine and Meyer, Matthias, Opening the ‘Black Box’ of Simulations: Transparency of Simulation Models and Effective Results Reports Through the Systematic Design of Experiments (May 1, 2011). Hamburg University of Technology (TUHH) , Research Paper Series No. 001. Available at SSRN: https://ssrn.com/abstract=1860904 or http://dx.doi.org/10.2139/ssrn.1860904

Iris Lorscheid (Contact Author)

Hamburg University of Technology ( email )

Schwarzenbergstrasse 95
Hamburg, DE Hamburg 21073
Germany

Heine Bernd-Oliver

affiliation not provided to SSRN ( email )

Matthias Meyer

Technical University Hamburg-Harburg (TUHH) ( email )

Schwarzenbergstr. 95
Hamburg, 21073
Germany

Register to save articles to
your library

Register

Paper statistics

Downloads
202
Abstract Views
1,222
rank
151,885
PlumX Metrics