A Good or a Bad Timetable: Do Different Evaluation Functions Agree?

42 Pages Posted: 10 Apr 2019

See all articles by Johann Hartleb

Johann Hartleb

Erasmus University Rotterdam (EUR) - Rotterdam School of Management (RSM)

Marie Schmidt

Erasmus Research Institute of Management (ERIM)

Markus Friedrich

University of Stuttgart

Dennis Huisman

Erasmus University Rotterdam (EUR) - Department of Econometrics; Erasmus University Rotterdam (EUR) - Erasmus Center for Optimization in Public Transport (ECOPT)

Date Written: April 4, 2019

Abstract

We compare different evaluation functions that are all designed to measure the quality of a timetable from passengers’ perspective. Already in small examples fundamentally different timetables can be preferred by evaluation functions that seem to be similar. To investigate this effect in practice, we design a set of evaluation functions as representatives for a wide range of commonly used evaluation functions in optimization models, evaluation applications, or choice models. These functions are compared by analyzing their evaluation values of multiple timetables in three case studies. To investigate to what extent these evaluation functions agree on a good or a bad timetable, we apply cluster analysis as well as a novel methodology to quantify the similarity of pairs of evaluation functions based on the values they yield on different timetables.

We empirically show that the choice of the evaluation function can have a significant impact on the assessed quality of timetables, and thus also on which timetable is considered optimal, even though all evaluation functions are meant to evaluate the same - the quality of a timetable from passengers’ perspective. Due to the structure of the designed evaluation functions, it is further possible to identify which components of the functions influence the results of an evaluation and under which conditions they this is most pronounced. This can be very beneficial when designing timetable evaluation functions for passengers.

Keywords: public transport evaluation, consistent evaluation, timetable evaluation, comparison of evaluation functions

Suggested Citation

Hartleb, Johann and Schmidt, Marie and Friedrich, Markus and Huisman, Dennis, A Good or a Bad Timetable: Do Different Evaluation Functions Agree? (April 4, 2019). ERIM Report Series . Available at SSRN: https://ssrn.com/abstract=3368839 or http://dx.doi.org/10.2139/ssrn.3368839

Johann Hartleb (Contact Author)

Erasmus University Rotterdam (EUR) - Rotterdam School of Management (RSM) ( email )

P.O. Box 1738
Room T08-21
3000 DR Rotterdam, 3000 DR
Netherlands

Marie Schmidt

Erasmus Research Institute of Management (ERIM) ( email )

P.O. Box 1738
3000 DR Rotterdam
Netherlands

Markus Friedrich

University of Stuttgart ( email )

Keplerstraße 17
D-70174 Stuttgart
Germany

Dennis Huisman

Erasmus University Rotterdam (EUR) - Department of Econometrics ( email )

P.O. Box 1738
3000 DR Rotterdam
Netherlands
+31 10 408 1523 (Phone)
+31 10 408 9162 (Fax)

HOME PAGE: http://www.few.eur.nl/few/people/huisman/

Erasmus University Rotterdam (EUR) - Erasmus Center for Optimization in Public Transport (ECOPT)

3000 DR Rotterdam
Netherlands

Register to save articles to
your library

Register

Paper statistics

Downloads
4
Abstract Views
82
PlumX Metrics
!

Under construction: SSRN citations while be offline until July when we will launch a brand new and improved citations service, check here for more details.

For more information