Standards for Evaluating Source Reliability and Information Credibility in Intelligence Production
Irwin, D. & Mandel, D. R. (accepted conditionally). Standards for evaluating source reliability and information credibility in intelligence production. In D. R. Mandel (Ed.), Assessment and Communication of Uncertainty in Intelligence to Support Decision Making: Final Report of Research Task Group S
16 Pages Posted: 15 Aug 2019
Date Written: April 1, 2019
Intelligence practitioners must regularly exploit information of uncertain quality to support decision-making. Recognizing information evaluation as a key function within the intelligence process, some organizations provide standards for assessing and communicating relevant information characteristics. Despite their intent, however, many of these standards are inconsistent across organizations, and may be fundamentally flawed or otherwise ill-suited to the context of application. In certain situations, poorly formulated standards may actually inhibit collaboration, degrade the quality of analytic judgements, and impair decision-making. In order to develop evidence-based recommendations for future practice in the assessment and communication of information quality, SAS-114 collected standards in use across a variety of agencies and domains. The following chapter provides a critical examination of standards for evaluating source reliability and information credibility, and highlights avenues for future research and development.
Keywords: intelligence analysis, intelligence production, information evaluation, NATO
JEL Classification: Z18
Suggested Citation: Suggested Citation