Toward a Framework for Determining Methods of Evaluation in Design Science Research

Evaluation is a key phase of design science research, particularly in design-oriented information systems, one that involves analyzing and solving problems to create artifacts. Because the nature of those artifacts varies based on the problem, they necessitate different methods of evaluation, and selecting an appropriate one first requires identifying appropriate criteria for evaluation. This paper aims to pinpoint those criteria by systematically reviewing the literature, with particular focus on identifying various criteria for evaluation, their frequency, their significance in evaluating artifacts, and their connection to specific methods of evaluation. The findings suggest a framework for choosing the most suitable methods of evaluation based on the defined criteria that can enhance the rigor and relevance of the evaluation phase in design science research.