M&D3: Individual and Organizational Diagnosis

URL study guide

https://studiegids.vu.nl/en/courses/2025-2026/P_BMD3IOD

Course Objective

The primary aim of this course is to provide insight into the key tools and methods that can be used to assess individuals, groups, and organizations. After finishing the course, you will be able to translate such an assessment into relevant actions or workplace interventions. After completing the course, you will obtain knowledge and skills related to:The most important quality requirements of measurement instruments and the application of this knowledge to evaluate the quality of measurement instruments;The (theoretical) background, psychometric quality, and applicability of measurement instruments that are commonly used by assessors/consultants in the workplace;The development of a measurement instrument and the examination of its psychometric properties in the organizational context;Different utility and decision-making models and the ability to calculate the utility of instruments and procedures;Different models of test fairness and the ability to calculate the adverse impact of instruments and procedures;Optimal group composition and the measurement of individual
- and team-level variables;Different measures at organizational level (e.g., organizational culture) which are commonly used by organizations.Evidence-based test use and decision makingThe content of this course will bridge the gap between theory and practice through analyses of the current practices present in the today's business environment.

Course Content

In the course you will learn how to evaluate and use tests and questionnaires in research and assessment, especially, in recruitment and personnel selection. You will learn to understand personnel selection methods, to check whether instruments are reliable, and to check whether those instruments measure what they are supposed to measure. You will learn what kinds of instruments are used in assessment and research and what requirements measurement instruments need to satisfy (e.g., by professional associations). You will analyze the reliability, validity, utility, and adverse impact of measurement instruments. Importantly, you will also learn how to use multiple instruments to make important workplace decisions such as whom to hire, fire, and promote. Furthermore, you will learn about state-of-the-art research on algorithmic decision-making in individual diagnosis.

Teaching Methods

The course consists of a total of 14 lectures. Lectures will be taught in English. There will be two lectures per week. Although attending the lectures is not mandatory, it is strongly recommended to attend lectures and actively participate in them. During the lectures, we will also work on small assignments that teach you how to develop tests and assess people in practice.

Method of Assessment

Written exam consisting of multiple-choice items (70% of the total grade) and group empirical report (30% of the total grade).

Literature

The students are required to get access to the following two textbooks via the university library. Both titles should be available as ebooks. Goldstein, H. W., Pulakos, E. D., Passmore, J., & Semedo, C. (Eds.). (2017). The Wiley Blackwell handbook of the psychology of recruitment, selection and employee retention (1st ed.). Wiley. (selected chapters)Shultz, K. S., Zickar, M. J., & Whitney, D. J. (2014). Measurement theory in action: Case studies and exercises, second edition (pp. 57–122). New York, NY: Routledge. (selected chapters)Additional literature, mostly empirical articles, will be presented in the course manual.

Target Audience

This course is required when applying to the master's program in Work and Organizational Psychology at the Vrije Universiteit Amsterdam.

Additional Information

Note that this is a very intensive course. It requires adequate preparations and performing multiple tasks.

Recommended background knowledge

The content of this course builds upon previous coursework in the Bachelor of psychology. As such, it is assumed that basic concepts (e.g., reliability, validity, measurement error, test validation) are understood by students who enroll in this course. If you do not have much experience with statistics and methods, ensure that you have studied the following textbook before starting the course: Furr, R. M. (2011). Scale construction and psychometrics for social and personality psychology. London: SAGE.

Explanation Canvas

Course materials will be available on a Canvas course. It is strongly recommended to participate in all Canvas activities regularly.