On the Implementation of Computerized Adaptive Observations for Psychological Assessment

Umberto Granziol, Andrea Brancaccio, Giulia Pizziconi, Marco Spangaro, Federica Gentili, Marta Bosia, Eleonora Gregori, Chiara Luperini, Chiara Pavan, Valeria Santarelli, Roberto Cavallaro, Carla Cremonese, Angela Favaro, Alessandro Rossi, Giulio Vidotto, Andrea Spoto

Research output: Contribution to journalArticlepeer-review

Abstract

The use of observational tools in psychological assessment has decreased in recent years, mainly due to its personnel and time costs, and researchers have not explored methodological innovations like adaptive algorithms in observational assessment. In the present study, we introduce the behavior-driven observation procedure to develop, test, and implement observational adaptive instruments. In Study 1, we use a preexisting observational checklist to evaluate nonverbal behaviors related to psychotic symptoms and to specify the adaptive algorithm’s model. We fit the model to observational data collected from 114 participants. The results support the model’s goodness of fit. In Study 2, we use the estimated model parameters to calibrate the adaptive procedure and test the algorithm for accuracy and efficiency in adaptively reconstructing 58 nonadaptively collected response patterns. The results show the algorithm’s good accuracy and efficiency, with a 40% average reduction in the number of administered items. In Study 3, we used real raters to test the adaptive checklist built with behavior-driven observation. The results indicate adequate intrarater agreement and good consistency of the observed response patterns. In conclusion, the results support the possibility of using behavior-driven observation to create accurate and affordable (in terms of resources) observational assessment tools.

Original languageEnglish
Pages (from-to)225-241
Number of pages17
JournalAssessment
Volume29
Issue number2
DOIs
Publication statusPublished - Mar 2022

Keywords

  • adaptive psychological assessment
  • behavior-driven observation
  • behavioral observation
  • cross-validation
  • modal response patterns
  • one-zero sampling
  • schizophrenia

ASJC Scopus subject areas

  • Clinical Psychology
  • Applied Psychology

Fingerprint

Dive into the research topics of 'On the Implementation of Computerized Adaptive Observations for Psychological Assessment'. Together they form a unique fingerprint.

Cite this