The Rapid Online Assessment of Reading (ROAR) is a web-based, lexical decision task that measures single word reading abilities in children and adults without a proctor. Here we study whether item response theory (IRT) and computerized adaptive testing (CAT) can be used to create a more efficient online measure of word recognition.
This repo contains data analysis and figures in the manuscript of ROAR-CAT.
Study 1: parameter_invariance.Rmd
Study 2: cat_validation.Rmd
Study 3: roar-convergent-validity.Rmd
jsCAT software can be found in https://github.com/yeatmanlab/jsCAT
The demo of the operational ROAR-CAT (84 adaptive items): https://roar-word.web.app/?recruitment=demo
Code to produce the results and figures can be found in https://github.com/yeatmanlab/ROAR-CAT-Public
We cannot legally make the data public due to privacy regulations from the schools.
Data available on request for research collaboration purposes.
Ma, W. A., Richie-Halford, A., Burkhardt, A. K., Kanopka, K., Chou, C., Domingue, B. W., & Yeatman, J. D. (2025). ROAR-CAT: Rapid Online Assessment of Reading ability with Computerized Adaptive Testing. Behavior Research Methods, 57(1), 1-17. https://doi.org/10.3758/s13428-024-02578-y
@article{ma2025roar, title={ROAR-CAT: Rapid Online Assessment of Reading ability with Computerized Adaptive Testing}, author={Ma, Wanjing Anya and Richie-Halford, Adam and Burkhardt, Amy K and Kanopka, Klint and Chou, Clementine and Domingue, Benjamin W and Yeatman, Jason D}, journal={Behavior Research Methods}, volume={57}, number={1}, pages={1--17}, year={2025}, publisher={Springer} }
Corresponding Author: Wanjing Anya Ma [email protected]