Rule-Based Process Indicators of Information Processing Explain Performance Differences in PIAAC Web Search Tasks

Periodical
Large-scale Assessments in Education
Volume
11
Year
2023
Issue number
1
Page range
16
Access date
06.12.2023
Relates to study/studies
PIAAC Cycle 1

Rule-Based Process Indicators of Information Processing Explain Performance Differences in PIAAC Web Search Tasks

Abstract

A priori assumptions about specific behavior in test items can be used to process log data in a rule-based fashion to identify the behavior of interest. In this study, we demonstrate such a top-down approach and created a process indicator to represent what type of information processing (flimsy, breadth-first, satisficing, sampling, laborious) adults exhibit when searching online for information. We examined how often the predefined patterns occurred for a particular task, how consistently they occurred within individuals, and whether they explained task success beyond individual background variables (age, educational attainment, gender) and information processing skills (reading and evaluation skills).