Negative Item Response Bias in Education-Based Surveys - a Factor Modelling Approach

Stellenbosch Working Paper Series No. WP04/2021
 
Publication date: March 2021
 
Author(s):
[protected email address] (Stellenbosch University Economics Department & RESEP)
 
Abstract:

In applied survey-based research, it is common to encounter responses based on both positively and negatively worded questions. In practice, responses are typically recoded to ensure that the numerical values attached to the responses of positively and negatively worded questions are aligned. This is done under the assumption that the responses to negatively worded questions are perfectly reversed reflections of responses to identical or similar positively worded questions - that the variation is inversed. This paper tests this assumption within a framework of factor modelling using South African Grade 4 TIMSS data. It finds significant differences in the degree to which the different question orientations capture information about single latent constructs that a specific group of questions is designed to capture. And thus, a failure of the assumption.

 
JEL Classification:

A21, C81, C83, I21, O12

Keywords:

Latent Construct Estimation, Negatively Item Response, Confirmatory Factor Analysis, Hierarchical Cluster Analysis

Download: PDF (455 KB)

BER Weekly

6 Jun 2025 SA GDP barely expands in Q1, while BCI and PMI suggest that Q2 remained weak
It was a busy week for local data releases, much of which painted a bleak picture of SA’s economy. Not only was first-quarter GDP growth dismal, but 2024 growth was also revised lower to just 0.5%. , The RMB/BER Business Confidence Index (BCI) showed sentiment remained shaky in the second quarter...

Read the full issue