Negative Item Response Bias in Education-Based Surveys - a Factor Modelling Approach

Stellenbosch Working Paper Series No. WP04/2021
 
Publication date: March 2021
 
Author(s):
[protected email address] (Stellenbosch University Economics Department & RESEP)
 
Abstract:

In applied survey-based research, it is common to encounter responses based on both positively and negatively worded questions. In practice, responses are typically recoded to ensure that the numerical values attached to the responses of positively and negatively worded questions are aligned. This is done under the assumption that the responses to negatively worded questions are perfectly reversed reflections of responses to identical or similar positively worded questions - that the variation is inversed. This paper tests this assumption within a framework of factor modelling using South African Grade 4 TIMSS data. It finds significant differences in the degree to which the different question orientations capture information about single latent constructs that a specific group of questions is designed to capture. And thus, a failure of the assumption.

 
JEL Classification:

A21, C81, C83, I21, O12

Keywords:

Latent Construct Estimation, Negatively Item Response, Confirmatory Factor Analysis, Hierarchical Cluster Analysis

Download: PDF (455 KB)

BER Weekly

25 Jul 2025 Budget hurdle cleared, but US tariff implementation remains a risk
It was another big week on the local political front, but with some constructive momentum. On the trade front, ahead of next week’s 1 August deadline, Trump announced another “massive” trade deal with Japan. The upcoming week is busy, with a slew of global and domestic data releases and several monetary policy decisions, including the SARB....

Read the full issue