Negative Item Response Bias in Education-Based Surveys - a Factor Modelling Approach

Stellenbosch Working Paper Series No. WP04/2021
 
Publication date: March 2021
 
Author(s):
[protected email address] (Stellenbosch University Economics Department & RESEP)
 
Abstract:

In applied survey-based research, it is common to encounter responses based on both positively and negatively worded questions. In practice, responses are typically recoded to ensure that the numerical values attached to the responses of positively and negatively worded questions are aligned. This is done under the assumption that the responses to negatively worded questions are perfectly reversed reflections of responses to identical or similar positively worded questions - that the variation is inversed. This paper tests this assumption within a framework of factor modelling using South African Grade 4 TIMSS data. It finds significant differences in the degree to which the different question orientations capture information about single latent constructs that a specific group of questions is designed to capture. And thus, a failure of the assumption.

 
JEL Classification:

A21, C81, C83, I21, O12

Keywords:

Latent Construct Estimation, Negatively Item Response, Confirmatory Factor Analysis, Hierarchical Cluster Analysis

Download: PDF (455 KB)

Login

(for staff & registered students)



Need a password?
Forgot your password?

BER Weekly

16 May 2025 Trade truce lifts markets, SA braces for winter load-shedding and budget reckoning
This week, data showed that South Africa’s unemployment rate rose in 2025Q1, with net job losses compared to 2024Q4. Meanwhile, mining output improved in March but declined overall for the quarter. In the US, inflation eased to a four-year low, while Germany’s economic sentiment rebounded sharply. The UK economy posted impressive growth in Q1; however,...

Read the full issue
 

BER Weekly

16 May 2025 Trade truce lifts markets, SA braces for winter load-shedding and budget reckoning
This week, data showed that South Africa’s unemployment rate rose in 2025Q1, with net job losses compared to 2024Q4. Meanwhile, mining output improved in March but declined overall for the quarter. In the US, inflation eased to a four-year low, while Germany’s economic sentiment rebounded sharply. The UK economy posted impressive growth in Q1; however,...

Read the full issue