Negative Item Response Bias in Education-Based Surveys - a Factor Modelling Approach

Stellenbosch Working Paper Series No. WP04/2021
 
Publication date: March 2021
 
Author(s):
[protected email address] (Stellenbosch University Economics Department & RESEP)
 
Abstract:

In applied survey-based research, it is common to encounter responses based on both positively and negatively worded questions. In practice, responses are typically recoded to ensure that the numerical values attached to the responses of positively and negatively worded questions are aligned. This is done under the assumption that the responses to negatively worded questions are perfectly reversed reflections of responses to identical or similar positively worded questions - that the variation is inversed. This paper tests this assumption within a framework of factor modelling using South African Grade 4 TIMSS data. It finds significant differences in the degree to which the different question orientations capture information about single latent constructs that a specific group of questions is designed to capture. And thus, a failure of the assumption.

 
JEL Classification:

A21, C81, C83, I21, O12

Keywords:

Latent Construct Estimation, Negatively Item Response, Confirmatory Factor Analysis, Hierarchical Cluster Analysis

Download: PDF (455 KB)

Login

(for staff & registered students)



Need a password?
Forgot your password?

BER Weekly

26 Sep 2025 Free Weekly Review | Number 37 | 26 September
This report covers the key domestic and international data releases over the past week. The more comprehensive BER Weekly Review (Enhanced Version) includes a detailed discussion on the main economic events and developments over the past week, a summary of upcoming data (the week ahead) and the BER’s forecast for key economic indicators....

Read the full issue
 

BER Weekly

26 Sep 2025 Free Weekly Review | Number 37 | 26 September
This report covers the key domestic and international data releases over the past week. The more comprehensive BER Weekly Review (Enhanced Version) includes a detailed discussion on the main economic events and developments over the past week, a summary of upcoming data (the week ahead) and the BER’s forecast for key economic indicators....

Read the full issue