Rotten apples or just apples and pears? Understanding patterns consistent with cheating in international test data
Stellenbosch Working Paper Series No. WP17/2017Publication date: December 2017
Author(s):
[protected email address] (Department of Basic Education)
The Southern and Eastern Africa Consortium for Monitoring Educational Quality (SACMEQ) programme has succeeded in generating valuable knowledge about the outcomes of schooling in the region, and in developing capacity to use data, including test data, in governments and amongst researchers. However, there is room for improvements in the programme. The current paper examines the extent to which patterns in the 2000 and 2007 test data suggest cheating occurred. The risk of cheating during the administration of the SACMEQ tests clearly exists, both because in-built controls can be subverted and because all pupils write exactly the same test, which is unlike the situation in a programme such as TIMSS, which employs a matrix sampling test design approach. Data analysis methods developed by Jacob and Levitt (2003) to detect cheating are adapted and then applied to the SACMEQ, but also TIMSS, data. It is concluded that whilst cheating does not substantially change the overall picture of performance derived from the 2000 and 2007 data, or country rankings, noteworthy patterns highly consistent with cheating can be found in some countries, and some regions within countries. Country-level indicators of cheating in SACMEQ correlate remarkably well with World Bank indicators of general corruption. An analysis of conditional correlations within the SACMEQ data reveals that schools serving more socio-economically disadvantaged pupils are more likely to cheat. In one country, having a male school principal is associated with a higher likelihood of cheating.
JEL Classification:C89, D73, I21
Keywords:SACMEQ, TIMSS, assessment data, cheating, corruption, gender
Download: PDF (461 KB)Login
(for staff & registered students)
Upcoming Seminars
Monday 21 July 202512:00-13:00
Izak Odendaal: Old Mutual Wealth Chief Investment Strategist
Topic: "Diverging fiscal policies and what it means for markets"
12:00-13:00
Dr Neil Rankin: Ceo Of Predictive Insights & Stellenbosch University
Topic: "TBC"
12:00-13:00
Prof Willem Boshoff: Stellenbosch University
Topic: "Two competing approaches in South African competition policy: merger control and anti-cartel enforcement over the past 30 years"
BER Weekly
27 Jun 2025 Another setback for the GNU, but oil markets breathe a little easierThis week was marked by heightened tensions both domestically and internationally. At home, friction intensified between the two largest parties in the Government of National Unity (GNU), the ANC and the DA, following the firing of one of the DA's deputy ministers. Internationally, the US conducted airstrikes on three Iranian nuclear facilities using...
Read the full issue
Upcoming Seminars
Monday 21 July 202512:00-13:00
Izak Odendaal: Old Mutual Wealth Chief Investment Strategist
Topic: "Diverging fiscal policies and what it means for markets"
12:00-13:00
Dr Neil Rankin: Ceo Of Predictive Insights & Stellenbosch University
Topic: "TBC"
12:00-13:00
Prof Willem Boshoff: Stellenbosch University
Topic: "Two competing approaches in South African competition policy: merger control and anti-cartel enforcement over the past 30 years"
BER Weekly
27 Jun 2025 Another setback for the GNU, but oil markets breathe a little easierThis week was marked by heightened tensions both domestically and internationally. At home, friction intensified between the two largest parties in the Government of National Unity (GNU), the ANC and the DA, following the firing of one of the DA's deputy ministers. Internationally, the US conducted airstrikes on three Iranian nuclear facilities using...
Read the full issue