Record linkage in the Cape of Good Hope Panel
Stellenbosch Working Paper Series No. WP06/2018Publication date: May 2018
Author(s):
[protected email address] (Department of Economic History, Lund University)
[protected email address] (Department of Economics, Stellenbosch University)
In this paper we describe the record linkage procedure to create a panel from Cape Colony census returns, or opgaafrolle, for 1787--1828, a dataset of 42,354 household-level observations. Based on a subset of manually linked records, we first evaluate statistical models and deterministic algorithms to best identify and match households over time. By using household-level characteristics in the linking process and near-annual data, we are able to create high-quality links for 84 percent of the dataset. We compare basic analyses on the linked panel dataset to the original cross-sectional data, evaluate the feasibility of the strategy when linking to supplementary sources, and discuss the scalability of our approach to the full Cape panel.
JEL Classification:N01, C81
Keywords:census, machine learning, micro-data, record linkage, panel data, South Africa
Download: PDF (1.1 MB)Login
(for staff & registered students)
Upcoming Seminars
Monday 28 July 202512:00-13:00
Dr Neil Rankin: Ceo Of Predictive Insights & Stellenbosch University
Topic: "TBC"
12:00-13:00
Prof Willem Boshoff: Stellenbosch University
Topic: "Two competing approaches in South African competition policy: merger control and anti-cartel enforcement over the past 30 years"
12:00-13:00
Professor Johan Fourie: Stellenbosch University
Topic: "Economic History: TBC"
BER Weekly
18 Jul 2025 Encouraging data, but messy politics while US tariff deadline loomsThe big global data prints of the week came on Tuesday, with better-than-expected Chinese GDP growth for Q2 and US core CPI coming in lower than expected, but still (finally) reflecting some signs of tariffs being passed on to consumers. Locally, the uptick in mining production and retail sales was positive for Q2 GDP dynamics. In addition to the data,...
Read the full issue
Upcoming Seminars
Monday 28 July 202512:00-13:00
Dr Neil Rankin: Ceo Of Predictive Insights & Stellenbosch University
Topic: "TBC"
12:00-13:00
Prof Willem Boshoff: Stellenbosch University
Topic: "Two competing approaches in South African competition policy: merger control and anti-cartel enforcement over the past 30 years"
12:00-13:00
Professor Johan Fourie: Stellenbosch University
Topic: "Economic History: TBC"
BER Weekly
18 Jul 2025 Encouraging data, but messy politics while US tariff deadline loomsThe big global data prints of the week came on Tuesday, with better-than-expected Chinese GDP growth for Q2 and US core CPI coming in lower than expected, but still (finally) reflecting some signs of tariffs being passed on to consumers. Locally, the uptick in mining production and retail sales was positive for Q2 GDP dynamics. In addition to the data,...
Read the full issue