Record linkage in the Cape of Good Hope Panel

Stellenbosch Working Paper Series No. WP06/2018
 
Publication date: May 2018
 
Author(s):
[protected email address] (Department of History, Utrecht University)
[protected email address] (Department of Economic History, Lund University)
[protected email address] (Department of Economics, Stellenbosch University)
 
Abstract:

In this paper we describe the record linkage procedure to create a panel from Cape Colony census returns, or opgaafrolle, for 1787--1828, a dataset of 42,354 household-level observations. Based on a subset of manually linked records, we first evaluate statistical models and deterministic algorithms to best identify and match households over time. By using household-level characteristics in the linking process and near-annual data, we are able to create high-quality links for 84 percent of the dataset. We compare basic analyses on the linked panel dataset to the original cross-sectional data, evaluate the feasibility of the strategy when linking to supplementary sources, and discuss the scalability of our approach to the full Cape panel.

 
JEL Classification:

N01, C81

Keywords:

census, machine learning, micro-data, record linkage, panel data, South Africa

Download: PDF (1.1 MB)

Login

(for staff & registered students)



Need a password?
Forgot your password?

BER Weekly

27 Jun 2025 Another setback for the GNU, but oil markets breathe a little easier
This week was marked by heightened tensions both domestically and internationally. At home, friction intensified between the two largest parties in the Government of National Unity (GNU), the ANC and the DA, following the firing of one of the DA's deputy ministers. Internationally, the US conducted airstrikes on three Iranian nuclear facilities using...

Read the full issue
 

BER Weekly

27 Jun 2025 Another setback for the GNU, but oil markets breathe a little easier
This week was marked by heightened tensions both domestically and internationally. At home, friction intensified between the two largest parties in the Government of National Unity (GNU), the ANC and the DA, following the firing of one of the DA's deputy ministers. Internationally, the US conducted airstrikes on three Iranian nuclear facilities using...

Read the full issue