• Jobs of the World
  • Mentoring Programme
  • Login for Grantees
  • Code of Conduct
  • About
    • History
    • Investigators
    • Team
  • Projects
    • GLM|LIC
      • Agricultural Labour Markets
      • Gender and Employment
      • Labour Markets in Low-Income Countries
      • Migration
      • Skill Training
    • G²LM|LIC
      • Fact & Policy
      • Fertility & Labour markets
      • Barriers to gender parity
      • The Future of Work
      • Policies & Welfare
    • COVID-19
  • Publications
    • Policy Briefs
    • Synthesis Papers
    • Working Papers
    • Published Articles
    • Book
    • Datasets
  • Events
  • For Policy Makers
Search
  • Skip to main content
  • Skip to primary sidebar
Published Article

Measuring the Measurement Error

A Method to Qualitatively Validate Survey Data

Empirical social science relies heavily on self-reported data, but subjects may misreport behaviors, especially sensitive ones such as crime or drug abuse. If a treatment influences survey misreporting, it biases causal estimates. We develop a validation technique that uses intensive qualitative work to assess survey misreporting and pilot it in a field experiment where subjects were assigned to receive cash, therapy, both, or neither. According to survey responses, both treatments reduced crime and other sensitive behaviors. Local researchers spent several days with a random subsample of subjects after surveys, building trust and obtaining verbal confirmation of four sensitive behaviors and two expenditures. In this instance, validation showed survey underreporting of most sensitive behaviors was low and uncorrelated with treatment, while expenditures were under reported in the survey across all arms, but especially in the control group. We use these data to develop measurement error bounds on treatment effects estimated from surveys.

Title Measuring the Measurement Error
Author
  • Christopher Blattman
  • Julian Jamison
  • Margaret Sheridan
  • Tricia Koroknay-Palicz,Katherine Rodrigues
Published in Journal of Development Economics, 120, 99-112
Publication Date 01/05/2016
Project High-Risk Youth in Post-Conflict Liberia
See Published Article

sidebar

Subscribe to our mailing list
Contact us
Follow us on Bluesky
Follow us on X

Established in 1998 in Bonn, Germany, IZA is an independent, non-profit research institution supported by the Deutsche Post Foundation with a focus on the analysis of global labour markets. It operates an international network of about 1,500 economists and researchers spanning across more than 50 countries.

Based on academic excellence and an ambitious publication strategy, IZA serves as a place of communication between academic science and political practice.

The Foreign, Commonwealth & Development Office (FCDO) leads the UK's work to end extreme poverty. We're ending the need for aid by creating jobs, unlocking the potential of girls and women, and helping to save lives when humanitarian emergencies hit.

FCDO is a ministerial department, supported by 12 agencies and public bodies.

© 2012–2025 | IZA – Institute of Labor Economics | Code of Conduct | Imprint