Hostname: page-component-76fb5796d-vfjqv Total loading time: 0 Render date: 2024-04-26T09:15:18.625Z Has data issue: false hasContentIssue false
  • English
  • Français

Correction to Gerber and Green (2000), Replication of Disputed Findings, and Reply to Imai (2005)

Published online by Cambridge University Press:  08 June 2005

ALAN S. GERBER  and
DONALD P. GREEN
ALAN S. GERBER
Affiliation:
Yale University
DONALD P. GREEN
Affiliation:
Yale University
Get access Rights & Permissions [Opens in a new window]

Abstract

This essay corrects the results reported in Gerber and Green 2000 and replies to Imai (2005). When data-processing errors are repaired, the original substantive findings from the New Haven experiment remain unchanged. As previously reported, brief phone calls do not increase voter turnout. The “correction” that Imai (2005) offers, which purports to show that these phone calls produce large, significant, and robust increases in voter turnout, is shown to contain statistical, computational, and reporting errors that invalidate its conclusions about the effectiveness and cost-effectiveness of phone calls and mail. A replication of the New Haven experiment reproduces both the findings reported in Gerber and Green 2000 and the biases of Imai's statistical analysis.

Type
FORUM
Information
American Political Science Review , Volume 99 , Issue 2 , May 2005 , pp. 301 - 313
Copyright
© 2005 by the American Political Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Angrist Joshua D., Imbens Guido W., and Donald B. Rubin. 1996. “Identification of Casual Effects Using Instrumental Variables.” Journal of the American Statistical Association 91 (June): 444– 55.Google Scholar
Angrist Joshua D., and Alan B. Krueger. 1999. “Empirical Strategies in Labor Economics.” In Handbook of Labor Economics, ed. Orley C. Ashenfelter and David Card. New York: Elsevier, 1277– 1366.
Ansolabehere Stephen, and Shanto Iyengar. 1995. Going Negative: How Political Advertisements Shrink and Polarize the Electorate. New York: Free Press.
Arceneaux Kevin T., Alan S. Gerber, and Donald P. Green. 2004. “Monte Carlo Simulation of the Biases in Misspecified Randomization Checks.” Manuscript. Institution for Social and Policy Studies, Yale University.
Bloom Howard S., Charles Michalopoulos, Carolyn J. Hill, and Ying Lei. 2002. “Can Nonexperimental Comparison Group Methods Match the Findings from a Random Assignment Evaluation of Mandatory Welfare-to-Work Programs?” Working paper. Manpower Demonstration Research Corporation.
Bound John, David A. Jaeger, and Regina M. Baker. 1995. “Problems with Instrumental Variables Estimation When the Correlation between the Instruments and the Endogenous Explanatory Variable Is Weak.” Journal of the American Statistical Association 90: 443– 50.Google Scholar
Bowers Jake, and Ben Hansen. 2005. “Attributing Effects to a Get-Out-The-Vote Campaign Using Full Matching and Randomization Inference.” Paper presented at the Annual Meeting of the Midwest Political Science Association, Chicago, Illinois, April 7– 10.
Cardy Emily Arthur. 2005. “An Experimental Field Study of the GOTV and Persuasion Effects of Partisan Direct Mail and Phone Calls.” Annals of American Academy of Political and Social Science. Forthcoming.
Dehejia Rajeev H., and Sadek Wahba. 1999. “Causal Effects in Nonexperimental Studies: Reevaluating the Evaluation of Training Programs.” Journal of the American Statistical Association 94 (448): 1053– 62.Google Scholar
Diamond Alexis, and Jasjeet S. Sekhon. 2005. “Genetic Matching for Estimating Causal Effects: A New Method of Achieving Balance in Observational Studies.” Paper presented at the Annual Meeting of the Midwest Political Science Association, Chicago, Illinois, April 7– 10.
Gerber Alan S., and Donald P. Green. 2000. “The Effects of Personal Canvassing, Telephone Calls, and Direct Mail on Voter Turnout: A Field Experiment.” American Political Science Review 94 (3): 653– 64.Google Scholar
Gerber Alan S., and Donald P. Green. 2001. “Do Phone Calls Increase Voter Turnout? A Field Experiment.” Public Opinion Quarterly 65: 75– 85.Google Scholar
Gerber Alan S., and Donald P. Green. 2004a. “Note on the Conditions Under Which It Is Optimal to Discard Observations Assigned to Multiple Treatments in an Experiment Using a Factorial Design.” Manuscript. Institution for Social and Policy Studies, Yale University.
Gerber Alan S., and Donald P. Green. 2004b. “Monte Carlo Simulation of Small Sample Bias for Varying Contact Rates.” Manuscript. Institution for Social and Policy Studies, Yale University.
Glazerman Steven, Dan M. Levy, and David Myers. 2003. Nonexperimental Versus Experimental Estimates of Earnings Impacts. The Annals of the American Academy of Political and Social Science. 589 (1): 63– 93.Google Scholar
Green Donald P., and Alan S. Gerber. 2001. “Getting Out the Youth Vote: Results from Randomized Field Experiments.” Unpublished report prepared for Pew Charitable Trusts, Yale University.
Green Donald P., and Alan S. Gerber. 2002. “Reclaiming the Experimental Tradition in Political Science.” In Political Science: State of the Discipline. Vol. 3, ed. I. Katznelson and H. V. Milner. New York: W. W. Norton.
Heckman James, Hidehiko Ichimura, Jeffrey Smith, and Petra Todd. 1998. “Matching as an Econometric Evaluation Estimator.” Review of Economic Studies 65 (2): 261– 94.Google Scholar
Heckman James J., Robert J. Lalonde, and Jeffrey A. Smith. 1999. “The Economics and Econometrics of Active Labor Market Programs.” In Handbook of Labor Economics, ed. Orley C. Ashenfelter and David Card. New York: Elsevier, 1865– 2097.
Imai Kosuke. 2002. “The Importance of Statistical Methodology for Analyzing Data from Field Experimentation: Evaluating Voter Mobilization Strategies.” Manuscript.
Imai Kosuke. 2003. “Essays on Political Methodology.” Ph.D. dissertation, Department of Government, Harvard University.Google Scholar
Imai Kosuke. 2005. “Do Get-Out-the-Vote Calls Reduce Turnout? The Importance of Statistical Methods for Field Experiments.” American Political Science Review, 99 (2): 283– 300.Google Scholar
Lee Young Jack, Jonas H. Ellenberg, Deborah G. Hirtz, and Karin B. Nelson. 1991. “Analysis of Clinical Trials by Treatment Actually Received: Is It Really An Option?” Statistics in Medicine. 10 (10): 1595– 605.Google Scholar
Mead R. 1988. The Design of Experiments: Statistical Principles for Practical Application. New York: Cambridge University Press.
McCullagh Peter, and John A. Nelder. 1989. Generalized Linear Models. 2nd Ed. London: Chapman and Hall.
McNulty John E. 2005. “Phone-Based GOTV: What's on the Line? Field Experiments with Varied Partisan Components, 2002–2003.” Annals of American Academy of Political and Social Science. Forthcoming.
Mooney Christopher Z., and Robert D. Duval. 1993. Bootstrapping: A Nonparametric Approach to Statistical Inference. Newbury Park, CA: Sage.
Rosenbaum Paul R., and Donald B. Rubin. 1985. The Bias Due to Incomplete Matching. Biometrics, 41 (1): 103– 16.Google Scholar
Smith Jeffrey, and Petra Todd. 2001. “Reconciling Conflicting Evidence on the Performance of Matching Estimators.” American Economic Review, Papers and Proceedings 91 (2): 112– 18.Google Scholar
Smith Jeffrey, and Petra Todd. 2004. “Does Matching Overcome Lalonde's Critique of Nonexperimental Estimators?” Journal of Econometrics. 125 (1–2): 305– 53.Google Scholar