Hostname: page-component-8448b6f56d-c4f8m Total loading time: 0 Render date: 2024-04-17T08:25:58.083Z Has data issue: false hasContentIssue false
  • English
  • Français

The Constraining Power of International Treaties: Theory and Methods

Published online by Cambridge University Press:  31 October 2005

BETH A. SIMMONS  and
DANIEL J. HOPKINS
BETH A. SIMMONS
Affiliation:
Harvard University
DANIEL J. HOPKINS
Affiliation:
Harvard University
Get access Rights & Permissions [Opens in a new window]

Abstract

We acknowledge the contribution of von Stein (2005) in calling attention to the very real problem of selection bias in estimating treaty effects. Nonetheless, we dispute both von Stein's theoretical and empirical conclusions. Theoretically, we contend that treaties can both screen and constrain simultaneously, meaning that findings of screening do nothing to undermine the claim that treaties constrain state behavior as well. Empirically, we question von Stein's estimator on several grounds, including its strong distributional assumptions and its statistical inconsistency. We then illustrate that selection bias does not account for much of the difference between Simmons's (2000) and von Stein's (2005) estimated treaty effects, and instead reframe the problem as one of model dependency. Using a preprocessing matching step to reduce that dependency, we then illustrate treaty effects that are both substantively and statistically significant—and that are quite close in magnitude to those reported by Simmons.

Type
FORUM
Information
American Political Science Review , Volume 99 , Issue 4 , November 2005 , pp. 623 - 631
Copyright
© 2005 by the American Political Science Association

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abadie Alberto. 2002. “Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models.” Journal of the American Statistical Association 97: 284– 92.Google Scholar
Abadie Alberto, and Guido Imbens. 2004. “Large Sample Properties of Matching Estimators for Average Treatment Effects.” http://emlab.berkeley.edu/users/imbens/sme_21 jan 04.pdf (July 12, 2005).Google Scholar
Albert A., and J. A. Anderson. 1984. “On the Existence of Maximum Likelihood Estimates in Logistic Regression Models.” Biometrick 71 (1): 1– 10.Google Scholar
Beck N., J. N. Katz, and R. Tucker. 1998. Taking Time Seriously: Time-Series-Cross-Section Analysis with a Binary Dependent Variable. American Journal of Political Science 42 (4): 1260– 88.Google Scholar
Berinsky Adam J. 1999. “The Two Faces of Public Opinion.” American Journal of Political Science 43 (4): 1209– 30.Google Scholar
Christmann Andreas, and Peter J. Rousseeuw. 2001. “Measuring Overlap in Logistic Regression.” Computational Statistics and Data Analysis 37: 65– 75.Google Scholar
Downs George W., David M. Rocke, and Peter N. Barsoom. 1996. “Is the good new about compliance good news about cooperation?” International Organization 50 (3): 379– 406.Google Scholar
Harding David J. 2003. “Counterfactual Models of Neighborhood Effects: The Effect of Neighborhood Poverty on Dropping Out and Teenage Pregnancy.” American Journal of Sociology 109 (3): 676– 719.Google Scholar
Heckman James J. 1976. “The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator of Such Models.” The Annals of Economic and Social Measurement 5: 475– 92.Google Scholar
Heckman James J. 1979. “Sample Selection Bias as a Specification Error.” Econometrica 47 (1): 153– 61.CrossRefGoogle Scholar
Heckman James J., Hidehiko Ichimura, Jeffrey Smith, and Petra Todd. 1998. “Characterizing Selection Bias Using Experimental Data.” Econometrica 66 (5): 1017– 98.CrossRefGoogle Scholar
Ho Daniel, Kosuke Imai, Gary King, and Elizabeth Stuart. 2004a. “Matching as Nonparametric Preprocessing for Improving Parametric Causal Inference.” http://gking.harvard.edu/files/ abs/matchup-abs.shtml (January 12, 2005).Google Scholar
Ho Daniel, Kosuke Imai, Gary King, and Elizabeth Stuart. 2004b. “MatchIt: Nonparametric Preprocessing for Parametric Causal Inference, Version 1.0-1.” Harvard University, Cambridge, MA. Computer program available at http://gking.harvard.edu/matchit/.
Imai Kosuke. 2005. Do Get-Out-The-Vote Calls Reduce Turnout?: The Importance of Statistical Methods for Field Experiments. American Political Science Review 99 (2): 283– 300.CrossRefGoogle Scholar
Imai Kosuke, Gary King, and Olivia Lau. 2005. “Zelig: Everyone's Statistical Software, Version 2.2-2”. Harvard University, Cambridge, MA. Computer program available at http://gking.harvard.edu/zelig/.
Imbens Guido. 2004. “Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review.” Review of Economics and Statistics 86 (1): 4– 30.Google Scholar
King Gary, James Honaker, Anne Joseph, and Kenneth F. Scheve. 2001. “Analyzing Incomplete Political Science Data: An Alternative Algorithm for Multiple Imputation.” American Political Science Review 95 (1): 49– 69.Google Scholar
King Gary, Michael Tomz, and Jason Wittenberg. 2000. “Making the Most of Statistical Analyses: Improving Interpretation and Presentation.” American Journal of Political Science 44 (2): 41– 55.Google Scholar
Lee Lung-fei. 1984. “Tests for the Bivariate Normal Distribution in Econometric Models with Selectivity.” Econometrica 52 (4): 843– 63.Google Scholar
Lee Lung-fei. 2001. “Self-Selection.” In A Companion to Theoretical Econometrics, ed. B. H. Baltagi. Malden, MA: Blackwell Publishers Inc.
Lemke Douglas, and William Reed. 2001. “War and Rivalry Among Great Powers.” American Journal of Political Science 45 (2): 457– 69.CrossRefGoogle Scholar
Liao Tim Futing. 1995. “The Nonrandom Selection of Don't Knows in Binary and Ordinal Responses: Corrections with the Bivariate Probit Model with Sample Selection.” Quality and Quantity 29: 87– 110.Google Scholar
R Development Core Team. 2004. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, http://www.R_project.org.
Reed William. 2000. “A Unified Statistical Model of Conflict Onset and Escalation.” American Journal of Political Science 44 (1): 84– 93.Google Scholar
Rosenbaum Paul E., and Donald B. Rubin. 1984. “Reducing Bias in Observational Studies Using Subclassification on the Propensity Score.” Journal of the American Statistical Association 79 (387): 516– 24.Google Scholar
Rosenbaum Paul R. 2002. Observational Studies. 2nd ed. New York, NY: Springer Verlag.
Rousseeuw Peter J., and Andreas Christmann. 2004. “The Noverlap Package,” version 1.0–1. Available online at http://cran.r-project.org/doc/packages/noverlap.pdf.Google Scholar
Sartori Anne E. 2003. “An Estimator for Some Binary-Outcome Selection Models Without Exclusion Restrictions.” Political Analysis 11: 111– 38.CrossRefGoogle Scholar
Schafer Joseph. 2003. “The Mix Package: Estimation/Multiple Imputation for Mixed Categorical and Continuous Data.” http://cran.r-project.org/src/contrib/Descriptions/mix.html (January 14, 2005).Google Scholar
Sekhon Jasjeet S. 2004. “The Varying Role of Voter Information across Democratic Societies.” http://jsekhon.fas.harvard.edu/papers/SekhonInformation.pdf (February 24, 2005).Google Scholar
Sekhon Jasjeet S. 2005 “Matching: Multivariate and Propensity Score Matching with Automated Balance Search.” Computer program available at http://jsekhon.fas.harvard.edu/ matching.Google Scholar
Sekhon Jasjeet, and Alexis Diamond. “Genetic Matching for Estimating Causal Effects: A New Method of Achieving Balance in Observational Studies.” Presented at the Summer Meeting of the Society for Political Methodology, Tallahassee, FL.
Signorino Curt. 2003. “Structure and Uncertainty in Discrete Choice Models.” Political Analysis 11 (4): 316– 44.Google Scholar
Simmons Beth A. 2000. “International Law and State Behavior: Commitment and Compliance in International Monetary Affairs. American Political Science Review 94 (4): 819– 35.Google Scholar
Timpone Richard J. 1998. “Structure, Behavior, and Voter Turnout in the United States.” American Political Science Review 92 (1): 145– 58.CrossRefGoogle Scholar
Vreeland James Raymond. 2003. The IMF and Economic Development. New York: Cambridge University Press.
Winship Christopher, and Robert D. Mare. 1992. “Models for Sample Selection Bias.” Annual Review of Sociology 18: 327– 50.Google Scholar
Winship Christopher, and Stephen L. Morgan. 1999. “The Estimation of Causal Effects from Observational Data.” Annual Review of Sociology 25: 659– 707.Google Scholar