Large-N comparative studies have helped common pool resource scholars gain general insights into the factors that influence collective action and governance outcomes. However, these studies are often limited by missing data, and suffer from the methodological limitation that important information is lost when we reduce textual information to quantitative data. This study was motivated by nine case studies that appeared to be inconsistent with the expectation that the presence of Ostrom’s Design Principles increases the likelihood of successful common pool resource governance. These cases highlight the limitations of coding and analyzing Large-N case studies.

We examine two issues: 1) the challenge of missing data and 2) potential approaches that rely on context (which is often lost in the coding process) to address inconsistencies between empirical observations theoretical predictions. For the latter, we conduct a post-hoc qualitative analysis of a large-N comparative study to explore 2 types of inconsistencies: 1) cases where evidence for nearly all design principles was found, but available evidence led to the assessment that the CPR system was unsuccessful and 2) cases where the CPR system was deemed successful despite finding limited or no evidence for design principles. We describe inherent challenges to large-N comparative analysis to coding complex and dynamically changing common pool resource systems for the presence or absence of design principles and the determination of “success”. Finally, we illustrate how, in some cases, our qualitative analysis revealed that the identity of absent design principles explained inconsistencies hence de-facto reconciling such apparent inconsistencies with theoretical predictions. This analysis demonstrates the value of combining quantitative and qualitative analysis, and using mixed-methods approaches iteratively to build comprehensive methodological and theoretical approaches to understanding common pool resource governance in a dynamically changing context.

On-going efforts to understand the dynamics of coupled social-ecological (or more broadly, coupled infrastructure) systems and common pool resources have led to the generation of numerous datasets based on a large number of case studies. This data has facilitated the identification of important factors and fundamental principles which increase our understanding of such complex systems. However, the data at our disposal are often not easily comparable, have limited scope and scale, and are based on disparate underlying frameworks inhibiting synthesis, meta-analysis, and the validation of findings. Research efforts are further hampered when case inclusion criteria, variable definitions, coding schema, and inter-coder reliability testing are not made explicit in the presentation of research and shared among the research community. This paper first outlines challenges experienced by researchers engaged in a large-scale coding project; then highlights valuable lessons learned; and finally discusses opportunities for further research on comparative case study analysis focusing on social-ecological systems and common pool resources. Includes supplemental materials and appendices published in the International Journal of the Commons 2016 Special Issue. Volume 10 - Issue 2 - 2016.

The Montreal Protocol is generally credited as a successful example of international cooperation in response to a global environmental problem. As a result, the production and consumption of ozone-depleting substances has declined rapidly, and it is expected that atmospheric ozone concentrations will return to their normal ranges toward the end of this century. This paper applies the social-ecological system framework and common-pool resource theory to explore the congruence between successful resolution of small-scale appropriation problems and ozone regulation, a large-scale pollution problem. The results of our analysis correspond closely to past studies of the Protocol that highlight the importance of attributes such as a limited number of major industrial producers, advances in scientific knowledge, and the availability of technological substitutes. However, in contrast to previous theoretical accounts that focus on one or a few variables, our analysis suggests that its success may have been the result of interactions between a wider range of SES attributes, many of which are associated with successful small-scale environmental governance. Although carefully noting the limitations of drawing conclusions from the analysis of a single case, our analysis reveals the potential for fruitful interplay between common-pool resource theory and large-scale pollution problems.

In this paper we use a case study of the Rhine River to examine the relevance of Common Pool Resource (CPR) Theory for two conditions in which it has not been extensively tested: large scale international water management and pollution problems. For that purpose, we link variation in pollution abatement to a set of explanatory variables proposed by CPR theory. Causal inference is established through process tracing and a series of within-case comparison across actor groups (i.e. riparian nations, industry, and agriculture), resource types (i.e. point source, and non-point source pollutants), and time periods (1976–1986, when treaties provided a limited basis for collective action and pollution abatement, and 1987–2001, when the Rhine Action Plan proved more successful). According to our analysis, a number of CPR variables can help understanding cooperation for pollution abatement in the Rhine case. These include physical attributes such as clear hydrological boundaries; governance factors such as the articulation of monitoring and decision-making at different governance levels and the proportional allocation of costs and benefits of abating pollution; and actor factors like the small size, trust and homogeneity of some actor groups and leadership. Other variables proposed by CPR theory proved to be irrelevant or in need of qualification. These include the right to self-organize and to participate in decision-making, communication and resource-dependence. Finally, two variables, not emphasized by CPR theory, proved relevant: the occurrence of external disturbances and the role of interest groups. We conclude that CPR theory is valuable for explaining pollution management in large trans-boundary river basins, but requires qualification and extension.