Skip to main content
Intended for healthcare professionals
Restricted access
Research article
First published online July 25, 2013

Education, outreach, and inclusive engagement: Towards integrated indicators of successful program outcomes in participatory science

Abstract

The use and utility of science in society is often influenced by the structure, legitimacy, and efficacy of the scientific research process. Public participation in scientific research (PPSR) is a growing field of practice aimed at enhancing both public knowledge and understanding of science (education outreach) and the efficacy and responsiveness of scientific research, practice, and policy (participatory engagement). However, PPSR objectives focused on “education outreach” and “participatory engagement” have each emerged from diverse theoretical traditions that maintain distinct indicators of success used for program development and evaluation. Although areas of intersection and overlap among these two traditions exist in theory and practice, a set of comprehensive standards has yet to coalesce that supports the key principles of both traditions in an assimilated fashion. To fill this void, a comprehensive indicators framework is proposed with the goal of promoting a more integrative and synergistic PPSR program development and assessment process.

Get full access to this article

View all access and purchase options for this article.

References

Abelson J, Pierre-Gerlier F, Eyles J, Smith P, Martin E, Francois-Pierre G (2003) Deliberations about deliberative methods: Issues in the design and evaluation of public participation processes. Social Science & Medicine 57: 239–251.
Bauer M, Allum N, Miller S (2007) What can we learn from 25 years of PUS survey research? Liberating and expanding the agenda. Public Understanding of Science 16: 79–95.
Beierle TC (1999) Using social goals to evaluate public participation in environmental decisions. Policy Studies Review 16(3–4): 75–103.
Bell P, Lewenstein BV, Shouse AW, Feder MA (eds) (2009) Learning Science in Informal Environments: People, Places, and Pursuits. Washington, DC: National Research Council of the National Academies.
Besley JC (2010) Public engagement and the impact of fairness perceptions on decision favorability and acceptance. Science Communication 32(2): 256–280.
Besley JC, McComas KA (2005) Framing justice: Using the concept of procedural justice to advance political communication research. Communication Theory 15: 414–436.
Biegelbauer P, Hansen J (2011) Democratic theory and citizen participation: Democracy models in the evaluation of public participation in science and technology. Science and Public Policy 38(8): 589–597.
Blackstock K, Kelly G, Horsey BL (2007) Developing and applying a framework to evaluate participatory research for sustainability. Ecological Economics 60: 726–742.
Bonney R (2004) Understanding the process of research. In: Chittenden D, Farmelo G, Lewenstein B (eds) Creating Connections: Museums and Public Understanding of Current Research. Walnut Creek, CA: Altamira Press, pp. 199–210.
Bonney R (2007) Citizen science at the Cornell Lab of Ornithology. In: Yager RE, Falk JH (eds) Exemplary Science in Informal Education Settings: Standards-based Success Stories. Arlington, VA: NSTA Press, pp. 213–230.
Bonney R, Dhondt A (1997) FeederWatch: An example of a student–scientist partnership. In: Cohen KC (ed.) Internet Links for Science Education: Student–Scientist Partnerships. New York, NY: Plenum Press, pp. 31–53.
Bonney R, Ballard H, Jordan R, McCallie E, Phillips T, Shirk J, Wilderman CC (2009a) Public Participation in Scientific Research: Defining the Field and Assessing its Potential for Informal Science Education. A CAISE Inquiry Group Report. Washington, DC: Center for Advancement of Informal Science Education (CAISE).
Bonney R, Cooper C, Dickinson J, Kelling S, Phillips T (2009b) Citizen science: A developing tool for expanding science knowledge and scientific literacy. BioScience 59(11): 977–984.
Braschler B, Mahood K, Karenyi N, Gaston K, Chown S (2010) Realizing a synergy between research and education: How participation in ant monitoring helps raise biodiversity awareness in a resource-poor country. Journal of Insect Conservation 14: 19–30.
Brewer C (2002) Outreach and partnership programs for conservation education where endangered species conservation and research occur. Conservation Biology 16(1): 4–6.
Campbell L, Vainio-Mattila A (2003) Participatory development and community-based conservation: Opportunities missed for lessons learned? Human Ecology 31(3): 417–437.
Conrad C, Hilchey K (2011) A review of citizen science and community-based environmental monitoring: Issues and opportunities. Environmental Monitoring & Assessment 176: 273–291.
Couvet D, Jiguet F, Julliard R, Levrel H, Teyssedre A (2008) Enhancing citizen contributions to biodiversity science and public policy. Interdisciplinary Science Reviews 33(1): 95–103.
Danielsen F, Burgess N, Balmford A (2005) Monitoring matters: Examining the potential of locally-based approaches. Biodiversity and Conservation 14(11): 2507–2542.
Davies S (2008) Constructing communication: Talking to scientists about talking to the public. Science Communication 29(4): 413–434.
Delli Carpini M, Lomax Cook F, Jacobs L (2004) Public deliberation, discursive participation, and citizen engagement: A review of the empirical literature. Annual Review of Political Science 7: 315–344.
Devictor V, Whittaker R, Beltrame C (2010) Beyond scarcity: Citizen science programmes as useful tools for conservation biogeography. Diversity and Distributions 16: 354–362.
Dickinson J, Zuckerberg B, Bonter D (2010) Citizen science as an ecological research tool: Challenges and benefits. Annual Review of Ecology, Evolution, and Systematics 41: 149–172.
Dunlap R, Van Liere K (2008) The “new environmental paradigm”. Journal of Environmental Education 40(1): 19–28.
Evans C, Abrams E, Reitsma R, Roux K, Salmonsen L, Marra P (2005) The Neighborhood Nestwatch program: Participant outcomes of a citizen-science ecological research project. Conservation Biology 19(3): 589–594.
Fernandez-Gimenez M, Ballard H, Sturtevant V (2008) Adaptive management and social learning in collaborative and community-based monitoring: A study of five community-based forestry organizations in the western USA. Ecology and Society 13(2).
Friedman A (ed.) (2008) Framework for Evaluating Impacts of Informal Science Education Projects. Report from a National Science Foundation Workshop. The National Science Foundation, Division of Research on Learning in Formal and Informal Settings (DRL).
Gerhards J, Schafer M (2009) Two normative models of science in the public sphere: Human genome sequencing in German and US mass media. Public Understanding of Science 18: 437–451.
Gibbons M (1999) Science’s new social contract with society. Nature 402: C81–C84.
Greenwood J (2007) Citizens, science and bird conservation. Journal of Ornithology 148: S77–S124.
Henry A, Dietz T (2012) Understanding environmental cognition. Organization and Environment 25(3): 238–258.
Horlick-Jones T, Rowe G, Walls J (2007) Citizen engagement processes as information systems: The role of knowledge and the concept of translation quality. Public Understanding of Science 16: 259–278.
Irwin A, Wynne B (1996) Misunderstanding Science? The Public Reconstruction of Science and Technology. Cambridge, UK: Cambridge University Press.
Kountoupes D, Oberhauser K (2008) Citizen science and youth audiences: Educational outcomes of the Monarch Larva Monitoring Project. Journal of Community Engagement and Scholarship 1(1): 10–20.
Krasny M, Bonney R (2005) Environmental education through citizen science and participatory action research. In: Johnson EA, Mappin MJ (eds) Environmental Education and Advocacy. Cambridge, UK: Cambridge University Press, pp. 292–319.
Kurian P, Wright J (2012) Science, governance, and public participation: An analysis of decision-making on genetic modification in Aotearoa/New Zealand. Public Understanding of Science 21(4): 447–464.
Lawrence A (2006) “No personal motive?” Volunteers, biodiversity and the false dichotomies of participation. Ethics, Place and Environment 9(3): 279–298.
Lee T, Quinn M, Duke D (2006) Citizen, science, highways, and wildlife: Using a web-based GIS to engage citizens in collecting wildlife information. Ecology and Society 11(1): 11.
Lewenstein B (1992) The meaning of “public understanding of science” in the United States after World War II. Public Understanding of Science 1: 45–68.
Lewenstein B, Bonney R (2004) Different ways of looking at public understanding of research. In: Chittenden D, Farmelo G, Lewenstein B (eds) Creating Connections: Museums and Public Understanding of Current Research. Walnut Creek, CA: Altamira Press, pp. 63–71.
Luhmann N (1988) Familiarity, confidence, trust: Problems and alternatives. In: Gambetta D (ed.) Trust: Making and Breaking Cooperative Relations. Oxford, UK: Basil Blackwell, pp. 94–107.
McCallie E, Bell L, Lohwater T, Falk JH, Lehr JL, Lewenstein BV, Needham C, Wiehe B (2009) Many Experts, Many Audiences: Public Engagement with Science and Informal Science Education. A CAISE Inquiry Group Report. Washington, DC: Center for Advancement of Informal Science Education (CAISE).
Mejlgaard N, Stares S (2010) Participation and competence as joint components in a cross-national analysis of scientific citizenship. Public Understanding of Science 19(5): 545–561.
National Research Council (NRC), Committee on Learning Science in Informal Environments, Bell P, Lewenstein B, Shouse A, Feder M (eds) (2009) Learning Science in Informal Environments: People, Places, and Pursuits. Board of Science Education, Center for Education. Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academies Press.
National Science Board (NSB) (2012) Science and Engineering Indicators 2012. National Science Foundation, Division of Science Resources Statistics. Arlington, VA. Available at: http://www.nsf.gov/statistics/seind12/
Overdevest C, Orr C, Stepenuck K (2004) Volunteer stream monitoring and local participation in natural resource issues. Human Ecology Review 11(2): 177–185.
Pateman C (1970) Participation and Democratic Theory. New York, NY: Cambridge University Press.
Patton M (1997) Toward distinguishing empowerment evaluation and placing it in a larger context. Evaluation Practice 18: 147–163.
Powell M, Colin M (2008) Meaningful citizen engagement in science and technology: What would it really take? Science Communication 30(1): 126–136.
Powell M, Kleinman DL (2008) Building citizen capacities for participation in technoscientific decision making: The democratic virtues of the consensus conference model. Public Understanding of Science 17: 329–348.
Raddick J, Bracey G, Carney K, Gyuk G, Borne K, Wallin J, Jacoby S (2009) Citizen science: Status and research directions for the coming decade. Astro2010: The Astronomy and Astrophysics Decadal Survey, Position Papers, no. 46. NASA Astrophysics Data System.
Renn O, Webler T, Wiedemann P (1995) Fairness and Competence in Citizen Participation: Evaluating Models for Environmental Discourse. Dordrecht, The Netherlands: Kluwer Academic Publishers.
Roth W, Lee S (2002) Scientific literacy as collective praxis. Public Understanding of Science 11: 33–56.
Rowe G, Frewer LJ (2000) Public participation methods: A framework for evaluation. Science, Technology, & Human Values 25(1): 3–29.
Rowe G, Frewer LJ (2004) Evaluating public participation exercises: A research agenda. Science, Technology, & Human Values 29(4): 512–556.
Schmeller D, Henry P, Julliard R, Gruber B, Clobert J, Dziock F, et al. (2009) Advantages of volunteer-based biodiversity monitoring in Europe. Conservation Biology 23(2): 307–316.
Shirk JL, Ballard HL, Wilderman CC, Phillips T, Wiggins A, Jordan R, et al. (2012) Public participation in scientific research: A framework for deliberate design. Ecology and Society 17(2): 29.
Siegrist M, Gutscher H, Earle T (2005) Perception of risk: The influence of general trust, and general confidence. Journal of Risk Research 8(2): 145–156.
Silvertown J (2009) A new dawn for citizen science. Trends in Ecology and Evolution 24(9): 467–470.
Sturgis P, Allum N (2004) Science in society: Re-evaluating the deficit model of public attitudes. Public Understanding of Science 13: 55–74.
Sullivan B, Wood C, Iliff M, Bonney R, Fink D, Kelling S (2009) eBird: A citizen-based bird observation network in the biological sciences. Biological Conservation 142: 2282–2292.
Talwar S, Wiek A, Robinson J (2011) User engagement in sustainability research. Science and Public Policy 38(5): 379–390.
Tlili A, Dawson E (2010) Mediating science and society in the EU and UK: From information transmission to deliberative democracy? Minerva 48: 429–461.
Trumbull D, Bonney R, Bascom D, Cabral A (2000) Thinking scientifically during participation in a citizen-science project. Science Education 84: 265–275.
Trumbull D, Bonney R, Grudens-Schuck N (2005) Developing materials to promote inquiry: Lessons learned. Science Education 89: 879–900.
Webler T (1995) “Right” discourse in citizen participation: An evaluative yardstick. In: Renn OM, Webler T, Wiedemann P (eds) Fairness and Competence in Citizen Participation: Evaluating Models for Environmental Discourse. Dordrecht, The Netherlands: Kluwer Academic Publishers, pp. 35–86.
Wilderman C, Barron A, Imgrund L (2004) Top down or bottom up? ALLARM’s experience with two operational models for community science. Proceedings of the 4th National Monitoring Conference. Chattanooga: National Water Quality Monitoring Council.
Wintle B, Runge M, Bekessey S (2010) Allocating monitoring effort in the face of unknown unknowns. Ecology Letters 13: 1325–1337.

Biographies

Benjamin K. Haywood is a PhD candidate in the Department of Geography at the University of South Carolina. His dissertation research focuses on nature–society interactions, sense of place, and citizen science.
John C. Besley, PhD, is an Associate Professor and the Ellis N. Brandt Chair in the Department of Advertising and Public Relations at Michigan State University. His work focuses on the intersection of science communication, public engagement and media.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.