Register      Login
Wildlife Research Wildlife Research Society
Ecology, management and conservation in natural and modified habitats
RESEARCH ARTICLE

Avian monitoring – comparing structured and unstructured citizen science

Corey T. Callaghan A D , John M. Martin A B , Richard E. Major A C and Richard T. Kingsford A
+ Author Affiliations
- Author Affiliations

A Centre for Ecosystem Science, School of Biological, Earth and Environmental Sciences, UNSW Australia, Sydney, NSW 2052, Australia.

B Royal Botanic Gardens and Domain Trust, Mrs Macquaries Road, Sydney, NSW 2000, Australia.

C Australian Museum Research Institute, Australian Museum, 1 William Street, Sydney, NSW 2010, Australia.

D Corresponding author. Email: c.callaghan@unsw.edu.au

Wildlife Research 45(2) 176-184 https://doi.org/10.1071/WR17141
Submitted: 9 October 2017  Accepted: 10 February 2018   Published: 23 April 2018

Abstract

Context: Citizen science is increasingly used to collect biodiversity data to inform conservation management, but its validity within urban greenspaces remains largely unresolved.

Aims: To assess the validity of eBird data for generating biodiversity estimates within an urban greenspace.

Methods: We compared data from structured avian surveys with eBird data at an urban greenspace in Sydney during 2012–16, using species richness and Shannon diversity indices. We also compared community composition, using non-metric multidimensional scaling (NMDS) and dissimilarities using non-parametric MANOVA.

Key results: Structured surveys had a lower overall species richness (80 versus 116) and Shannon diversity (3.64 versus 3.94) than eBird data, but we found no significant differences when using years as replicates. After standardising the richness and diversity indices by time spent surveying in a given year, structured surveys produced significantly higher biodiversity estimates. Further, when grouped into species occupying different broad habitats, there were no significant differences in waterbird or landbird species richness, or in Shannon diversity between data sources.

Conclusions: The most likely explanation for the larger magnitudes of the biodiversity indices from the eBird data is the increase in effort manifested in the number of observers, time spent surveying and spatial coverage. This resulted in increased detection of uncommon species, which in turn accounted for a significant difference (R2 = 0.21, P = 0.015) in overall community composition measured by the two methods.

Implications: Our results highlight the opportunities provided by eBird data as a useful tool for land managers for monitoring avian communities in urban areas.

Additional keywords: atlas, bird surveys, community composition, eBird, Shannon diversity, species richness, urban ecology, urban greenspace.


References

Anderson, M. J. (2001). A new method for non-parametric analysis of variance. Austral Ecology 26, 32–46.

Barrett, G., Silcocks, A., Barry, S., Cunningham, R., and Poulter, R. (2003). ‘The New Atlas of Australian Birds.’ (Royal Australasian Ornithologists Union: Melbourne.)

Bibby, C. J., Marsden, S., and Jones, M. (1998). ‘Bird Surveys.’ (Expedition Advisory Centre of the Royal Geographical Society: London.)

Biggs, D., Turpie, J., Fabricius, C., and Spenceley, A. (2011). The value of avitourism for conservation and job-creation – an analysis from South Africa. Conservation & Society 9, 80–90.
The value of avitourism for conservation and job-creation – an analysis from South Africa.Crossref | GoogleScholarGoogle Scholar |

Bird, T. J., Bates, A. E., Lefcheck, J. S., Hill, N. A., Thomson, R. J., Edgar, G. J., Stuart-Smith, R. D., Wotherspoon, S., Krkosek, M., Stuart-Smith, J. F., Pecl, G. T., Barrett, N., and Frusher, S. (2014). Statistical solutions for error and bias in global citizen science datasets. Biological Conservation 173, 144–154.
Statistical solutions for error and bias in global citizen science datasets.Crossref | GoogleScholarGoogle Scholar |

Blakers, M., Davies, S. J. J. F., and Reilly, P. N. (1984). ‘The Atlas of Australian Birds.’ (Royal Australasian Ornithologists Union: Melbourne.)

Boakes, E. H., McGowan, P. J. K., Fuller, R. A., Chang-qing, D., Clark, N. E., O’Connor, K., and Mace, G. M. (2010). Distorted views of biodiversity: spatial and temporal bias in species occurrence data. PLoS Biology 8, e1000385.
Distorted views of biodiversity: spatial and temporal bias in species occurrence data.Crossref | GoogleScholarGoogle Scholar |

Bonney, R., Cooper, C. B., Dickinson, J., Kelling, S., Phillips, T., Rosenberg, K. V., and Shirk, J. (2009). Citizen science: a developing tool for expanding science knowledge and scientific literacy. Bioscience 59, 977–984.
Citizen science: a developing tool for expanding science knowledge and scientific literacy.Crossref | GoogleScholarGoogle Scholar |

Bonter, D. N., and Cooper, C. B. (2012). Data validation in citizen science: a case study from project feeder watch. Frontiers in Ecology and the Environment 10, 305–307.
Data validation in citizen science: a case study from project feeder watch.Crossref | GoogleScholarGoogle Scholar |

Bray, J. R., and Curtis, J. T. (1957). An ordination of the upland forest communities of southern Wisconsin. Ecological Monographs 27, 325–349.
An ordination of the upland forest communities of southern Wisconsin.Crossref | GoogleScholarGoogle Scholar |

Callaghan, C. T., and Gawlik, D. E. (2015). Efficacy of eBird data as an aid in conservation planning and monitoring. Journal of Field Ornithology 86, 298–304.
Efficacy of eBird data as an aid in conservation planning and monitoring.Crossref | GoogleScholarGoogle Scholar |

Callaghan, C. T., Lyons, M. B., Martin, J. M., Major, R. E., and Kingsford, R. T. (2017). Assessing the reliability of avian biodiversity measures of urban greenspaces using eBird citizen science data. Avian Conservation and Ecology 12, .
Assessing the reliability of avian biodiversity measures of urban greenspaces using eBird citizen science data.Crossref | GoogleScholarGoogle Scholar |

Centennial Parklands (2015). Centennial Parklands Annual Report 2014–2015. Available at https://www.centennialparklands.com.au/__data/assets/pdf_file/0018/102816/Centennial_Parklands_Annual_Report_ 2014-2015_Final.PDF [Verified 27/03/2018]

Cohn, J. P. (2008). Citizen science: can volunteers do real research? Bioscience 58, 192–197.
Citizen science: can volunteers do real research?Crossref | GoogleScholarGoogle Scholar |

Cooper, C. B., Dickinson, J., Phillips, T., and Bonney, R. (2007). Citizen science as a tool for conservation in residential ecosystems. Ecology and Society 12, .
Citizen science as a tool for conservation in residential ecosystems.Crossref | GoogleScholarGoogle Scholar |

Cottman-Fields, M., Brereton, M., and Roe, P. (2013). Virtual birding: extending an environmental pastime into the virtual world for citizen science. In ‘Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Association for Computing Machinery, New York, NY, USA, pp. 187–194.

Courter, J. R., Johnson, R. J., Stuyck, C. M., Lang, B. A., and Kaiser, E. W. (2013). Weekend bias in citizen science data reporting: implications for phenology studies. International Journal of Biometeorology 57, 715–720.
Weekend bias in citizen science data reporting: implications for phenology studies.Crossref | GoogleScholarGoogle Scholar |

Crall, A. W., Newman, G. J., Stohlgren, T. J., Holfelder, K. A., Graham, J., and Waller, D. M. (2011). Assessing citizen science data quality: an invasive species case study. Conservation Letters 4, 433–442.
Assessing citizen science data quality: an invasive species case study.Crossref | GoogleScholarGoogle Scholar |

Davies, T. K., Stevens, G., Meekan, M. G., Struve, J., and Rowcliffe, J. M. (2012). Can citizen science monitor whale-shark aggregations? Investigating bias in mark–recapture modelling using identification photographs sourced from the public. Wildlife Research 39, 696–704.
Can citizen science monitor whale-shark aggregations? Investigating bias in mark–recapture modelling using identification photographs sourced from the public.Crossref | GoogleScholarGoogle Scholar |

Dickinson, J. L., Zuckerberg, B., and Bonter, D. (2010). Citizen Science as an ecological research tool: challenges and benefits. Annual Review of Ecology Evolution and Systematics 41, 149–172.
Citizen Science as an ecological research tool: challenges and benefits.Crossref | GoogleScholarGoogle Scholar |

Domroese, M. C., and Johnson, E. A. (2017). Why watch bees? Motivations of citizen science volunteers in the Great Pollinator Project. Biological Conservation 208, 40–47.
Why watch bees? Motivations of citizen science volunteers in the Great Pollinator Project.Crossref | GoogleScholarGoogle Scholar |

Ellwood, E. R., Crimmins, T. M., and Miller-Rushing, A. J. (2017). Citizen science and conservation: recommendations for a rapidly moving field. Biological Conservation 208, 1–4.
Citizen science and conservation: recommendations for a rapidly moving field.Crossref | GoogleScholarGoogle Scholar |

Evans, C., Abrams, E., Reitsma, R., Roux, K., Salmonsen, L., and Marra, P. P. (2005). The Neighborhood Nestwatch program: participant outcomes of a citizen-science ecological research project. Conservation Biology 19, 589–594.
The Neighborhood Nestwatch program: participant outcomes of a citizen-science ecological research project.Crossref | GoogleScholarGoogle Scholar |

Fink, D., Hochachka, W. M., Zuckerberg, B., Winkler, D. W., Shaby, B., Munson, M. A., Hooker, G., Riedewald, M., Sheldon, D., and Kelling, S. (2010). Spatiotemporal exploratory models for broad-scale survey data. Ecological Applications 20, 2131–2147.
Spatiotemporal exploratory models for broad-scale survey data.Crossref | GoogleScholarGoogle Scholar |

Goldsmith, F. B. (1991). ‘Monitoring for Conservation and Ecology.’ (Chapman and Hall: London.)

Gollan, J., de Bruyn, L. L., Reid, N., and Wilkie, L. (2012). Can volunteers collect data that are comparable to professional scientists? A study of variables used in monitoring outcomes of ecosystem rehabilitation. Environmental Management 50, 969–978.
Can volunteers collect data that are comparable to professional scientists? A study of variables used in monitoring outcomes of ecosystem rehabilitation.Crossref | GoogleScholarGoogle Scholar |

Hochachka, W. M., and Fink, D. (2012). Broad-scale citizen science data from checklists: prospects and challenges for macroecology. Frontiers of Biogeography 4, 150–154.

Hochachka, W. M., Fink, D., Hutchinson, R. A., Sheldon, D., Wong, W.-K., and Kelling, S. (2012). Data-intensive science applied to broad-scale citizen science. Trends in Ecology & Evolution 27, 130–137.
Data-intensive science applied to broad-scale citizen science.Crossref | GoogleScholarGoogle Scholar |

Hoyer, M. V., Wellendorf, N., Frydenborg, R., Bartlett, D., and Canfield, D. E. (2012). A comparison between professionally (Florida Department of Environmental Protection) and volunteer (Florida LAKEWATCH) collected trophic state chemistry data in Florida. Lake and Reservoir Management Journal 28, 277–281.
| 1:CAS:528:DC%2BC38XhvVGqs7nP&md5=0a58f0b415452a84898a8e5601228d2dCAS |

Hutcheson, K. (1970). A test for comparing diversities based on the Shannon formula. Journal of Theoretical Biology 29, 151–154.
A test for comparing diversities based on the Shannon formula.Crossref | GoogleScholarGoogle Scholar | 1:STN:280:DyaE3M%2FotVKjtQ%3D%3D&md5=12533f0e2feccd44a255a7ca2fe5d2d4CAS |

Isaac, N. J. B., van Strien, A. J., August, T. A., de Zeeuw, M. P., and Roy, D. B. (2014). Statistics for citizen science: extracting signals of change from noisy ecological data. Methods in Ecology and Evolution 5, 1052–1060.
Statistics for citizen science: extracting signals of change from noisy ecological data.Crossref | GoogleScholarGoogle Scholar |

Jackson, M. M., Gergel, S. E., and Martin, K. (2015). Citizen science and field survey observations provide comparable results for mapping Vancouver Island white-tailed Ptarmigan (Lagopus leucura saxatilis) distributions. Biological Conservation 181, 162–172.
Citizen science and field survey observations provide comparable results for mapping Vancouver Island white-tailed Ptarmigan (Lagopus leucura saxatilis) distributions.Crossref | GoogleScholarGoogle Scholar |

Jordan, R., Crall, A., Gray, S., Phillips, T., and Mellor, D. (2015). Citizen science as a distinct field of inquiry. Bioscience 65, 208–211.
Citizen science as a distinct field of inquiry.Crossref | GoogleScholarGoogle Scholar |

Kamp, J., Oppel, S., Heldbjerg, H., Nyegaard, T., and Donald, P. F. (2016). Unstructured citizen science data fail to detect long-term population declines of common birds in Denmark. Diversity & Distributions 22, 1024–1035.
Unstructured citizen science data fail to detect long-term population declines of common birds in Denmark.Crossref | GoogleScholarGoogle Scholar |

Kelling, S., Fink, D., La Sorte, F. A., Johnston, A., Bruns, N. E., and Hochachka, W. M. (2015a). Taking a ‘Big Data’ approach to data quality in a citizen science project. Ambio 44, 601–611.
Taking a ‘Big Data’ approach to data quality in a citizen science project.Crossref | GoogleScholarGoogle Scholar |

Kelling, S., Johnston, A., Hochachka, W. M., Iliff, M., Fink, D., Gerbracht, J., Lagoze, C., La Sorte, F. A., Moore, T., Wiggins, A., Wong, W.-K., Wood, C., and Yu, J. (2015b). Can observation skills of citizen scientists be estimated using species accumulation curves? PLoS One 10, e0139600.
Can observation skills of citizen scientists be estimated using species accumulation curves?Crossref | GoogleScholarGoogle Scholar |

Kobori, H., and Primack, R. B. (2003). Participatory conservation approaches for satoyama, the traditional forest and agricultural landscape of Japan. Ambio 32, 307–311.
Participatory conservation approaches for satoyama, the traditional forest and agricultural landscape of Japan.Crossref | GoogleScholarGoogle Scholar |

Kobori, H., Dickinson, J. L., Washitani, I., Sakurai, R., Amano, T., Komatsu, N., Kitamura, W., Takagawa, S., Koyama, K., Ogawar, T., and Miller-Rushing, A. J. (2016). Citizen science: a new approach to advance ecology, education, and conservation. Ecological Research 31, 1–19.
Citizen science: a new approach to advance ecology, education, and conservation.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC2MXhvFWhsbvP&md5=5a28de49c035baab46e0e71dd7b105ecCAS |

La Sorte, F. A., Fink, D., Hochachka, W. M., DeLong, J. P., and Kelling, S. (2013). Population-level scaling of avian migration speed with body size and migration distance for powered fliers. Ecology 94, 1839–1847.
Population-level scaling of avian migration speed with body size and migration distance for powered fliers.Crossref | GoogleScholarGoogle Scholar |

La Sorte, F. A., Fink, D., Hochachka, W. M., and Kelling, S. (2016). Convergence of broad-scale migration strategies in terrestrial birds. Proceedings. Biological Sciences 283, 20152588.
Convergence of broad-scale migration strategies in terrestrial birds.Crossref | GoogleScholarGoogle Scholar |

Lowe, K., Taylor, C. E., and Major, R. E. (2011). Do common mynas significantly compete with native birds in urban environments? Journal of Ornithology 152, 909–921.
Do common mynas significantly compete with native birds in urban environments?Crossref | GoogleScholarGoogle Scholar |

MacKenzie, C. M., Murray, G., Primack, R., and Weihrauch, D. (2017). Lessons from citizen science: assessing volunteer-collected plant phenology data with Mountain Watch. Biological Conservation 208, 121–126.
Lessons from citizen science: assessing volunteer-collected plant phenology data with Mountain Watch.Crossref | GoogleScholarGoogle Scholar |

Magurran, A. E. (2004). ‘Measuring Biological Diversity.’ 2nd edn. (Blackwell Science Ltd: Oxford.)

Miller, R. A., Paprocki, N., Stuber, M. J., Moulton, C. E., and Carlisle, J. D. (2016). Short-eared Owl (Asio flammeus) surveys in the North American Intermountain West: utilizing citizen scientists to conduct monitoring across a broad geographic scale. Avian Conservation & Ecology 11, .
Short-eared Owl (Asio flammeus) surveys in the North American Intermountain West: utilizing citizen scientists to conduct monitoring across a broad geographic scale.Crossref | GoogleScholarGoogle Scholar |

Miller-Rushing, A., Primack, R., and Bonney, R. (2012). The history of public participation in ecological research. Frontiers in Ecology and the Environment 10, 285–290.
The history of public participation in ecological research.Crossref | GoogleScholarGoogle Scholar |

Morris, E. K., Caruso, T., Buscot, F., Fischer, M., Hancock, C., Maier, T. S., Meiners, T., Müller, C., Obermaier, E., Prati, D., Socher, S. A., Sonnemann, I., Wäschke, N., Wubet, T., Wurst, S., and Rillig, M. C. (2014). Choosing and using diversity indices: insights for ecological applications from the German Biodiversity Exploratories. Ecology and Evolution 4, 3514–3524.
Choosing and using diversity indices: insights for ecological applications from the German Biodiversity Exploratories.Crossref | GoogleScholarGoogle Scholar |

Munson, M. A., Caruana, R., Fink, D., Hochachka, W. M., Iliff, M., Rosenberg, K. V., Sheldon, D., Sullivan, B. L., Wood, C., and Kelling, S. (2010). A method for measuring the relative information content of data from different monitoring protocols. Methods in Ecology and Evolution 1, 263–273.

Nagy, C., Bardwell, K., Rockwell, R. F., Christie, R., and Weckel, M. (2012). Validation of a citizen science-based model of site occupancy for eastern screech owls with systematic data in suburban New York and Connecticut. Northeastern Naturalist 19, 143–158.
Validation of a citizen science-based model of site occupancy for eastern screech owls with systematic data in suburban New York and Connecticut.Crossref | GoogleScholarGoogle Scholar |

National Audubon Society (2012). ‘The Christmas Bird Count Historical Results.’ (National Audubon Society: New York.)

Oksanen, J. F., Blanchet, G., Friendly, M., Kindt, R., Legendre, P., McGlinn, D., Minchin, P. R., O’Hara, R. B., Simpson, G. L., Solymos, P., Henry, M., Stevens, H., Szoecs, E., and Wagner, H. [online]. (2016). Vegan: Community Ecology Package. R package version 2.4–1. Available at https://CRAN.R-project.org/package=vegan [Verified 27/03/2018].

R Core Team (2016). R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna.

Risely, K., Noble, D. G., and Baillie, S. R. (2009). The breeding bird survey 2008. BTO Research Report 537, British Trust for Ornithology, Thetford, UK.

Ruxton, G. D. (2006). The unequal variance t-test is an underused alternative to Student’s t-test and the Mann–Whitney U test. Behavioral Ecology 17, 688–690.
The unequal variance t-test is an underused alternative to Student’s t-test and the Mann–Whitney U test.Crossref | GoogleScholarGoogle Scholar |

Sauer, J. R., Hines, J. E., Fallon, J. E., Pardieck, K. L., Ziolkowski, D. J., Jr, and Link, W. A. (2014). The North American breeding bird survey, results and analysis 1966–2013. Version 01.30.2015, USGS Patuxent Wildlife Research Center, Laurel, MD.

Semple, S. A., and Weins, J. A. (1989). Bird populations and environmental changes: can birds be bio-indicators? American Birds 43, 260–270.

Snäll, T., Kindvall, O., Nilsson, J., and Part, T. (2011). Evaluating citizen-based presence data for bird monitoring. Biological Conservation 144, 804–810.
Evaluating citizen-based presence data for bird monitoring.Crossref | GoogleScholarGoogle Scholar |

Steven, R., Morrison, C., and Castley, J. G. (2015). Birdwatching and avitourism: a global review of research into its participant markets, distribution and impacts, highlighting future research priorities to inform sustainable avitourism management. Journal of Sustainable Tourism 23, 1257–1276.
Birdwatching and avitourism: a global review of research into its participant markets, distribution and impacts, highlighting future research priorities to inform sustainable avitourism management.Crossref | GoogleScholarGoogle Scholar |

Sullivan, B. L., Wood, C. L., Iliff, M. J., Bonney, R. E., Fink, D., and Kelling, S. (2009). eBird: a citizen-based bird observation network in the biological sciences. Biological Conservation 142, 2282–2292.
eBird: a citizen-based bird observation network in the biological sciences.Crossref | GoogleScholarGoogle Scholar |

Sullivan, B. L., Aycrigg, J. L., Barry, J. H., Bonney, R. E., Bruns, N., Cooper, C. B., Damoulas, T., Dhondt, A. A., Dietterich, T., Farnsworth, A., Fink, D., Fitzpatrick, J. W., Frefericks, T., Gerbracht, J., Gomes, C., Hochachka, W. M., Iliff, M. J., Lagoze, C., La Sorte, F. A., Merrefield, M., Morris, W., Phillips, T. B., Reynolds, M., Rodewald, A. D., Rosenberg, K. V., Trautmann, N. M., Wiggins, A., Winkler, D. W., Wong, W. K., Wood, C. L., Yu, J., and Kelling, S. (2014). The eBird enterprise: an integrated approach to development and application of citizen science. Biological Conservation 169, 31–40.
The eBird enterprise: an integrated approach to development and application of citizen science.Crossref | GoogleScholarGoogle Scholar |

Sullivan, B. L., Phillips, T., Dayer, A. A., Wood, C. L., Farnsworth, A., Iliff, M. J., Davies, I. J., Wiggins, A., Fink, D., and Hochachka, W. M. (2017). Using open access observational data for conservation action: a case study for birds. Biological Conservation 208, 5–14.
Using open access observational data for conservation action: a case study for birds.Crossref | GoogleScholarGoogle Scholar |

Szabo, J. K., Fuller, R. A., and Possingham, H. P. (2012). A comparison of estimates of relative abundance from a weakly structured mass-participation bird atlas survey and a robustly designed monitoring scheme. The Ibis 154, 468–479.
A comparison of estimates of relative abundance from a weakly structured mass-participation bird atlas survey and a robustly designed monitoring scheme.Crossref | GoogleScholarGoogle Scholar |

Tulloch, A. I. T., Possingham, H. P., Joseph, L. N., Szabo, J., and Martin, T. G. (2013). Realising the full potential of citizen science monitoring programs. Biological Conservation 165, 128–138.
Realising the full potential of citizen science monitoring programs.Crossref | GoogleScholarGoogle Scholar |

Vianna, G. M. S., Meekan, M. G., Bornovski, T. H., and Meeuwig, J. J. (2014). Acoustic telemetry validates a citizen science approach for monitoring sharks on coral reefs. PLoS One 9, e95565.
Acoustic telemetry validates a citizen science approach for monitoring sharks on coral reefs.Crossref | GoogleScholarGoogle Scholar |

Walker, J., and Taylor, P. D. (2017). Using eBird data to model population change of migratory bird species. Avian Conservation & Ecology 12, .
Using eBird data to model population change of migratory bird species.Crossref | GoogleScholarGoogle Scholar |

Welvaert, M., and Caley, P. (2016). Citizen surveillance for environmental monitoring: combining the effects of citizen science and crowdsourcing in a quantitative data framework. SpringerPlus 5, 1890.
Citizen surveillance for environmental monitoring: combining the effects of citizen science and crowdsourcing in a quantitative data framework.Crossref | GoogleScholarGoogle Scholar |

Wiersma, Y. F. (2010). Birding 2.0: citizen science and effective monitoring in the Web 2.0 world. Avian Conservation & Ecology 5, .
Birding 2.0: citizen science and effective monitoring in the Web 2.0 world.Crossref | GoogleScholarGoogle Scholar |

Wood, C., Sullivan, B., Iliff, M., Fink, D., and Kelling, S. (2011). eBird: engaging birders in science and conservation. PLoS Biology 9, e1001220.
eBird: engaging birders in science and conservation.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC38XjvFSlsQ%3D%3D&md5=33f3e63dd67d1497ae2c35d9b9c06735CAS |

Zar, J. H. (1999). ‘Biostatistical Analysis.’ 4th edn. (Prentice Hall: Upper Saddle River, NY.)