Quantifying uncertainty in environmental indices: an application to an estuarine health index
Melissa J. Dobbie A B and David Clifford A
+ Author Affiliations
- Author Affiliations
A CSIRO Land and Water Flagship and Digital Productivity Flagship, Brisbane, Qld 4001, Australia.
B Corresponding author. Email: melissa.dobbie@csiro.au
Marine and Freshwater Research 66(2) 95-105 https://doi.org/10.1071/MF13065
Submitted: 10 March 2014 Accepted: 22 May 2014 Published: 7 November 2014
Abstract
Estuaries are an important link between terrestrial and marine ecosystems, so assessing their health and what influences it can help guide future ecosystem monitoring and management. But estuaries can be complex and dynamic systems, so summarising health by a single score or grade raises questions about interpretation, variability, sensitivity and confidence. Such questions may include how variable is the score for a particular waterway, how sensitive is the score to seemingly benign decisions taken to reach that score, and how different is the B grade of one waterway to the C scored by an adjacent waterway. Focusing on a specific estuarine health index, we quantified two different sources of variation in its construction and examined how they contributed to the variability of the final score. We found that quantifying the variability in two steps of the index construction enabled us to make more informed inferences about the index and its bearing on an overall report card score for an estuary. By highlighting uncertainty in an estuarine health index, we are improving its inferential value and enabling more defensible decision-making about current and future management and amelioration of an estuary’s health and function.
Additional keywords: composite index, ecosystem health, EHMP, multi-metric, sensitivity, south-east Queensland.
References
Attard, M., Thompson, M., Kelly, R., and Locatelli, A. (2012). Tamar Estuary Ecosystem Health Assessment Program Monitoring Report 2012. Report to NRM North Tamar Estuary and Esk Rivers Program.Birk, S., Bonne, W., Borja, A., Brucet, S., Courrat, A., Poikane, S., Solimini, A., van de Bund, W., Zampoukas, N., and Hering, D. (2012). Three hundred ways to assess Europe’s surface waters: an almost complete overview of biological methods to implement the water framework directive. Ecological Indicators 18, 31–41.
| Three hundred ways to assess Europe’s surface waters: an almost complete overview of biological methods to implement the water framework directive.Crossref | GoogleScholarGoogle Scholar |
Borja, A., and Dauer, D. (2008). Assessing the environmental quality status in estuarine and coastal systems: comparing methodologies and indices. Ecological Indicators 8, 331–337.
| Assessing the environmental quality status in estuarine and coastal systems: comparing methodologies and indices.Crossref | GoogleScholarGoogle Scholar |
Borja, A., Franco, J., and Pérez, V. (2000). A marine biotic index to establish the ecological quality of soft-bottom benthos within European estuarine and coastal environments. Marine Pollution Bulletin 40, 1100–1114.
| A marine biotic index to establish the ecological quality of soft-bottom benthos within European estuarine and coastal environments.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD3MXjtlCh&md5=bc6a472c2eb0ad0cd848e50a069f74eeCAS |
Bunn, S., Abal, E., Smith, M., Choy, S., Fellows, C., Harch, B., Kennard, M., and Sheldon, F. (2010). Integration of science and monitoring of river ecosystem health to guide investments in catchment protection and rehabilitation. Freshwater Biology 55, 223–240.
| Integration of science and monitoring of river ecosystem health to guide investments in catchment protection and rehabilitation.Crossref | GoogleScholarGoogle Scholar |
Cade, B. S., and Noon, B. R. (2003). A gentle introduction to quantile regression for ecologists. Frontiers in Ecology and the Environment 1, 412–420.
| A gentle introduction to quantile regression for ecologists.Crossref | GoogleScholarGoogle Scholar |
Chainho, P., Costa, J. L., Chaves, M. L., Dauer, D. M., and Costa, M. J. (2007). Influence of seasonal variability in benthic invertebrate community structure on the use of biotic indices to assess the ecological status of a Portuguese estuary. Marine Pollution Bulletin 54, 1586–1597.
| Influence of seasonal variability in benthic invertebrate community structure on the use of biotic indices to assess the ecological status of a Portuguese estuary.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD2sXhtFSrt7nO&md5=97c606d967196020f614896949c9c71fCAS | 17681552PubMed |
Chiu, G., and Guttorp, P. (2006). Stream health index for Puget Sound Lowland. Environmetrics 17, 285–307.
| Stream health index for Puget Sound Lowland.Crossref | GoogleScholarGoogle Scholar |
Clark, J. S., and Gelfand, A. E. (Eds) (2006). ‘Hierarchical Modeling for the Environmental Sciences: Statistical Methods and Applications.’ (Oxford University Press: Oxford.)
Coates, S., Waugh, A., Anwar, A., and Robson, M. (2007). Efficacy of multi-metric fish index as an analysis tool for the transitional fish component of the water framework directive. Marine Pollution Bulletin 55, 225–240.
| Efficacy of multi-metric fish index as an analysis tool for the transitional fish component of the water framework directive.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD28Xht1equrrE&md5=6b741886c5d1366ec73233de943ee566CAS | 17056072PubMed |
Connolly, R. M., Bunn, S., Campbell, M., Escher, B., Hunter, J., Maxwell, P., Page, T., Richmond, S., Rissik, D., Roiko, A., Smart, J., and Teasdale, P. (2013). Review of the use of report cards for monitoring ecosystem and waterway health. Report to: Gladstone Healthy Harbour Partnership. November 2013. Queensland, Australia.
Curnutt, J. L., Comiskey, E. J., Nott, M. P., and Gross, L. J. (2000). Landscape-based spatially-explicit species index models for Everglades restoration. Ecological Applications 10, 1849–1860.
| Landscape-based spatially-explicit species index models for Everglades restoration.Crossref | GoogleScholarGoogle Scholar |
Day, J. W., Crump, B. C., Kemp, W. M., and Yanez-Arancibia, A. (Eds) (2013). ‘Estuarine Ecology.’ 2nd edn. (Wiley-Blackwell: New York, NY.)
Department of Environment and Heritage Protection (2009). ‘Queensland Water Quality Guidelines, Version 3.’ ISBN 978–0-9806986–0-2.
Diaz, R. J., Solan, M., and Valente, R. M. (2004). A review of approaches for classifying benthic habitats and evaluating habitat quality. Journal of Environmental Management 73, 165–181.
| A review of approaches for classifying benthic habitats and evaluating habitat quality.Crossref | GoogleScholarGoogle Scholar | 15474734PubMed |
Dobbie, M. J., and Dail, D. (2012). Environmental indices. In ‘Encyclopaedia of Environmetrics Second Edition’. (Eds A.-H. El-Shaarawi and W. Piegorsch.) pp. 862–864. (John Wiley & Sons Ltd: Chichester, UK.) https://doi.org/ 10.1002/9780470057339.vnn157
Dobbie, M. J., and Dail, D. (2013). Robustness and sensitivity of weighting and aggregation in constructing composite indices. Ecological Indicators 29, 270–277.
| Robustness and sensitivity of weighting and aggregation in constructing composite indices.Crossref | GoogleScholarGoogle Scholar |
EHMP (2008). ‘Ecosystem Health Monitoring Program 2006–07 Annual Technical Report.’ (South East Queensland Healthy Waterways Partnership: Brisbane.)
EPA (2006). Queensland Water Quality Guidelines 2006. (Environmental Protection Agency: Brisbane.)
European Parliament and the Council of the European Union (2000). Directive 2000/60/EC of the European Parliament and of the Council of 23 October 2000 establishing a framework for Community action in the field of water policy. Official Journal of the European Communities 43, 1–73.
Fairweather, P. G. (1999). Determining the ‘health’ of estuaries: priorities for ecological research. Australian Journal of Ecology 24, 441–451.
| Determining the ‘health’ of estuaries: priorities for ecological research.Crossref | GoogleScholarGoogle Scholar |
Hallett, C. S., Valesini, F. J., Clarke, K. R., Hesp, S. A., and Hoeksema, S. D. (2012). Development and validation of fish-based, multimetric indices for assessing the ecological health of Western Australian estuaries. Estuarine, Coastal and Shelf Science 104–105, 102–113.
| Development and validation of fish-based, multimetric indices for assessing the ecological health of Western Australian estuaries.Crossref | GoogleScholarGoogle Scholar |
Heip, C. (1988). Biota and abiotic environment in the Westerschelde estuary. Hydrobiological Bulletin 22, 31–34.
| Biota and abiotic environment in the Westerschelde estuary.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DyaL1MXksVCgsw%3D%3D&md5=1fb14346060b8d6091f86c8083a57dd5CAS |
Hewitt, J. E., Anderson, M. J., and Thrush, S. F. (2005). Assessing and monitoring ecological community health in marine systems. Ecological Applications 15, 942–953.
| Assessing and monitoring ecological community health in marine systems.Crossref | GoogleScholarGoogle Scholar |
Karr, J. R. (1981). Assessment of biotic integrity using fish communities. Fisheries 6, 21–27.
| Assessment of biotic integrity using fish communities.Crossref | GoogleScholarGoogle Scholar |
Koenker, R. W. (2005). ‘Quantile Regression.’ (Cambridge University Press: New York, NY.)
Koenker, R. (2012). ‘quantreg: Quantile Regression. R Package Version 4.79.’ Available at http://CRAN.R-project.org/package=quantreg (accessed 10 August 2012).
Llansó, R. J., Scott, L. C., Hyland, J. L., Dauer, D. M., Russell, D. E., and Kutz, F. W. (2002). An estuarine benthic index of biotic integrity for the mid-Atlantic region of the United States II. Index development. Estuaries 25, 1231–1242.
| An estuarine benthic index of biotic integrity for the mid-Atlantic region of the United States II. Index development.Crossref | GoogleScholarGoogle Scholar |
Millward, G. E., and Glegg, G. A. (1997). Fluxes and retention of trace metals in the Humber estuary. Estuarine, Coastal and Shelf Science 44, 97–105.
| Fluxes and retention of trace metals in the Humber estuary.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DyaK2sXjvFegsLw%3D&md5=2f31c2cea4ddabf8d9b5222761151bceCAS |
Nardo, M., Saisana, M., Saltelli, A., and Tarantola, S. (2005). Tools for composite indicators building. European Commission Joint Research Centre Report EUR 21682 EN.
Newell, P., Tiller, D., and Lloyd, L. N. (2012). Technical report for freshwater monitoring framework and report card for the Tamar estuary and Esk Rivers program. Report to NRM North.
OECD (2008). ‘Handbook on Constructing Composite Indicators: Methodology and User Guide.’ ISBN 978–92–64–04345–9.
Pantus, F. J., and Dennison, W. C. (2005). Quantifying and evaluation ecosystem health: a case study from Moreton Bay, Australia. Environmental Management 36, 757–771.
| Quantifying and evaluation ecosystem health: a case study from Moreton Bay, Australia.Crossref | GoogleScholarGoogle Scholar | 16206027PubMed |
R Development Core Team (2012). ‘R: a language and environment for statistical computing.’ (R Foundation for Statistical Computing, Vienna, Austria.) ISBN 3–900051–07–0. Available at http://www.R-project.org/ (accessed 10 August 2012).
Raican, S. M., Wang, Y.-G., and Harch, B. D. (2013). Water quality indices from unbalanced spatio-temporal monitoring designs. In ‘Water Quality: Indicators, Human Impact and Environmental Health’. (Ed. Y.-G. Wang.) pp. 1–30. (Nova Publishers: New York, NY.)
Rider, P. R. (1960). Variance of the median of small samples from several special populations. Journal of the American Statistical Association 55, 148–150.
| Variance of the median of small samples from several special populations.Crossref | GoogleScholarGoogle Scholar |
Saisana, M., Saltelli, A., and Tarantola, S. (2005). Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators. Journal of the Royal Statistical Society. Series A (General) 168, 307–323.
| Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators.Crossref | GoogleScholarGoogle Scholar |
Venables, W. N., and Ripley, B. D. (2002). ‘Modern Applied Statistics with S.’ 4th edn. (Springer: New York, NY.)
Weisberg, S. B., Ranasinghe, J. A., Dauer, D. M., Schaffner, L. C., Diaz, R. J., and Frithsen, J. B. (1997). An estuarine benthic index of biotic integrity (B-IBI) for Chesapeake Bay. Estuaries 20, 149–158.
| An estuarine benthic index of biotic integrity (B-IBI) for Chesapeake Bay.Crossref | GoogleScholarGoogle Scholar |
Wolter, K., and Timlin, M. S. (1993). Monitoring ENSO in COADS with a seasonally adjusted principal component index. In ‘Proceedings of the 17th Climate Diagnostics Workshop, Norman, OK, NOAA/NMC/CAC, NSSL, Oklahoma Clim’. pp. 52–57. Survey, CIMMS and the School of Meteor, University of Oklahoma.
Ysebaert, T., Herman, P. M. J., Meire, P., Craeymeersch, J., Verbeek, H., and Heip, C. H. R. (2003). Large-scale spatial patterns in estuaries: estuarine macrobenthic communities in the Schelde estuary, NW Europe. Estuarine, Coastal and Shelf Science 57, 335–355.
| Large-scale spatial patterns in estuaries: estuarine macrobenthic communities in the Schelde estuary, NW Europe.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BD3sXlt1aqsLk%3D&md5=14c0b7e333ca6b99d6d5914dd17bdfaaCAS |
