Free Standard AU & NZ Shipping For All Book Orders Over $80!
Register      Login
Marine and Freshwater Research Marine and Freshwater Research Society
Advances in the aquatic sciences
RESEARCH ARTICLE (Open Access)

What’s wrong with the Australian River Assessment System (AUSRIVAS)?

Bruce C. Chessman https://orcid.org/0000-0002-4173-8023
+ Author Affiliations
- Author Affiliations

Centre for Ecosystem Science, School of Biological, Earth and Environmental Sciences, UNSW Sydney, NSW 2052, Australia. Email: brucechessman@gmail.com

Marine and Freshwater Research 72(8) 1110-1117 https://doi.org/10.1071/MF20361
Submitted: 14 December 2020  Accepted: 18 January 2021   Published: 4 March 2021

Journal Compilation © CSIRO 2021 Open Access CC BY

Abstract

The Australian River Assessment System (AUSRIVAS or AusRivAS) is a national biomonitoring scheme that supposedly assesses the ‘biological health’ of rivers. AUSRIVAS outputs observed-over-expected (O/E) indices derived from macroinvertebrate survey data obtained both at a site to be assessed and at designated reference sites. However, AUSRIVAS reference sites lack any consistent or quantified status, and, therefore, AUSRIVAS O/E indices have no particular meaning. Moreover, many studies have found AUSRIVAS O/E to be a weak or inconsistent indicator of exposure to anthropogenic or human-influenced stressors. Poor performance by AUSRIVAS may relate to numerous factors including the following: (1) variable reference-site status, (2) inappropriate model predictors, (3) limitations of O/E indices, (4) inconstant sampling methods, and (5) neglect of non-seasonal temporal variability. The indices Ephemeroptera–Plecoptera–Trichoptera (EPT) and stream invertebrate grade number – average level (SIGNAL) provide alternatives that have often outperformed AUSRIVAS O/E in comparative tests. In addition, bioassessment of Australian rivers might be advanced by the development of diagnostic methods to identify the stressors causing ecological impact rather than merely to infer impact intensity and assign quality ratings to assessment sites.

Keywords: macroinvertebrate, O/E, predictive model, river health, RIVPACS.

Introduction

The Australian River Assessment System (AUSRIVAS or AusRivAS) is a national biomonitoring scheme adapted from the British River Prediction and Classification System (RIVPACS: Clarke et al. 2003). AUSRIVAS was developed and tested as part of Australia’s former National River Health Program during the 1990s (Davies 2000), and has changed little since that time. It is currently promoted by way of a website and biannual training courses. The AUSRIVAS software can produce various outputs, but the one that is principally used is an observed-over-expected (O/E) index of macroinvertebrate taxonomic richness. In the calculation of this index, E is the sum of probabilities of occurrence in a macroinvertebrate sample of those taxa with a predicted probability above a specified value (commonly 0.5), and O is the number of those taxa that were actually recorded in the sample (Nichols and Dyer 2013). The probabilities of occurrence are derived by a predictive statistical model from macroinvertebrate survey data that were collected at designated reference sites, weighted according to their physical, biophysical and chemical similarities to the assessment site for which an O/E value is to be generated. AUSRIVAS O/E values are used to assign sites to quality bands, variously labelled ‘more biologically diverse than reference’, ‘similar to reference’, ‘significantly impaired’, ‘severely impaired’ and ‘extremely impaired’ (Nichols and Dyer 2013).

According to its website (ausrivas.ewater.org.au; accessed 14 December 2020), AUSRIVAS is ‘a prediction system used to assess the biological health of Australian rivers’, based on computer models that ‘predict the aquatic macroinvertebrate fauna expected to occur at a site in the absence of environmental stress, such as pollution or habitat degradation, to which the fauna collected at a site can be compared’. These claims are problematic from a scientific perspective because they cannot be tested objectively with empirical evidence. Ability to assess river health cannot be tested because ecosystem health is a metaphor or value judgment and not a measurable property (Suter 1993; Lancaster 2000). Ability to predict the aquatic macroinvertebrate fauna occurring in the absence of environmental stress cannot be tested because nowhere on Earth can any longer be regarded as untouched by anthropogenic stressors. Even in wilderness areas, the freshwater biota is exposed to pervasive anthropogenic climate change, atmospheric deposition of nutrients and toxicants, and invasion of alien species (e.g. Hageman et al. 2006; Havel et al. 2015; Knouft and Ficklin 2017).

Moreover, AUSRIVAS reference sites lack any consistent or quantified status, being chosen on rather vague and geographically variable criteria such as being ‘selected primarily on the basis of riparian zone integrity and absence of major point sources of pollution upstream’ (Turak et al. 1999¸ p. 286) or being ‘usually located in conservation reserves, little grazed pastoral land or forested areas not recently logged’ but sometimes ‘located in rivers running through farmland or other disturbed areas’ (Halse et al. 2007, p. 164). Consequently, degrees of inferred deviation from reference status, as expressed by O/E values and band assignments, have no particular meaning.

Nevertheless, numerous studies provide evidence about the behaviour of AUSRIVAS outputs, and especially its O/E index, in relation to measurable properties such as repeatability, capacity to discriminate among sites with different levels of exposure to human influences, and strength of association with anthropogenic or human-influenced physical and chemical variables. An appraisal of the performance of AUSRIVAS based on these studies may help progress bioassessment of Australian rivers, which has fallen into decline in recent years (Nichols et al. 2017). Accordingly, the present contribution critically evaluates the performance of AUSRIVAS by reviewing the findings of previous studies. Possible reasons for performance inadequacies are then explored, and, finally, some suggestions are made for more effective bioassessment of Australian rivers. Although the evaluation is limited to AUSRIVAS, issues raised may be relevant to similar systems used elsewhere in the world.


Materials and methods

Studies providing empirical evidence of the behaviour and performance of AUSRIVAS in Australian states and territories, mostly based on its O/E index, were summarised in terms of the geographic location of the study, the criterion or criteria by which the performance of AUSRIVAS could be evaluated, and the overall findings (Table 1). Occasional applications of AUSRIVAS outside of Australia were excluded. The performance of AUSRIVAS was then rated as ‘good’, ‘fair’ or ‘poor’ on the basis of the evidence presented and the authors’ evaluations. Thus, if AUSRIVAS performed well or better than did alternatives tested, a ‘good’ rating was assigned, whereas if AUSRIVAS performed weakly or worse than did alternatives, a ‘poor’ rating was allocated. If AUSRIVAS performed adequately in some circumstances or respects but not in others, a ‘fair’ rating was applied. Publications on AUSRIVAS, and articles describing the application of RIVPACS-type methods to biota other than macroinvertebrates and outside of Australia, were also consulted for information on factors that might limit the performance of AUSRIVAS.


Table 1.  Summary of studies consulted for information on the behaviour of AUSRIVAS for rivers in Australian states and territories, and the present author’s evaluation of performance
ACT, Australian Capital Territory; NSW, New South Wales; NT, Northern Territory; Qld, Queensland; SA, South Australia; Tas., Tasmania; Vic., Victoria; WA, Western Australia
Click to zoom


Results

Evaluation of the behaviour and performance of AUSRIVAS encompassed 25 studies including all Australian states and territories (Table 1). On the basis of information in these studies, ‘good’ ratings were assigned in seven cases (28%), ‘fair’ ratings in six cases (24%), and ‘poor’ ratings in 12 cases (48%). Many of the studies demonstrated a failure to discriminate between sites with lower and those with higher levels of exposure to anthropogenic stress, or a lack of statistically significant association with anthropogenic or human-influenced physical and chemical stressors that are well known to have an impact on aquatic macroinvertebrates. When AUSRIVAS showed statistically significant discrimination or association, it often did so more weakly than did alternatives (Table 1).


Discussion

Instances when the performance of AUSRIVAS was rated as ‘good’ mostly related to exposure to severe stress, such as gross pollution from acid mine drainage (Sloane and Norris 2003; Linke et al. 2005) or the presence of a major dam immediately upstream (Nichols et al. 2006a). This observation concurs with the conclusion of some authors that impact detection by AUSRIVAS O/E is reliable only for severe stress (Smith et al. 1999; Edward et al. 2000). Even studies for which the performance of AUSRIVAS was rated as ‘good’ revealed some weaknesses, such as failure of some models to meet set criteria (Linke et al. 2005) or infrequent detection of a mild impact (Bailey et al. 2014; Nichols et al. 2014).

The frequent insensitivity of AUSRIVAS is of concern from a management perspective. For example, a stream in Western Australia with a nitrate concentration of 5.8 mg L–1, due to a discharge of treated sewage from a small town, was evaluated as AUSRIVAS Band A, equivalent to reference condition (Halse et al. 2007). Edward et al. (2000) expressed disquiet about the inability of AUSRIVAS to detect impacts on macroinvertebrate assemblages related to anthropogenic salinisation caused by land clearing and rising water tables, which is a major environmental problem in south-western Western Australia.

At least five factors may contribute to weak performance by AUSRIVAS, including (1) variable reference-site status, (2) inappropriate model predictors, (3) limitations of O/E indices, (4) inconstant sampling methods, and (5) neglect of non-seasonal temporal variability. Below, each is discussed, in turn, before alternatives to AUSRIVAS are briefly explored and possible future directions for more effective bioassessment of Australian rivers are considered.

Variable reference-site status

Faunal predictions made by AUSRIVAS are derived from data collected at reference sites that are supposedly ‘minimally disturbed’ (Nichols and Dyer 2013). Although quantification of disturbance at these sites does not seem to be available, it is clear from descriptive accounts that they are exposed to spatially variable and often substantial human influence. For example, some reference sites have been located on regulated rivers and within farmland (Turak et al. 1999; Halse et al. 2007). Consequently, anthropogenic faunal alteration at AUSRIVAS reference sites has been suggested as a possible reason for weak performance by some authors (Chessman and Royal 2004; Chessman et al. 2006). A fundamental conundrum of the AUSRIVAS approach is that if there were an effective way to determine the degree of anthropogenic faunal alteration at reference sites, the same method could presumably be applied to assessment sites as well, in which case, comparison with reference sites would not be needed. In reality, the degree of anthropogenic faunal alteration at reference sites is unknowable, considering the plethora of anthropogenic and human-influenced stressors, cryptic biotic legacies of past human disturbance that may linger for decades or even centuries (e.g. Ogden 2000; Maloney et al. 2008; Wohl 2019), and transmission of stressors and biota between potential reference sites and other parts of the landscape (e.g. Pringle 1997; Lake et al. 2010; Spear et al. 2018).

Inappropriate model predictors

The AUSRIVAS models collectively use a great variety of environmental variables for matching an assessment site to particular groups of reference sites, so as to generate occurrence probabilities of macroinvertebrate taxa at the assessment site (Simpson and Norris 2000). Many of these environmental predictors are subject to anthropogenic alteration, for example, alkalinity, discharge, stream depth and width, substratum composition and vegetation. The values of such predictors input to the AUSRIVAS models are the measured values, not the values that would occur in the absence of human influence, and this practice is likely to cause model predictions to deviate from natural expectations (Clarke et al. 1996; Hargett et al. 2007; Chessman 2014). For example, faunal predictions for an assessment site with unnaturally high alkalinity as a result of anthropogenic salinisation may be derived from reference sites with naturally high alkalinity, whereas reference sites with naturally low alkalinity would have been the appropriate comparison (Metzeling et al. 2006; Schäfer et al. 2011). The estimation of natural values of anthropogenically altered predictors (e.g. Olson and Hawkins 2012, 2013) might help alleviate this problem.

By contrast, if environmental variables that are subject to anthropogenic alteration are simply excluded, prediction may be less accurate (Clarke et al. 1996; Theroux et al. 2020). For example, Chessman et al. (2010) noted that in western New South Wales, the applicable AUSRIVAS model used only slope and geographic position (latitude, longitude and elevation) to match assessment sites with reference sites, and thus did not use hydrological variables. It is, therefore, uncertain how well this model matches assessment and reference sites in terms of the natural variation in hydrological regimes that can have a major bearing on the composition of macroinvertebrate assemblages in Australian dryland rivers (Sheldon and Thoms 2006). Similarly, in south-western Western Australia, a major determinant of macroinvertebrate assemblage composition, i.e. salinity, could not be used for faunal prediction because both naturally saline and anthropogenically salinised sites had similar salinities (Halse et al. 2007).

Moreover, predictor variables that are not subject to human alteration may actually be surrogates for variables that are anthropogenically modified. For example, latitude and longitude obviously do not have a direct causal influence on macroinvertebrate assemblages, and if they have predictive value it must be because they correlate with other, unknown variables that do have a causal influence, that is, variables that might be subject to anthropogenic alteration.

Limitations of O/E indices

The O/E index used by AUSRIVAS and similar bioassessment methods such as RIVPACS combines two variables, namely, the predicted probability that a taxon will occur in a sample under reference conditions (a continuous variable ranging from 0 to 1) and the detection or non-detection of a taxon in a sample (a binary variable with values of 0 or 1). Neither variable takes account of taxon abundance, except to the extent that abundance affects likelihood of occurrence or detection. Aguiar et al. (2011) suggested that the non-incorporation of abundance information might explain the poor performance of a RIVPACS-type application for Portuguese stream macrophytes, relative to alternatives that were tested. However, Kanninen et al. (2013) found that an alternative to O/E that incorporated abundance did not have superior performance for lacustrine macrophytes in Finland.

The O/E index also has a structural weakness in that the detection of taxa with a low modelled probability of occurrence can counter the non-detection of taxa with a high probability of occurrence, leading to an under-representation of the difference between the predicted and observed assemblages (Van Sickle 2008). Furthermore, the choice of a threshold of predicted probability for including taxa in the calculation of the O/E index affects index values, even for reference sites (Yuan 2006). For assessment sites, the choice of a high threshold excludes taxa that are infrequent at reference sites but may, nevertheless, be adversely affected by anthropogenic stress (Clarke and Murphy 2006; Mazor et al. 2016), or alternatively may benefit from certain types of anthropogenic stress (Edward et al. 2000). However, the presence or absence of such taxa may be quite informative. For example, in applying RIVPACS-type methods to diatoms, Chessman et al. (1999) found that sites with a greater exposure to anthropogenic influence were characterised more by the presence of taxa with predicted probabilities of <0.5 than by the absence of taxa with probabilities of >0.5. This problem may not be alleviated by the use of a low threshold, which has sometimes been reported to improve index performance (Clarke and Murphy 2006; Vander Laan and Hawkins 2014), but much more often found to reduce performance (e.g. Van Sickle et al. 2007; Aroviita et al. 2009; Meador and Carlisle 2009). Instead, the solution may be to use a different index (Chessman et al. 1999; Van Sickle 2008; Kanninen et al. 2013).

Finally, because the value of the AUSRIVAS O/E index depends on the number of expected taxa that are recorded in a sample, the index value is highly sensitive to the chance detection or non-detection of individual taxa that are present at an assessment site (Smith et al. 1999). This issue is particularly acute for naturally harsh environments with low taxon richness, such as dryland or nutrient-deficient streams or the profundal zone of lakes (Chessman et al. 2006; Halse et al. 2007; Jyväsjärvi et al. 2011), because the intrinsic variability of O/E is higher when the number of expected taxa is low (Hämäläinen et al. 2018).

Inconstant sampling methods

Inherent variability in taxon detection is likely to be compounded by weakly standardised sampling or subsampling methods. Protocols for AUSRIVAS invertebrate sampling and subsampling vary substantially among the separate manuals for each Australian state and territory (available from ausrivas.ewater.org.au/index.php/manuals-a-datasheets). However, all protocols provide quite limited standardisation. For example, all manuals specify that samples should be collected over a 10-m transect, but in most cases this distance is permitted to be either continuous or broken up into multiple, physically separated segments at the operator’s discretion. Moreover, none of the manuals specifies any time limit for sample collection or describes a procedure to measure the distance over which sampling actually occurs.

Procedures for subsampling macroinvertebrates from the bulk sample of macroinvertebrates and associated plants, algae, sediment and debris are quite varied among jurisdictions, and variously impose requirements for the number of animals to be retrieved, the time to be spent, or both. These requirements can be complex; for example, in the New South Wales manual (Turak et al. 2004), operators are instructed to use a sequence of different strategies to pick out specimens for successive periods of 5, 20, 5 and 10 min, variously focussing on collecting common taxa, seeking new taxa, or accumulating more individuals. After 40 min, picking may or may not continue for up to 20 additional minutes, depending on whether the operator believes that additional taxa are still being found. It is questionable whether such a complex procedure, applied by various operators for diverse samples, will retrieve a consistent proportion of the taxa present in the sampling area.

Neglect of non-seasonal temporal variability

AUSRIVAS attempts to deal with natural temporal variability by creating separate predictive models for its two sampling seasons, spring and autumn. However, non-seasonal (e.g. inter-annual) variation in macroinvertebrate faunas can also be high, even at reference sites (Bailey et al. 1998; Feio et al. 2006; Mazor et al. 2009). Over much of Australia, especially the arid and semi-arid zones, much of the variation in hydrological regimes and, consequently, biota, is naturally aseasonal or supraseasonal (Bunn and Davies 2000; Sheldon 2005). In such regions, it may be advisable to partition reference data according to antecedent rainfall or the phase of the flood–drought cycle, and not just calendar season (Davis et al. 2006; Chessman et al. 2010).

Alternatives to AUSRIVAS

Alternatives to the AUSRIVAS O/E index for macroinvertebrate-based bioassessment of Australian rivers include the Ephemeroptera–Plecoptera–Trichoptera (EPT) index (Lenat and Penrose 1996) and family-level and genus-level versions of the stream invertebrate grade number – average level (SIGNAL) index (Chessman 2003; Chessman et al. 2007). Both of these indices have been widely tested, and found to out-perform AUSRIVAS O/E in several investigations (e.g. Chessman et al. 2006; Walsh 2006; Cox et al. 2019). Other options, such as the environmental filters method of Chessman and Royal (2004), the salinity index of Horrigan et al. (2005), and the invertebrate species index of Haase and Nolte (2008), have not been greatly tested, and so their general utility is uncertain. Surprisingly, multimetric indices of biotic integrity, widely used around the world for bioassessment based on macroinvertebrates, fish and other organism groups (Ruaro et al. 2020), have not been developed for Australian freshwater invertebrates, perhaps because of early criticism by proponents of AUSRIVAS (Norris and Hawkins 2000) and ecological risk assessment (Suter 1993, 2001).

Ephemeroptera–Plecoptera–Trichoptera indices are based on the number or proportion of taxa or individuals belonging to the generally pollution-sensitive insect orders Ephemeroptera, Plecoptera and Trichoptera (Kitchin 2005). SIGNAL indices are an abundance-weighted or unweighted average of numerical grades assigned to individual taxa to represent their tolerance of general environmental stress (Chessman 2003). SIGNAL is conceptually different from AUSRIVAS O/E in that SIGNAL is proposed as an indicator of measurable environmental stressors such as chemical enrichment or contamination (Chessman 2003), and not of unmeasurable ‘river health’. Because SIGNAL is an average, it is little affected by variation in sampling and subsampling methods (Growns et al. 1997; Metzeling et al. 2003), in contrast to AUSRIVAS O/E (Nichols and Norris 2006; Nichols et al. 2006b).

Unlike AUSRIVAS O/E, EPT and SIGNAL do not contain built-in reference data. Users of EPT and SIGNAL are, therefore, at liberty to generate reference values in a transparent way that is appropriate to their objectives. For example, in New Zealand, Collier and Hamer (2013) and Clapcott et al. (2017) used regression models to generate reference values of the EPT index and a macroinvertebrate community index similar to SIGNAL by setting values of predictors that represented anthropogenic stressors to zero.

Future directions

A notable trend in freshwater bioassessment globally is the development of diagnostic methods to identify the stressors causing ecological responses, rather than to merely estimate the intensity of anthropogenic impact and, thereby, assign quality ratings to study sites (e.g. Lemm et al. 2019; Feld et al. 2020). A diagnostic approach is needed to support effective management (Negus et al. 2020) in a world where a natural reference state is ever more hypothetical and unattainable, and the distinction between natural and human influences on aquatic biota is increasingly blurred (Bishop et al. 2009; Dufour and Piégay 2009; Bouleau and Pont 2015). An early Australian test of the diagnostic approach with stream macroinvertebrates had mixed success (Chessman and McEvoy 1998), and more recent Australian efforts based on the species at risk (SPEAR) method (Schäfer et al. 2011; Kath et al. 2018; Bray et al. 2021) are yet to demonstrate stressor specificity. Nevertheless, advances in other parts of the world suggest that a diagnostic approach, whether based on macroinvertebrates or on other biota, may be a vehicle to progress bioassessment of Australian rivers, particularly at a time when technical advances such as identification by DNA analysis promise greatly reduced costs (Dafforn et al. 2016; Carew et al. 2017).


Conflicts of interest

The author is the originator of the SIGNAL index and had minor involvement in the early development of AUSRIVAS.


Declaration of funding

The present research did not receive any funding.



Acknowledgements

The author thanks anonymous reviewers and the handling editor for comments on the manuscript.


References

Aguiar, F. C., Feio, M. J., and Ferreira, M. T. (2011). Choosing the best method for stream bioassessment using macrophyte communities: indices and predictive models. Ecological Indicators 11, 379–388.
Choosing the best method for stream bioassessment using macrophyte communities: indices and predictive models.Crossref | GoogleScholarGoogle Scholar |

Aroviita, J., Mykrä, H., Muotka, T., and Hämäläinen, H. (2009). Influence of geographical extent on typology- and model-based assessments of taxonomic completeness of river macroinvertebrates. Freshwater Biology 54, 1774–1787.
Influence of geographical extent on typology- and model-based assessments of taxonomic completeness of river macroinvertebrates.Crossref | GoogleScholarGoogle Scholar |

Bailey, R. C., Kennedy, M. G., Dervish, M. Z., and Taylor, R. M. (1998). Biological assessment of freshwater ecosystems using a reference condition approach: comparing predicted and actual benthic invertebrate communities in Yukon streams. Freshwater Biology 39, 765–774.
Biological assessment of freshwater ecosystems using a reference condition approach: comparing predicted and actual benthic invertebrate communities in Yukon streams.Crossref | GoogleScholarGoogle Scholar |

Bailey, R. C., Linke, S., and Yates, A. G. (2014). Bioassessment of freshwater ecosystems using the Reference Condition Approach: comparing established and new methods with common data sets. Freshwater Science 33, 1204–1211.
Bioassessment of freshwater ecosystems using the Reference Condition Approach: comparing established and new methods with common data sets.Crossref | GoogleScholarGoogle Scholar |

Bishop, K., Beven, K., Destouni, G., Abrahamsson, K., Andersson, L., Johnson, R. K., Rodhe, J., and Hjerdt, N. (2009). Nature as the ‘natural’ goal for water management: a conversation. Ambio 38, 209–214.
Nature as the ‘natural’ goal for water management: a conversation.Crossref | GoogleScholarGoogle Scholar | 19739555PubMed |

Bouleau, G., and Pont, D. (2015). Did you say reference conditions? Ecological and socio-economic perspectives on the European Water Framework Directive. Environmental Science & Policy 47, 32–41.
Did you say reference conditions? Ecological and socio-economic perspectives on the European Water Framework Directive.Crossref | GoogleScholarGoogle Scholar |

Bray, J. P., O’Reilly-Nugent, A., Kon Kam King, G., Kaserzon, S., Nichols, S. J., Mac Nally, R., Thompson, R. M., and Kefford, B. J. (2021). Can species at risk of pesticides (SPEAR) indices detect effects of target stressors amongst multiple interacting stressors? The Science of the Total Environment 763, 142997.
Can species at risk of pesticides (SPEAR) indices detect effects of target stressors amongst multiple interacting stressors?Crossref | GoogleScholarGoogle Scholar | 33250249PubMed |

Bunn, S. E., and Davies, P. M. (2000). Biological processes in running waters and their implications for the assessment of ecological integrity. Hydrobiologia 422/423, 61–70.
Biological processes in running waters and their implications for the assessment of ecological integrity.Crossref | GoogleScholarGoogle Scholar |

Carew, M. E., Nichols, S. J., Batovska, J., St Clair, R., Murphy, N. P., Blacket, M. J., and Shackleton, M. E. (2017). A DNA barcode database of Australia’s freshwater macroinvertebrate fauna. Marine and Freshwater Research 68, 1788–1802.
A DNA barcode database of Australia’s freshwater macroinvertebrate fauna.Crossref | GoogleScholarGoogle Scholar |

Chessman, B. C. (1999). Predicting the macroinvertebrate faunas of streams by multiple regression of biological and environmental differences. Freshwater Biology 41, 747–757.
Predicting the macroinvertebrate faunas of streams by multiple regression of biological and environmental differences.Crossref | GoogleScholarGoogle Scholar |

Chessman, B. C. (2003). New sensitivity grades for Australian river macroinvertebrates. Marine and Freshwater Research 54, 95–103.
New sensitivity grades for Australian river macroinvertebrates.Crossref | GoogleScholarGoogle Scholar |

Chessman, B. C. (2014). Predicting reference assemblages for freshwater bioassessment with limiting environmental difference analysis. Freshwater Science 33, 1261–1271.
Predicting reference assemblages for freshwater bioassessment with limiting environmental difference analysis.Crossref | GoogleScholarGoogle Scholar |

Chessman, B. C., and McEvoy, P. K. (1998). Towards diagnostic biotic indices for river macroinvertebrates. Hydrobiologia 364, 169–182.
Towards diagnostic biotic indices for river macroinvertebrates.Crossref | GoogleScholarGoogle Scholar |

Chessman, B. C., and Royal, M. J. (2004). Bioassessment without reference sites: use of environmental filters to predict natural assemblages of river macroinvertebrates. Journal of the North American Benthological Society 23, 599–615.
Bioassessment without reference sites: use of environmental filters to predict natural assemblages of river macroinvertebrates.Crossref | GoogleScholarGoogle Scholar |

Chessman, B., Growns, I., Currey, J., and Plunkett-Cole, N. (1999). Predicting diatom communities at the genus level for the rapid biological assessment of rivers. Freshwater Biology 41, 317–331.
Predicting diatom communities at the genus level for the rapid biological assessment of rivers.Crossref | GoogleScholarGoogle Scholar |

Chessman, B. C., Thurtell, L. A., and Royal, M. J. (2006). Bioassessment in a harsh environment: a comparison of macroinvertebrate assemblages at reference and assessment sites in an Australian inland river system. Environmental Monitoring and Assessment 119, 303–330.
Bioassessment in a harsh environment: a comparison of macroinvertebrate assemblages at reference and assessment sites in an Australian inland river system.Crossref | GoogleScholarGoogle Scholar | 16741821PubMed |

Chessman, B., Williams, S., and Besley, C. (2007). Bioassessment of streams with macroinvertebrates: effect of sampled habitat and taxonomic resolution. Journal of the North American Benthological Society 26, 546–565.
Bioassessment of streams with macroinvertebrates: effect of sampled habitat and taxonomic resolution.Crossref | GoogleScholarGoogle Scholar |

Chessman, B. C., Jones, H. A., Searle, N. K., Growns, I. O., and Pearson, M. R. (2010). Assessing effects of flow alteration on macroinvertebrate assemblages in Australian dryland rivers. Freshwater Biology 55, 1780–1800.
Assessing effects of flow alteration on macroinvertebrate assemblages in Australian dryland rivers.Crossref | GoogleScholarGoogle Scholar |

Clapcott, J. E., Goodwin, E. O., Snelder, T. H., Collier, K. J., Neale, M. W., and Greenfield, S. (2017). Finding reference: a comparison of modelling approaches for predicting macroinvertebrate community index benchmarks. New Zealand Journal of Marine and Freshwater Research 51, 44–59.
Finding reference: a comparison of modelling approaches for predicting macroinvertebrate community index benchmarks.Crossref | GoogleScholarGoogle Scholar |

Clarke, R. T., and Murphy, J. F. (2006). Effects of locally rare taxa on the precision and sensitivity of RIVPACS bioassessment of freshwaters. Freshwater Biology 51, 1924–1940.
Effects of locally rare taxa on the precision and sensitivity of RIVPACS bioassessment of freshwaters.Crossref | GoogleScholarGoogle Scholar |

Clarke, R. T., Furse, M. T., Wright, J. F., and Moss, D. (1996). Derivation of a biological quality index for river sites: comparison of the observed with the expected fauna. Journal of Applied Statistics 23, 311–332.
Derivation of a biological quality index for river sites: comparison of the observed with the expected fauna.Crossref | GoogleScholarGoogle Scholar |

Clarke, R. T., Wright, J. F., and Furse, M. T. (2003). RIVPACS models for predicting the expected macroinvertebrate fauna and assessing the ecological quality of rivers. Ecological Modelling 160, 219–233.
RIVPACS models for predicting the expected macroinvertebrate fauna and assessing the ecological quality of rivers.Crossref | GoogleScholarGoogle Scholar |

Collier, K. J., and Hamer, M. P. (2013). Ecological response differentials: an alternative benchmark to inform stream and river bioassessment. Freshwater Biology 58, 1471–1483.
Ecological response differentials: an alternative benchmark to inform stream and river bioassessment.Crossref | GoogleScholarGoogle Scholar |

Cox, B., Oeding, S., and Taffs, K. (2019). A comparison of macroinvertebrate-based indices for biological assessment of river health: a case example from the sub-tropical Richmond River catchment in northeast New South Wales, Australia. Ecological Indicators 106, 105479.
A comparison of macroinvertebrate-based indices for biological assessment of river health: a case example from the sub-tropical Richmond River catchment in northeast New South Wales, Australia.Crossref | GoogleScholarGoogle Scholar |

Dafforn, K. A., Johnston, E. L., Ferguson, A., Humphrey, C. L., Monk, W., Nichols, S. J., Simpson, S. L., Tulbure, M. G., and Baird, D. J. (2016). Big data opportunities and challenges for assessing multiple stressors across scales in aquatic ecosystems. Marine and Freshwater Research 67, 393–413.
Big data opportunities and challenges for assessing multiple stressors across scales in aquatic ecosystems.Crossref | GoogleScholarGoogle Scholar |

Davies, P. E. (2000). Development of a national river bioassessment system (AUSRIVAS). In ‘Assessing the Biological Quality of Freshwaters: RIVPACS and Other Techniques’. (Eds J. F. Wright, D. W. Sutcliffe, and M. T. Furse.) pp. 113–124. (Freshwater Biological Association: Ambleside, UK.)

Davis, J., Horwitz, P., Norris, R., Chessman, B., McGuire, M., and Sommer, B. (2006). Are river bioassessment methods using macroinvertebrates applicable to wetlands? Hydrobiologia 572, 115–128.
Are river bioassessment methods using macroinvertebrates applicable to wetlands?Crossref | GoogleScholarGoogle Scholar |

Dufour, S., and Piégay, H. (2009). From the myth of a lost paradise to targeted river restoration: forget natural references and focus on human benefits. River Research and Applications 25, 568–581.
From the myth of a lost paradise to targeted river restoration: forget natural references and focus on human benefits.Crossref | GoogleScholarGoogle Scholar |

Edward, D. H. D., Storey, A. W., and Smith, M. J. B. (2000). Assessing river health in south-western Australia: comparison of macroinvertebrates at family level with Chironomidae at species level. Verhandlungen der Internationale VereinugungfürTheoretische und AngewandteLimnologie 27, 2326–2335.
Assessing river health in south-western Australia: comparison of macroinvertebrates at family level with Chironomidae at species level.Crossref | GoogleScholarGoogle Scholar |

Feio, M. J., Reynoldson, T. B., and Graça, M. A. S. (2006). Effect of seasonal changes on predictive model assessments of streams water quality with macroinvertebrates. International Review of Hydrobiology 91, 509–520.
Effect of seasonal changes on predictive model assessments of streams water quality with macroinvertebrates.Crossref | GoogleScholarGoogle Scholar |

Feld, C. K., Saeedghalati, M., and Hering, D. (2020). A framework to diagnose the causes of river ecosystem deterioration using biological symptoms. Journal of Applied Ecology 57, 2271–2284.
A framework to diagnose the causes of river ecosystem deterioration using biological symptoms.Crossref | GoogleScholarGoogle Scholar |

Franks, C. A., Mahony, M. J., and Franks, S. W. (2005). Measuring river health: the uncertainty associated with impact assessment using a single sample biological assessment technique. In ‘Dynamics and Biogeochemistry of River Corridors and Wetlands’. (Eds L. Heathwaite, B. Webb, D. Rosenberry, D. Weaver, and M. Hayashi.) pp. 176–182. (International Association of Hydrological Sciences: Wallingford, UK.)

Growns, J. E., Chessman, B. C., Jackson, J. E., and Ross, D. G. (1997). Rapid assessment of Australian rivers using macroinvertebrates: cost and efficiency of 6 methods of sample processing. Journal of the North American Benthological Society 16, 682–693.
Rapid assessment of Australian rivers using macroinvertebrates: cost and efficiency of 6 methods of sample processing.Crossref | GoogleScholarGoogle Scholar |

Haase, R., and Nolte, U. (2008). The invertebrate species index (ISI) for streams in southeast Queensland, Australia. Ecological Indicators 8, 599–613.
The invertebrate species index (ISI) for streams in southeast Queensland, Australia.Crossref | GoogleScholarGoogle Scholar |

Hageman, K. J., Simonich, S. L., Campbell, D. H., Wilson, G. R., and Landers, D. H. (2006). Atmospheric deposition of current-use and historic-use pesticides in snow at national parks in the western United States. Environmental Science & Technology 40, 3174–3180.
Atmospheric deposition of current-use and historic-use pesticides in snow at national parks in the western United States.Crossref | GoogleScholarGoogle Scholar |

Halse, S. A., Scanlon, M. D., Cocking, J. S., Smith, M. J., and Kay, W. R. (2007). Factors affecting river health and its assessment over broad geographic ranges: the Western Australian experience. Environmental Monitoring and Assessment 134, 161–175.
Factors affecting river health and its assessment over broad geographic ranges: the Western Australian experience.Crossref | GoogleScholarGoogle Scholar | 17342438PubMed |

Hämäläinen, H., Aroviita, J., Jyväsjärvi, J., and Kärkkäinen, S. (2018). Dangerous relationships: biases in freshwater bioassessment based on observed to expected ratios. Ecological Applications 28, 1260–1272.
Dangerous relationships: biases in freshwater bioassessment based on observed to expected ratios.Crossref | GoogleScholarGoogle Scholar | 29645323PubMed |

Hargett, E. G., ZumBerge, J. R., Hawkins, C. P., and Olson, J. R. (2007). Development of a RIVPACS-type predictive model for bioassessment of wadeable streams in Wyoming. Ecological Indicators 7, 807–826.
Development of a RIVPACS-type predictive model for bioassessment of wadeable streams in Wyoming.Crossref | GoogleScholarGoogle Scholar |

Harrison, E. T., Norris, R. H., and Wilkinson, S. N. (2008). Can an indicator of river health be related to assessments from a catchment-scale sediment model? Hydrobiologia 600, 49–64.
Can an indicator of river health be related to assessments from a catchment-scale sediment model?Crossref | GoogleScholarGoogle Scholar |

Havel, J. E., Kovalenko, K. E., Thomaz, S. M., Amalfitano, S., and Kats, L. B. (2015). Aquatic invasive species: challenges for the future. Hydrobiologia 750, 147–170.
Aquatic invasive species: challenges for the future.Crossref | GoogleScholarGoogle Scholar | 32214452PubMed |

Hoang, H., Recknagel, F., Marshall, J., and Choy, S. (2001). Predictive modelling of macroinvertebrate assemblages for stream habitat assessments in Queensland (Australia). Ecological Modelling 146, 195–206.
Predictive modelling of macroinvertebrate assemblages for stream habitat assessments in Queensland (Australia).Crossref | GoogleScholarGoogle Scholar |

Horrigan, N., Choy, S., Marshall, J., and Recknagel, F. (2005). Response of stream macroinvertebrates to changes in salinity and the development of a salinity index. Marine and Freshwater Research 56, 825–833.
Response of stream macroinvertebrates to changes in salinity and the development of a salinity index.Crossref | GoogleScholarGoogle Scholar |

Hose, G., Turak, E., and Waddell, N. (2004). Reproducibility of AUSRIVAS rapid bioassessments using macroinvertebrates. Journal of the North American Benthological Society 23, 126–139.
Reproducibility of AUSRIVAS rapid bioassessments using macroinvertebrates.Crossref | GoogleScholarGoogle Scholar |

Jyväsjärvi, J., Aroviita, J., and Hämäläinen, H. (2011). Evaluation of approaches for measuring taxonomic completeness of lake profundal macroinvertebrate assemblages. Freshwater Biology 56, 1876–1892.
Evaluation of approaches for measuring taxonomic completeness of lake profundal macroinvertebrate assemblages.Crossref | GoogleScholarGoogle Scholar |

Kanninen, A., Hellsten, S., and Hämäläinen, H. (2013). Comparing stressor-specific indices and general measures of taxonomic composition for assessing the status of boreal lacustrine macrophyte communities. Ecological Indicators 27, 29–43.
Comparing stressor-specific indices and general measures of taxonomic composition for assessing the status of boreal lacustrine macrophyte communities.Crossref | GoogleScholarGoogle Scholar |

Kath, J., Thomson, J. R., Thompson, R. M., Kefford, B. J., Dyer, F. J., and Mac Nally, R. (2018). Interactions among stressors may be weak: implications for management of freshwater macroinvertebrate communities. Diversity & Distributions 24, 939–950.
Interactions among stressors may be weak: implications for management of freshwater macroinvertebrate communities.Crossref | GoogleScholarGoogle Scholar |

Kitchin, P. L. (2005). Measuring the amount of statistical information in the EPT index. Environmetrics 16, 51–59.
Measuring the amount of statistical information in the EPT index.Crossref | GoogleScholarGoogle Scholar |

Knouft, J. H., and Ficklin, D. L. (2017). The potential impacts of climate change on biodiversity in flowing freshwater systems. Annual Review of Ecology, Evolution, and Systematics 48, 111–133.
The potential impacts of climate change on biodiversity in flowing freshwater systems.Crossref | GoogleScholarGoogle Scholar |

Lake, P. S., Thomson, J. R., Lada, H., Mac Nally, R., Reid, D., Stanaway, J., and Taylor, A. C. (2010). Diversity and distribution of macroinvertebrates in lentic habitats in massively altered landscapes in south-eastern Australia. Diversity & Distributions 16, 713–724.
Diversity and distribution of macroinvertebrates in lentic habitats in massively altered landscapes in south-eastern Australia.Crossref | GoogleScholarGoogle Scholar |

Lamche, G., and Fukuda, Y. (2008). Comparison of genus and family AUSRIVAS models for the Darwin–Daly region and relation to land use. Report 01/2008D, Department of Natural Resources, Environment and the Arts, Darwin, NT, Australia.

Lancaster, J. (2000). The ridiculous notion of assessing ecological health and identifying the useful concepts underneath. Human and Ecological Risk Assessment 6, 213–222.
The ridiculous notion of assessing ecological health and identifying the useful concepts underneath.Crossref | GoogleScholarGoogle Scholar |

Lemm, J. U., Feld, C. K., and Birk, S. (2019). Diagnosing the causes of river deterioration using stressor-specific metrics. The Science of the Total Environment 651, 1105–1113.
Diagnosing the causes of river deterioration using stressor-specific metrics.Crossref | GoogleScholarGoogle Scholar | 30360242PubMed |

Lenat, D. R., and Penrose, D. L. (1996). History of the EPT taxa richness metric. Bulletin of the North American Benthological Society 13, 1–3.

Linke, S., Norris, R. H., Faith, D. P., and Stockwell, D. (2005). ANNA: a new prediction method for bioassessment programs. Freshwater Biology 50, 147–158.
ANNA: a new prediction method for bioassessment programs.Crossref | GoogleScholarGoogle Scholar |

Magierowski, R. H., Davies, P. E., Read, S. M., and Horrigan, N. (2012). Impacts of land use on the structure of river macroinvertebrate communities across Tasmania, Australia: spatial scales and thresholds. Marine and Freshwater Research 63, 762–776.
Impacts of land use on the structure of river macroinvertebrate communities across Tasmania, Australia: spatial scales and thresholds.Crossref | GoogleScholarGoogle Scholar |

Maloney, K. O., Feminella, J. W., Mitchell, R. M., Miller, S. A., Mulholland, P. J., and Houser, J. N. (2008). Landuse legacies and small streams: identifying relationships between historical land use and contemporary stream conditions. Journal of the North American Benthological Society 27, 280–294.
Landuse legacies and small streams: identifying relationships between historical land use and contemporary stream conditions.Crossref | GoogleScholarGoogle Scholar |

Marchant, R., and Hehir, G. (2002). The use of AUSRIVAS predictive models to assess the response of lotic macroinvertebrates to dams in south-east Australia. Freshwater Biology 47, 1033–1050.
The use of AUSRIVAS predictive models to assess the response of lotic macroinvertebrates to dams in south-east Australia.Crossref | GoogleScholarGoogle Scholar |

Mazor, R. D., Purcell, A. H., and Resh, V. H. (2009). Long-term variability in bioassessments: a twenty-year study from two northern California streams. Environmental Management 43, 1269–1286.
Long-term variability in bioassessments: a twenty-year study from two northern California streams.Crossref | GoogleScholarGoogle Scholar | 19381714PubMed |

Mazor, R. D., Rehn, A. C., Ode, P. R., Engeln, M., Schiff, K. C., Stein, E. D., Gillett, D. J., Herbst, D. B., and Hawkins, C. P. (2016). Bioassessment in complex environments: designing an index for consistent meaning in different settings. Freshwater Science 35, 249–271.
Bioassessment in complex environments: designing an index for consistent meaning in different settings.Crossref | GoogleScholarGoogle Scholar |

Meador, M. R., and Carlisle, D. M. (2009). Predictive models for fish assemblages in eastern US streams: implications for assessing biodiversity. Transactions of the American Fisheries Society 138, 725–740.
Predictive models for fish assemblages in eastern US streams: implications for assessing biodiversity.Crossref | GoogleScholarGoogle Scholar |

Metzeling, L., Chessman, B. C., Hardwick, R., and Wong, V. (2003). Rapid assessment of rivers using macroinvertebrates: the role of experience, and comparisons with quantitative methods. Hydrobiologia 510, 39–52.
Rapid assessment of rivers using macroinvertebrates: the role of experience, and comparisons with quantitative methods.Crossref | GoogleScholarGoogle Scholar |

Metzeling, L., Perriss, S., and Robinson, D. (2006). Can the detection of salinity and habitat simplification gradients using rapid bioassessment of benthic invertebrates be improved through finer taxonomic resolution or alternative indices? Hydrobiologia 572, 235–252.
Can the detection of salinity and habitat simplification gradients using rapid bioassessment of benthic invertebrates be improved through finer taxonomic resolution or alternative indices?Crossref | GoogleScholarGoogle Scholar |

Negus, P., Blessing, J., Clifford, S., and Marshall, J. (2020). Adaptive monitoring using causative conceptual models: assessment of ecological integrity of aquatic ecosystems. Australasian Journal of Environmental Management 27, 224–240.
Adaptive monitoring using causative conceptual models: assessment of ecological integrity of aquatic ecosystems.Crossref | GoogleScholarGoogle Scholar |

Nichols, S. J., and Dyer, F. J. (2013). Contribution of national bioassessment approaches for assessing ecological water security: an AUSRIVAS case study. Frontiers of Environmental Science & Engineering 7, 669–687.
Contribution of national bioassessment approaches for assessing ecological water security: an AUSRIVAS case study.Crossref | GoogleScholarGoogle Scholar |

Nichols, S. J., and Norris, R. H. (2006). River condition assessment may depend on the sub-sampling method: field live-sort versus laboratory sub-sampling of invertebrates for bioassessment. Hydrobiologia 572, 195–213.
River condition assessment may depend on the sub-sampling method: field live-sort versus laboratory sub-sampling of invertebrates for bioassessment.Crossref | GoogleScholarGoogle Scholar |

Nichols, S., Norris, R., Maher, W., and Thoms, M. (2006a). Ecological effects of serial impoundment on the Cotter River, Australia. Hydrobiologia 572, 255–273.
Ecological effects of serial impoundment on the Cotter River, Australia.Crossref | GoogleScholarGoogle Scholar |

Nichols, S. J., Robinson, W. A., and Norris, R. H. (2006b). Sample variability influences the precision of predictive bioassessment. Hydrobiologia 572, 215–233.
Sample variability influences the precision of predictive bioassessment.Crossref | GoogleScholarGoogle Scholar |

Nichols, S. J., Robinson, W. A., and Norris, R. H. (2010). Using the reference condition maintains the integrity of a bioassessment program in a changing climate. Journal of the North American Benthological Society 29, 1459–1471.
Using the reference condition maintains the integrity of a bioassessment program in a changing climate.Crossref | GoogleScholarGoogle Scholar |

Nichols, S. J., Reynoldson, T. B., and Harrison, E. T. (2014). Evaluating AUSRIVAS predictive model performance for detecting simulated eutrophication effects on invertebrate assemblages. Freshwater Science 33, 1212–1224.
Evaluating AUSRIVAS predictive model performance for detecting simulated eutrophication effects on invertebrate assemblages.Crossref | GoogleScholarGoogle Scholar |

Nichols, S. J., Barmuta, L. A., Chessman, B. C., Davies, P. E., Dyer, F. J., Harrison, E. T., Hawkins, C. P., Jones, I., Kefford, B. J., Linke, S., Marchant, R., Metzeling, L., Moon, K., Ogden, R., Peat, M., Reynoldson, T. B., and Thompson, R. M. (2017). The imperative need for nationally coordinated bioassessment of rivers and streams. Marine and Freshwater Research 68, 599–613.
The imperative need for nationally coordinated bioassessment of rivers and streams.Crossref | GoogleScholarGoogle Scholar |

Norris, R. H., and Hawkins, C. P. (2000). Monitoring river health. Hydrobiologia 435, 5–17.
Monitoring river health.Crossref | GoogleScholarGoogle Scholar |

Ogden, R. W. (2000). Modern and historical variation in aquatic macrophyte cover of billabongs associated with catchment development. Regulated Rivers 16, 497–512.
Modern and historical variation in aquatic macrophyte cover of billabongs associated with catchment development.Crossref | GoogleScholarGoogle Scholar |

Olson, J. R., and Hawkins, C. P. (2012). Predicting natural base-flow stream water chemistry in the western United States. Water Resources Research 48, W02504.
Predicting natural base-flow stream water chemistry in the western United States.Crossref | GoogleScholarGoogle Scholar |

Olson, J. R., and Hawkins, C. P. (2013). Developing site-specific nutrient criteria from empirical models. Freshwater Science 32, 719–740.
Developing site-specific nutrient criteria from empirical models.Crossref | GoogleScholarGoogle Scholar |

Pringle, C. M. (1997). Exploring how disturbance is transmitted upstream: going against the flow. Journal of the North American Benthological Society 16, 425–438.
Exploring how disturbance is transmitted upstream: going against the flow.Crossref | GoogleScholarGoogle Scholar |

Ruaro, R., Gubiani, E. A., Hughes, R. M., and Mormul, R. P. (2020). Global trends and challenges in multimetric indices of biological condition. Ecological Indicators 110, 105862.
Global trends and challenges in multimetric indices of biological condition.Crossref | GoogleScholarGoogle Scholar |

Schäfer, R. B., Kefford, B. J., Metzeling, L., Liess, M., Burgert, S., Marchant, R., Pettigrove, V., Goonan, P., and Nugegoda, D. (2011). A trait database of stream invertebrates for the ecological risk assessment of single and combined effects of salinity and pesticides in south-east Australia. The Science of the Total Environment 409, 2055–2063.
A trait database of stream invertebrates for the ecological risk assessment of single and combined effects of salinity and pesticides in south-east Australia.Crossref | GoogleScholarGoogle Scholar | 21376369PubMed |

Sheldon, F. (2005). Incorporating natural variability into the assessment of ecological health in Australian dryland rivers. Hydrobiologia 552, 45–56.
Incorporating natural variability into the assessment of ecological health in Australian dryland rivers.Crossref | GoogleScholarGoogle Scholar |

Sheldon, F., and Thoms, M. C. (2006). Relationships between flow variability and macroinvertebrate assemblage composition: data from four Australian dryland rivers. River Research and Applications 22, 219–238.
Relationships between flow variability and macroinvertebrate assemblage composition: data from four Australian dryland rivers.Crossref | GoogleScholarGoogle Scholar |

Simpson, J. C., and Norris, R. H. (2000). Biological assessment of river quality: development of AUSRIVAS models and outputs. In ‘Assessing the Biological Quality of Freshwaters: RIVPACS and Other Techniques’. (Eds J. F. Wright, D. W. Sutcliffe, and M. T. Furse.) pp. 125–142. (Freshwater Biological Association: Ambleside, UK.)

Sloane, P. I. W., and Norris, R. H. (2003). Relationship of AUSRIVAS-based macroinvertebrate predictive model outputs to a metal pollution gradient. Journal of the North American Benthological Society 22, 457–471.
Relationship of AUSRIVAS-based macroinvertebrate predictive model outputs to a metal pollution gradient.Crossref | GoogleScholarGoogle Scholar |

Smith, M. J., Kay, W. R., Edward, D. H. D., Papas, P. J., Richardson, K., St, J., Simpson, J. C., Pinder, A. M., Cale, D. J., Horwitz, P. H. J., Davis, J. A., Yung, F. H., Norris, R. H., and Halse, S. A. (1999). AusRivAS: using macroinvertebrates to assess ecological conditions of rivers in Western Australia. Freshwater Biology 41, 269–282.
AusRivAS: using macroinvertebrates to assess ecological conditions of rivers in Western Australia.Crossref | GoogleScholarGoogle Scholar |

Spear, J. E., Grijalva, E. K., Michaels, J. S., and Parker, S. S. (2018). Ecological spillover dynamics of organisms from urban to natural landscapes. Journal of Urban Ecology 4, 1–12.
Ecological spillover dynamics of organisms from urban to natural landscapes.Crossref | GoogleScholarGoogle Scholar |

Suter, G. W. (1993). A critique of ecosystem health concepts and indexes. Environmental Toxicology and Chemistry 12, 1533–1539.
A critique of ecosystem health concepts and indexes.Crossref | GoogleScholarGoogle Scholar |

Suter, G. W. (2001). Applicability of indicator monitoring to ecological risk assessment. Ecological Indicators 1, 101–112.
Applicability of indicator monitoring to ecological risk assessment.Crossref | GoogleScholarGoogle Scholar |

Taylor, D., Goonan, P., and McEvoy, P. (2002). Assessment of stream invertebrates and water quality during insecticide spraying of plague locusts in the Flinders Ranges, South Australia. Environmental Health 2, 19–29.

Theroux, S., Mazor, R. D., Beck, M. W., Ode, P. R., Stein, E. D., and Sutula, M. (2020). Predictive biological indices for algae populations in diverse stream environments. Ecological Indicators 119, 106421.
Predictive biological indices for algae populations in diverse stream environments.Crossref | GoogleScholarGoogle Scholar |

Turak, E., Flack, L. K., Norris, R. H., Simpson, J., and Waddell, N. (1999). Assessment of river condition at a large spatial scale using predictive models. Freshwater Biology 41, 283–298.
Assessment of river condition at a large spatial scale using predictive models.Crossref | GoogleScholarGoogle Scholar |

Turak, E., Waddell, N., and Johnstone, G. (2004). ‘New South Wales (NSW) Australian River Assessment System (AUSRIVAS) Sampling and Processing Manual 2004.’(Department of Environment and Conservation: Sydney, NSW, Australia.)

Van Sickle, J. (2008). An index of compositional dissimilarity between observed and expected assemblages. Journal of the North American Benthological Society 27, 227–235.
An index of compositional dissimilarity between observed and expected assemblages.Crossref | GoogleScholarGoogle Scholar |

Van Sickle, J., Larsen, D. P., and Hawkins, C. P. (2007). Exclusion of rare taxa affects performance of the O/E index in bioassessments. Journal of the North American Benthological Society 26, 319–331.
Exclusion of rare taxa affects performance of the O/E index in bioassessments.Crossref | GoogleScholarGoogle Scholar |

Vander Laan, J. J., and Hawkins, C. P. (2014). Enhancing the performance and interpretation of freshwater biological indices: an application in arid zone streams. Ecological Indicators 36, 470–482.
Enhancing the performance and interpretation of freshwater biological indices: an application in arid zone streams.Crossref | GoogleScholarGoogle Scholar |

Walsh, C. J. (2006). Biological indicators of stream health using macroinvertebrate assemblage composition: a comparison of sensitivity to an urban gradient. Marine and Freshwater Research 57, 37–47.
Biological indicators of stream health using macroinvertebrate assemblage composition: a comparison of sensitivity to an urban gradient.Crossref | GoogleScholarGoogle Scholar |

Wohl, E. (2019). Forgotten legacies: understanding and mitigating historical human alterations of river corridors. Water Resources Research 55, 5181–5201.
Forgotten legacies: understanding and mitigating historical human alterations of river corridors.Crossref | GoogleScholarGoogle Scholar |

Yuan, L. L. (2006). Theoretical predictions of observed to expected ratios in RIVPACS-type predictive model assessments of stream biological condition. Journal of the North American Benthological Society 25, 841–850.
Theoretical predictions of observed to expected ratios in RIVPACS-type predictive model assessments of stream biological condition.Crossref | GoogleScholarGoogle Scholar |