An accuracy assessment of the MTBS burned area product for shrub–steppe fires in the northern Great Basin, United States
Aaron M. Sparks A , Luigi Boschetti A , Alistair M. S. Smith A B , Wade T. Tinkham A , Karen O. Lannom A and Beth A. Newingham AA Department of Forest, Rangeland, and Fire Sciences, University of Idaho, Moscow, ID 83844-1133, USA.
B Corresponding author. Email: alistair@uidaho.edu
International Journal of Wildland Fire 24(1) 70-78 https://doi.org/10.1071/WF14131
Submitted: 25 July 2014 Accepted: 28 August 2014 Published: 26 November 2014
Abstract
Although fire is a common disturbance in shrub–steppe, few studies have specifically tested burned area mapping accuracy in these semiarid to arid environments. We conducted a preliminary assessment of the accuracy of the Monitoring Trends in Burn Severity (MTBS) burned area product on four shrub–steppe fires that exhibited varying degrees of within-fire patch heterogeneity. Independent burned area perimeters were derived through visual interpretation and were used to cross-compare the MTBS burned area perimeters with classifications produced using set thresholds on the Relativised differenced Normalised Burn Index (RdNBR), Mid-infrared Burn Index (MIRBI) and Char Soil Index (CSI). Overall, CSI provided the most consistent accuracies (96.3–98.6%), with only small commission errors (1.5–4.4%). MIRBI also had relatively high accuracies (92.2–97.9%) and small commission errors (2.1–10.8%). The MTBS burned area product had higher commission errors (4.3–15.5%), primarily due to inclusion of unburned islands and fingers within the fire perimeter. The RdNBR burned area maps exhibited lower accuracies (92.9–96.0%). However, the different indices when constrained by the MTBS perimeter provided variable results, with CSI providing the highest and least variable accuracies (97.4–99.1%). Studies seeking to use MTBS perimeters to analyse trends in burned area should apply spectral indices to constrain the final burned area maps. The present paper replaces a former paper of the same title (http://dx.doi.org/10.1071/WF13206), which was withdrawn owing to errors discovered in data analysis after the paper was accepted for publication.
Additional keywords: CSI, dNBR, MIRBI, RdNBR, remote sensing.
References
Abatzoglou JT, Kolden CA (2011) Climate change in western US deserts: potential for increased wildfire and invasive annual grasses. Rangeland Ecology and Management 64, 471–478.| Climate change in western US deserts: potential for increased wildfire and invasive annual grasses.Crossref | GoogleScholarGoogle Scholar |
Abatzoglou JT, Kolden CA (2013) Relationships between climate and macroscale area burned in the western United States. International Journal of Wildland Fire 22, 1003–1020.
| Relationships between climate and macroscale area burned in the western United States.Crossref | GoogleScholarGoogle Scholar |
Baker WL (2006) Fire and restoration of sagebrush ecosystems. Wildlife Society Bulletin 34, 177–185.
| Fire and restoration of sagebrush ecosystems.Crossref | GoogleScholarGoogle Scholar |
Boschetti L, Brivio PA, Eva HD, Gallego J, Baraldi A, Gregiore J-M (2006) A sampling method for the retrospective validation of global burned area products. IEEE Transactions on Geoscience and Remote Sensing 44, 1765–1773.
| A sampling method for the retrospective validation of global burned area products.Crossref | GoogleScholarGoogle Scholar |
Boschetti L, Roy DP, Justice CO (2009) International Global Burned Area Satellite Product Validation Protocol Part I – production and standardization of validation reference data (to be followed by part II – accuracy reporting). Available at http://lpvs.gsfc.nasa.gov/PDF/BurnedAreaValidationProtocol.pdf [Verified 8 October 2014]
Brewer CK, Winne JC, Redmond RL, Opitz DW, Mangrich MV (2005) Classifying and mapping wildfire severity: a comparison of methods. Photogrammetric Engineering and Remote Sensing 71, 1311–1320.
| Classifying and mapping wildfire severity: a comparison of methods.Crossref | GoogleScholarGoogle Scholar |
Chambers JC, Roundy BA, Blank RR, Meyer SE, Whittaker A (2007) What makes Great Basin sagebrush ecosystems invasible by Bromus tectorum? Ecological Monographs 77, 117–145.
| What makes Great Basin sagebrush ecosystems invasible by Bromus tectorum?Crossref | GoogleScholarGoogle Scholar |
Crawford JA, Olson RA, West NE, Mosley JC, Schroeder MA, Whitson TD, Miller RF, Gregg MA, Boyd CS (2004) Synthesis paper: ecology and management of sage-grouse and sage-grouse habitat. Journal of Range Management 57, 2–19.
| Synthesis paper: ecology and management of sage-grouse and sage-grouse habitat.Crossref | GoogleScholarGoogle Scholar |
Dillon GK, Holden ZA, Morgan P, Crimmins MA, Heyerdahl EK, Luce CH (2011) Both topography and climate affected forest and woodland burn severity in two regions of the western US, 1984 to 2006. Ecosphere 2, 12
| Both topography and climate affected forest and woodland burn severity in two regions of the western US, 1984 to 2006.Crossref | GoogleScholarGoogle Scholar |
Eidenshink J, Schwind B, Brewer K, Zhu Z, Quayle B, Howard S (2007) A project for monitoring trends in burn severity. Fire Ecology 3, 3–21.
| A project for monitoring trends in burn severity.Crossref | GoogleScholarGoogle Scholar |
Heward H, Smith AMS, Roy DP, Tinkham WT, Hoffman CM, Morgan P, Lannom KO (2013) Is burn severity related to fire intensity? Observations from landscape scale remote sensing. International Journal of Wildland Fire 22, 910–918.
| Is burn severity related to fire intensity? Observations from landscape scale remote sensing.Crossref | GoogleScholarGoogle Scholar |
Holden ZA, Smith AMS, Morgan P, Rollins MG, Gessler PE (2005) Evaluation of novel thermally enhanced spectral indices for mapping fire perimeters and comparison with fire atlas data. International Journal of Remote Sensing 26, 4801–4808.
| Evaluation of novel thermally enhanced spectral indices for mapping fire perimeters and comparison with fire atlas data.Crossref | GoogleScholarGoogle Scholar |
Kolden CA, Lutz JA, Key CH, Kane JT, van Wagtendonk JW (2012) Mapped versus actual burned area within wildfire perimeters: characterizing the unburned. Forest Ecology and Management 286, 38–47.
| Mapped versus actual burned area within wildfire perimeters: characterizing the unburned.Crossref | GoogleScholarGoogle Scholar |
Lannom KO, Tinkham WT, Smith AMS, Abatzoglou J, Newingham BA, Hall T, Morgan P, Strand EK, Paveglio Y, Anderson JW, Sparks AM (2014) Defining extreme wildland fires using geospatial and ancillary metrics. International Journal of Wildland Fire 23, 322–337.
| Defining extreme wildland fires using geospatial and ancillary metrics.Crossref | GoogleScholarGoogle Scholar |
Lentile LB, Holden ZA, Smith AMS, Falkowski MJ, Hudak AT, Morgan P, Lewis SA, Gessler PE, Benson NC (2006) Remote sensing techniques to assess active fire characteristics and post-fire effects. International Journal of Wildland Fire 15, 319–345.
| Remote sensing techniques to assess active fire characteristics and post-fire effects.Crossref | GoogleScholarGoogle Scholar |
Lentile LB, Smith AMS, Hudak AT, Morgan P, Bobbitt M, Lewis SA, Robichaud P (2009) Remote sensing for prediction of 1-year post-fire ecosystem condition. International Journal of Wildland Fire 18, 594–608.
| Remote sensing for prediction of 1-year post-fire ecosystem condition.Crossref | GoogleScholarGoogle Scholar |
Lund GH (2007) Accounting for the world’s rangelands. Rangelands 29, 3–10.
| Accounting for the world’s rangelands.Crossref | GoogleScholarGoogle Scholar |
Masek JG, Vermote EF, Saleous NE, Wolfe R, Hall FG, Huemmrich KF, Gao F, Kutler J, Lim TK (2006) A Landsat surface reflectance dataset for North America, 1990–2000. IEEE Geoscience and Remote Sensing Letters 3, 68–72.
| A Landsat surface reflectance dataset for North America, 1990–2000.Crossref | GoogleScholarGoogle Scholar |
Masek JG, Huang CQ, Wolfe R, Cohen W, Hall F, Kutler J, Nelson P (2008) North American forest disturbance mapped from a decadal Landsat record. Remote Sensing of Environment 112, 2914–2926.
| North American forest disturbance mapped from a decadal Landsat record.Crossref | GoogleScholarGoogle Scholar |
Miller JD, Thode AE (2007) Quantifying burn severity in a heterogeneous landscape with a relative version of the delta Normalized Burn Ratio (dNBR). Remote Sensing of Environment 109, 66–80.
| Quantifying burn severity in a heterogeneous landscape with a relative version of the delta Normalized Burn Ratio (dNBR).Crossref | GoogleScholarGoogle Scholar |
Morton DC, Collatz GJ, Wang D, Randerson JT, Giglio L, Chen Y (2012) Satellite-based assessment of climate controls on US burned area. Biogeosciences 9, 7853–7892.
| Satellite-based assessment of climate controls on US burned area.Crossref | GoogleScholarGoogle Scholar |
Oliveira SLJ, Periera JMC, Carrieras JMB (2012) Fire frequency analysis in Portugal (1975–2005), using Landsat-based burnt area maps. International Journal of Wildland Fire 21, 48–60.
| Fire frequency analysis in Portugal (1975–2005), using Landsat-based burnt area maps.Crossref | GoogleScholarGoogle Scholar |
Olofsson P, Foody GM, Stehman SV, Woosdock CE (2013) Making better use of accuracy data in land change studies: estimating accuracy and area and quantifying uncertainty using stratified estimation. Remote Sensing of Environment 129, 122–131.
| Making better use of accuracy data in land change studies: estimating accuracy and area and quantifying uncertainty using stratified estimation.Crossref | GoogleScholarGoogle Scholar |
Olofsson P, Foody GM, Herold M, Stehman SV, Woodcock CE, Wulder MA (2014) Good practices for estimating area and assessing accuracy of land change. Remote Sensing of Environment 148, 42–57.
| Good practices for estimating area and assessing accuracy of land change.Crossref | GoogleScholarGoogle Scholar |
Pereira JMC, Sá ACL, Sousa AMO, Silva JMN, Santos TN, Carreiras JMB (1999) Spectral characterisation and discrimination of burnt areas. In ‘Remote Sensing of Large Wildfires in the European Mediterranean Basin’, (Ed E Chuvieco) pp. 123–138 (Springer-Verlag: Berlin).
Petropoulos GP, Vadrevu KP, Xanthopoulos G, Karantounias G, Scholza M (2010) A comparison of spectral angle mapper and artificial neural network classifiers combined with Landsat TM imagery analysis for obtaining burnt area mapping. Sensors 10, 1967–1985.
| A comparison of spectral angle mapper and artificial neural network classifiers combined with Landsat TM imagery analysis for obtaining burnt area mapping.Crossref | GoogleScholarGoogle Scholar | 22294909PubMed |
Picotte JJ, Robertson K (2011) Timing constraints on remote sensing of wildland fire burned area in the southeastern US. Remote Sensing 3, 1680–1690.
| Timing constraints on remote sensing of wildland fire burned area in the southeastern US.Crossref | GoogleScholarGoogle Scholar |
Randerson J. T., Chen Y., Werf G. R., Rogers B. M., Morton D. C. (2012) Global burned area and biomass burning emissions from small fires. Journal of Geophysical Research: Biogeosciences 117,
| Global burned area and biomass burning emissions from small fires.Crossref | GoogleScholarGoogle Scholar | 1:CAS:528:DC%2BC3sXhtFCnsLjL&md5=64a2d5bd523d6e34f01c5cdf9c37b2afCAS |
Riley KL, Abatzoglou JT, Greenfell IC, Klene AE, Heinsch FA (2013) The relationship of large fire occurrence with drought and fire danger indices in the western USA, 1984–2008: the role of temporal scale. International Journal of Wildland Fire 22, 894–909.
| The relationship of large fire occurrence with drought and fire danger indices in the western USA, 1984–2008: the role of temporal scale.Crossref | GoogleScholarGoogle Scholar |
Roy DP, Boschetti L, Justice CO, Ju J (2008) The collection 5 MODIS burned area product – global evaluation by comparison with the MODIS active fire product. Remote Sensing of Environment 112, 3690–3707.
| The collection 5 MODIS burned area product – global evaluation by comparison with the MODIS active fire product.Crossref | GoogleScholarGoogle Scholar |
Smith AMS, Wooster MJ, Powell AK, Usher D (2002) Texture based feature extraction: application to burn scar detection in Earth Observation Imagery. International Journal of Remote Sensing 23, 1733–1739.
| Texture based feature extraction: application to burn scar detection in Earth Observation Imagery.Crossref | GoogleScholarGoogle Scholar |
Smith AMS, Wooster MJ, Drake NA, Dipotso FM, Perry GLW (2005) Fire in Africa savanna: testing the impact of incomplete combustion on pyrogenic emission estimates. Ecological Applications 15, 1074–1082.
| Fire in Africa savanna: testing the impact of incomplete combustion on pyrogenic emission estimates.Crossref | GoogleScholarGoogle Scholar |
Smith AMS, Lentile LB, Hudak AT, Morgan P (2007a) Evaluation of linear spectral unmixing and dNBR for predicting post-fire recovery in a N. American ponderosa pine forest. International Journal of Remote Sensing 28, 5159–5166.
| Evaluation of linear spectral unmixing and dNBR for predicting post-fire recovery in a N. American ponderosa pine forest.Crossref | GoogleScholarGoogle Scholar |
Smith AMS, Drake NA, Wooster MJ, Hudak AT, Holden ZA, Gibbons CJ (2007b) production of Landsat ETM+ Reference imagery of burned areas within southern African savannahs: comparison of methods and application to MODIS. International Journal of Remote Sensing 28, 2753–2775.
| production of Landsat ETM+ Reference imagery of burned areas within southern African savannahs: comparison of methods and application to MODIS.Crossref | GoogleScholarGoogle Scholar |
Stringham TK, Kruger WC, Shaver PL (2003) State and transition modeling: an ecological process approach. Journal of Range Management 56, 106–113.
| State and transition modeling: an ecological process approach.Crossref | GoogleScholarGoogle Scholar |
Stroppiana D, Bordogna G, Carrara P, Boschetti M, Boschetti M, Brivio PA (2012) A method for extracting burned areas from Landsat TM/ETM plus images by soft aggregation of multiple Spectral Indices and a region growing algorithm. ISPRS Journal of Photogrammetry and Remote Sensing 69, 88–102.
| A method for extracting burned areas from Landsat TM/ETM plus images by soft aggregation of multiple Spectral Indices and a region growing algorithm.Crossref | GoogleScholarGoogle Scholar |
Sunderman SO, Weisberg PJ (2011) Remote sensing approaches for reconstructing fire perimeters and burn severity mosaics in desert spring ecosystems. Remote Sensing of Environment 115, 2384–2389.
| Remote sensing approaches for reconstructing fire perimeters and burn severity mosaics in desert spring ecosystems.Crossref | GoogleScholarGoogle Scholar |
Trigg S, Flasse S (2001) An evaluation of different bi-spectral space for discriminating burned shrub-savannah. International Journal of Remote Sensing 22, 2641–2647.
| An evaluation of different bi-spectral space for discriminating burned shrub-savannah.Crossref | GoogleScholarGoogle Scholar |
Verstraete MM, Pinty BP (1996) Designing optimal spectral indexes for remote sensing applications. IEEE Transactions on Geoscience and Remote Sensing 34, 1254–1265.
| Designing optimal spectral indexes for remote sensing applications.Crossref | GoogleScholarGoogle Scholar |
West NE, Young JA (2000) Intermountain valleys and lower mountain slopes. In ‘North American Terrestrial Vegetation’, 2nd ed. (Eds MG Barbour, WD Billings) pp. 255–284. (Cambridge University Press: Cambridge, UK)
Zheng D, Heath LS, Ducey MJ, Smith JE (2011) Carbon changes in conterminous US forests associated with growth and major disturbances: 1992–2001. Environmental Research Letters 6, 014012
| Carbon changes in conterminous US forests associated with growth and major disturbances: 1992–2001.Crossref | GoogleScholarGoogle Scholar |