Techniques for evaluating wildfire simulators via the simulation of historical fires using the Australis simulator
Joel K. Kelso A B , Drew Mellor A , Mary E. Murphy A and George J. Milne AA School of Computer Science and Software Engineering, University of Western Australia, M002, 35 Stirling Highway, Crawley, WA 6009, Australia.
B Corresponding author. Email: joel.kelso@uwa.edu.au
International Journal of Wildland Fire 24(6) 784-797 https://doi.org/10.1071/WF14047
Submitted: 27 March 2014 Accepted: 15 March 2015 Published: 11 June 2015
Abstract
A methodology for validating fire spread simulation systems using historical fire data is presented. The key features of this methodology are (a) quantitative comparison between simulator-generated fire perimeters and fire perimeters from an independently produced fire reconstruction at multiple time points during the fire, and (b) extensive sensitivity analyses on simulation variables including simulation spatial resolution, weather, vegetation coverage and fire behaviour model selection to determine the effect of each simulation input on the simulation output. The methodology is demonstrated in a case study in which the ability of the Australis high-performance wildfire simulator to replicate a large wildfire in Western Australia was examined. Simulation accuracy was found to be lower in extreme fire danger conditions and exhibited under-prediction of the head fire rate of spread. This was caused by inaccuracies in at least one of wind speed data, vegetation data or the fire behaviour model applied; however, the source of the inaccuracy could not be further diagnosed with the available data. The gathering of accurate data during and after active wildfires would facilitate more rigorous simulator and fire behaviour model validation studies as well as more accurate prediction of ‘live’ wildfires.
Additional keywords: Boorabbin Fire, fire spread simulation, Geographic Information System (GIS), validation.
References
Achtemeier GL (2013) Field validation of a free-agent cellular automata model of fire spread with fire–atmosphere coupling. International Journal of Wildland Fire 22, 148–156.| Field validation of a free-agent cellular automata model of fire spread with fire–atmosphere coupling.Crossref | GoogleScholarGoogle Scholar |
Arca B, Duce P, Laconi M, Pellizzaro G, Salis M, Spano D (2007) Evaluation of FARSITE simulator in Mediterranean maquis. International Journal of Wildland Fire 16, 563–572.
| Evaluation of FARSITE simulator in Mediterranean maquis.Crossref | GoogleScholarGoogle Scholar |
Bureau of Meteorology (2008) Meteorological aspects of the Boorabbin Fire (28 December 2007–8 January 2008). Western Australian Regional Office, Bureau of Meteorology, Perth, WA. Available at http://www.bom.gov.au/wa/sevwx/fire/20071228/boorabbin_fire_rpt.pdf [Verified 18 May 2012].
Burrows ND, Ward B, Robinson A (2009) Fuel dynamics and fire spread in spinifex grasslands of the Western Desert. Proceedings of the Royal Society of Queensland 115, 69–76. [Verified 8 July 2014].http://search.informit.com.au/documentSummary;dn=590969984229226;res=IELHSS
Catchpole W, Bradstock R, Choate J, Fogarty L, Gellie N, McCarthy G, McCaw L, Marsden-Smedley J, Pearce G (1998) Cooperative development of prediction equations for heathland fire behaviour. In ‘Proceedings of the 3rd International Conference on Forest Fire Research and 14th Conference on Fire and Forest Meteorology’, 16–20 November 1998, Coimbra, Portugal. (Ed. DX Viegas) Associação para o Desenvolvimento da Aerodinâmica Industrial (ADAI), pp. 631–645. (Coimbra, Portugal)
Cheney NP (2010) Fire behaviour during the Pickering Brook wildfire, January 2005 (Perth Hills Fires 71–80). Conservation Science Western Australia 7, 451–468.
Cheney P, Sullivan A (2008) ‘Grassfires: Fuel, Weather and Fire Behaviour.’ (CSIRO Publishing: Collingwood)
Coleman JR, Sullivan AL (1996) A real-time computer application for the prediction of fire spread across the Australian landscape. Simulation 67, 230–240.
| A real-time computer application for the prediction of fire spread across the Australian landscape.Crossref | GoogleScholarGoogle Scholar |
Congalton RG, Green K (1999) ‘Assessing the Accuracy of Remotely Sensed Data: Principles and Practices.’ (CRC Press: Boca Raton, FL)
Cruz MG, Matthews S, Gould J, Ellis P, Henderson M, Knight I, Watters J (2010) Fire dynamcis in mallee–heath: fuel, weather and fire behaviour prediction in South Australian semi-arid shrublands. Bushfire CRC. Available at http://www.bushfirecrc.com/resources/research-report/report-fire-dynamics-mallee-heath [Verified 8 July 2014].
de Berg M, Cheong O, van Kreveld M, Overmars M (2008) ‘Computational Geometry.’ (Springer: Berlin)
de Mar P (2008) Goldfields Fire 13 (Boorabbin Fire) – Fire Development Chronology. GHD Pty Ltd, Sydney. Available at http://www.dec.wa.gov.au/pdf/boorabbin/goldfields_fire_13_chronology.pdf [Accessed 8 July 2014].
Farr TG, Rosen PA, Caro E, Crippen R, Duren R, Hensley S, Kobrick M, Paller M, Rodriguez E, Roth L, Seal D, Shaffer S, Shimada J, Umland J, Werner M, Oskin M, Burbank D, Alsdorf D (2007) The Shuttle Radar Topography Mission. Reviews of Geophysics 45, RG2004
| The Shuttle Radar Topography Mission.Crossref | GoogleScholarGoogle Scholar |
Filippi J-B, Mallet V, Nader B (2014) Representation and evaluation of wildfire propagation simulations. International Journal of Wildland Fire 23, 46–57.
| Representation and evaluation of wildfire propagation simulations.Crossref | GoogleScholarGoogle Scholar |
Finney MA (1994) Modeling the spread and behavior of prescribed natural fires. In ‘Proceedings of the 12th International Conference on Fire and Forest Meteorology’, 26–28 October 1993, Jekyll Island, GA. Society of American Foresters, pp. 138–143 (Bethesda, MD)
Finney MA (2000) Efforts at comparing simulated and observed fire growth patterns. Systems for Environmental Management, Missoula, MT. Available at http://www.firemodels.org/downloads/farsite/publications/Finney_2000_FarsiteValidation_FinalReport.pdf [Verified 8 July 2014].
Finney MA (2002) Fire growth using minimum travel time methods. Canadian Journal of Forest Research 32, 1420–1424.
| Fire growth using minimum travel time methods.Crossref | GoogleScholarGoogle Scholar |
Finney MA (2004) FARSITE: fire area simulator – model development and evaluation. USDA Forest Service, Rocky Mountain Research Station, RMRS-RP-4, revised (Missoula, MT).
Finney MA, Ryan KC (1995) Use of the FARSITE fire growth model for fire prediction in U.S. national parks. In ‘The International Emergency Management and Engineering Conference’, 9–12 May 1995, Nice, France. (Eds JD Sullivan, JL Wybo, L Buisson) The International Emergency Management and Engineering Society, pp. 183–189 (Dallas, TX)
Gould JS, McCaw WL, Cheney NP, Ellis PF, Knight IK, Sullivan AL (2007) ‘Project Vesta – Fire in Dry Eucalypt Forest: Fuel Structure, Fuel Dynamics and Fire Behaviour.’ (Ensis–CSIRO: Canberra).
Hernández Encinas L, Hoya White S, Martin del Rey A, Rodríguez Sánchez G (2007) Modelling forest fire spread using hexagonal cellular automata. Applied Mathematical Modelling 31, 1213–1227.
| Modelling forest fire spread using hexagonal cellular automata.Crossref | GoogleScholarGoogle Scholar |
Johnston P, Kelso J, Milne GJ (2008) Efficient simulation of wildfire spread on an irregular grid. International Journal of Wildland Fire 17, 614–627.
| Efficient simulation of wildfire spread on an irregular grid.Crossref | GoogleScholarGoogle Scholar |
Kourtz PH, O’Regan WG (1971) A model for a small forest fire. to simulate burned and burning areas for use in a detection model. Forest Science 17, 163–169.
Lagae A, Dutré P (2008) A comparison of methods for generating Poisson disk distributions. Computer Graphics Forum 27, 114–129.
| A comparison of methods for generating Poisson disk distributions.Crossref | GoogleScholarGoogle Scholar |
Linn R, Reisner J, Colman JJ, Winterkamp J (2002) Studying wildfire behavior using FIRETEC. International Journal of Wildland Fire 11, 233–246.
| Studying wildfire behavior using FIRETEC.Crossref | GoogleScholarGoogle Scholar |
Lopes AMG, Cruz MG, Viegas DX (2002) FireStation – an integrated software system for the numerical simulation of fire spread on complex topography. Environmental Modelling & Software 17, 269–285.
| FireStation – an integrated software system for the numerical simulation of fire spread on complex topography.Crossref | GoogleScholarGoogle Scholar |
Luke RH, McArthur AG (1978) ‘Bushfires in Australia.’ (Australian Government Publishing Service: Canberra)
Matthews S, Gould J, McCaw L (2010) Simple models for predicting dead fuel moisture in eucalyptus forests. International Journal of Wildland Fire 19, 459–467.
| Simple models for predicting dead fuel moisture in eucalyptus forests.Crossref | GoogleScholarGoogle Scholar |
McArthur AG (1966) ‘Weather and Grassland Fire Behaviour.’ (Forest Research Institute, Forestry and Timber Bureau of Australia: Canberra)
McArthur AG (1967) ‘Fire Behaviour in Eucalypt Forests.’ (Forest Research Institute, Forestry and Timber Bureau of Australia: Canberra)
McCaw L (1997) Predicting fire spread in Western Australia mallee–heath shrubland. PhD thesis, University of New South Wales.
Mell W, Jenkins MA, Gould J, Cheney P (2007) A physics-based approach to modelling grassland fires. International Journal of Wildland Fire 16, 1–22.
| A physics-based approach to modelling grassland fires.Crossref | GoogleScholarGoogle Scholar |
Miller JD, Yool SR (2002) Modeling fire in semi-desert grassland/oak woodland: the spatial implications. Ecological Modelling 153, 229–245.
| Modeling fire in semi-desert grassland/oak woodland: the spatial implications.Crossref | GoogleScholarGoogle Scholar |
Noble IR, Gill AM, Bary GAV (1980) McArthur’s fire-danger meters expressed as equations. Australian Journal of Ecology 5, 201–203.
| McArthur’s fire-danger meters expressed as equations.Crossref | GoogleScholarGoogle Scholar |
Perry GLW, Sparrow AD, Owens IF (1999) A GIS-supported model for the simulation of the spatial structure of wildland fire, Cass Basin, New Zealand. Journal of Applied Ecology 36, 502–518.
| A GIS-supported model for the simulation of the spatial structure of wildland fire, Cass Basin, New Zealand.Crossref | GoogleScholarGoogle Scholar |
Santoni P-A, Filippi J-B, Balbi J-H, Bosseur F (2011) Wildland fire behaviour case studies and fuel models for landscape-scale fire modeling. Journal of Combustion 2011, 613424
| Wildland fire behaviour case studies and fuel models for landscape-scale fire modeling.Crossref | GoogleScholarGoogle Scholar |
Schönfisch B (1997) Anisotropy in cellular automata. Bio Systems 41, 29–41.
| Anisotropy in cellular automata.Crossref | GoogleScholarGoogle Scholar | 9043675PubMed |
Sirakoff C (1985) A correction to the equations describing the McArthur forest fire danger meter. Australian Journal of Ecology 10, 481
| A correction to the equations describing the McArthur forest fire danger meter.Crossref | GoogleScholarGoogle Scholar |
Sullivan AL (2009a) Wildland surface fire spread modelling, 1990–2007. 1: Physical and quasi-physical models. International Journal of Wildland Fire 18, 349–368.
| Wildland surface fire spread modelling, 1990–2007. 1: Physical and quasi-physical models.Crossref | GoogleScholarGoogle Scholar |
Sullivan AL (2009b) Wildland surface fire spread modelling, 1990–2007. 2: Empirical and quasi-empirical models. International Journal of Wildland Fire 18, 369–386.
| Wildland surface fire spread modelling, 1990–2007. 2: Empirical and quasi-empirical models.Crossref | GoogleScholarGoogle Scholar |
Sullivan AL (2009c) Wildland surface fire spread modelling, 1990–2007. 3: Simulation and mathematical analogue models. International Journal of Wildland Fire 18, 387–403.
| Wildland surface fire spread modelling, 1990–2007. 3: Simulation and mathematical analogue models.Crossref | GoogleScholarGoogle Scholar |
Sullivan A, Knight I (2004) A hybrid cellular automata/semi-physical model of fire growth, In ‘Complex 2004, Proceedings of 7th Asia-Pacific Complex Systems Conference’, 6–10 December 2004, Cairns. Central Queensland University, pp. 64–73 (Rockhampton, Qld)
Tymstra C, Bryce RW, Wotton BM, Taylor SW, Armitage OB (2010) Development and structure of Prometheus: the Canadian wildland fire growth simulation model. Canadian Forest Service, Northern Forestry Centre, NOR-X-417 (Edmonton, AB). Available at http://cfs.nrcan.gc.ca/bookstore_pdfs/31775.pdf [Verified 8 July 2014].
Viney NR (1991) A review of fine fuel moisture modelling. International Journal of Wildland Fire 1, 215–234.
| A review of fine fuel moisture modelling.Crossref | GoogleScholarGoogle Scholar |
Zeigler BP, Praehofer H, Ki TG (2000) ‘Theory of Modelling and Simulation: Integrating Discrete Event and Continuous Complex Dynamic Systems.’ (Academic Press: San Diego, CA)