Register      Login
Soil Research Soil Research Society
Soil, land care and environmental research
RESEARCH ARTICLE

Organic farming does not increase soil organic carbon compared to conventional farming if there is no carbon transfer from other agroecosystems. A meta-analysis

Roberto Alvarez https://orcid.org/0000-0002-4149-4508 A *
+ Author Affiliations
- Author Affiliations

A Facultad de Agronomía, Universidad de Buenos Aire-CONICET, Av. San Martín 4453 (1417), Buenos Aires, Argentina.

* Correspondence to: ralvarez@agro.uba.ar

Handling Editor: Maria Cayuela

Soil Research 60(3) 211-223 https://doi.org/10.1071/SR21098
Submitted: 9 April 2021  Accepted: 29 September 2021   Published: 17 November 2021

© 2022 The Author(s) (or their employer(s)). Published by CSIRO Publishing

Abstract

Context: Organic farming is based on the non-use of synthetic fertilisers and pesticides. Nitrogen inputs are derived from symbiotic fixation and organic fertilisers, which also contribute carbon to the agroecosystem. Soil organic carbon (SOC) generally increases in organically managed soils, but it is unclear whether the increase is due to carbon transfer from off-site or can be achieved without carbon transfer from other production systems.

Aims: This study aims to determine how carbon transfer is achieved to increase SOC under organic farming systems.

Methods: A meta-analysis was conducted to answer this question using articles published in peer-reviewed journals in which the results of randomised and replicated experiments were available. Data were collected from 66 experiments that generated 83 direct comparisons of organic vs conventional management. The data were divided into three groups: no carbon transfer between agroecosystems (no off-site effects, n = 15), with carbon transfer (off-site effects, n = 43), and undefined carbon management (n = 25). The response ratio was used as the effect size and the 95% confidence interval was calculated.

Key results: In experiments with no off-site effects, SOC did not differ between organic and conventional systems. In contrast, in experiments where manure-compost was transferred to organic systems from off-site or crop residues were harvested in conventional treatment, SOC was 22% higher in organic system.

Conclusions: These results indicate that organic farming increases SOC only when carbon is transferred between agroecosystems.

Implications: Off-site effects should be considered when addressing the carbon sequestration potential of organic farming.

Keywords: carbon sequestration, carbon transfer, conventional farming, meta-analysis, off-site effects, organic farming, organic fertilisers, soil management.


References

Adams DC, Gurevitch J, Rosenberg MS (1997) Resampling tests for meta-analysis of ecological data. Ecology 78, 1277–1283.
Resampling tests for meta-analysis of ecological data.Crossref | GoogleScholarGoogle Scholar |

Aguilera E, Lassaletta L, Gattinger A, Gimeno BS (2013) Managing soil carbon for climate change mitigation and adaptation in Mediterranean cropping systems: a meta-analysis. Agriculture, Ecosystems and Environment 168, 25–36.
Managing soil carbon for climate change mitigation and adaptation in Mediterranean cropping systems: a meta-analysis.Crossref | GoogleScholarGoogle Scholar |

Alvarez R (2021) Comparing productivity of organic and conventional farming systems: a quantitative review. Archives of Agronomy and Soil Science
Comparing productivity of organic and conventional farming systems: a quantitative review.Crossref | GoogleScholarGoogle Scholar |

Alvarez R, Steinbach HS, De Paepe JL (2017) Cover crop effects on soils and subsequent crops in the pampas: a meta-analysis. Soil and Tillage Research 170, 53–65.
Cover crop effects on soils and subsequent crops in the pampas: a meta-analysis.Crossref | GoogleScholarGoogle Scholar |

Andrén O, Kátterer T, Kirchmann H (2008) How will conversion to organic cereal production affect carbon stocks in Swedish agricultural soils? In ‘Organic crop production-ambitions and limitations’. (Eds H Kirchmann, L Bergströn) pp 161–172. (Springer, Dordrecht, The Netherlands)

Bernal MP, Albuquerque JA, Moral R (2009) Composting of animal manures and chemical criteria for compost maturity assessment. a review. Bioresource Technology 100, 5444–5453.
Composting of animal manures and chemical criteria for compost maturity assessment. a review.Crossref | GoogleScholarGoogle Scholar | 19119002PubMed |

Berry PM, Sylvester-Bradley R, Philips L, Hatchs DJ, Cuttle SP, Rayns FW, Gosling P (2002) Is the productivity of organic farms restricted by the supply of available nitrogen? Soil Use and Management 18, 248–255.

Blanco-Canqui H, Francis CA, Galusha TD (2017) Does organic farming accumulate carbon in deeper soil profiles in the long term. Geoderma 288, 213–221.
Does organic farming accumulate carbon in deeper soil profiles in the long term.Crossref | GoogleScholarGoogle Scholar |

Borenstein M, Hedges LV, Higgins JP, Rothsein HR (2009) ‘Introduction to meta-analysis’. p. 421. (Wiley: UK)

Brock C, Oberholzer H-R, Schwarz J, Fließbach A, Hülsbergen K-J, Koch W, Palurt B, Reinicke F, Leithold G (2012) Soil organic matter balances in organic versus conventional farming—modelling in field experiments and regional upscaling for cropland in Germany. Organic Agriculture 2, 185–195.
Soil organic matter balances in organic versus conventional farming—modelling in field experiments and regional upscaling for cropland in Germany.Crossref | GoogleScholarGoogle Scholar |

Connor DJ (2008) Organic agriculture cannot feed the world. Field Crops Research 106, 187–190.
Organic agriculture cannot feed the world.Crossref | GoogleScholarGoogle Scholar |

Crystal-Ornelas R, Thapa R, Tully KL (2021) Soil organic carbon is affected by organic amendments, conservation tillage, and cover cropping in organic farming systems. A meta-analysis. Agriculture, Ecosystems & Environment 312, 107356
Soil organic carbon is affected by organic amendments, conservation tillage, and cover cropping in organic farming systems. A meta-analysis.Crossref | GoogleScholarGoogle Scholar |

García-Palacios P, Gattinger A, Bracht-Jøergensen H, Brussard L, Carvalho F, Castro H, Clément J-C, De Deyn G, D’Hertefeldt T, Foulquier A, Hedlung K, Lavorel S, Legay N, Lori M, Mäder P, Martínez-García LB, Martins da Silva P, Muller A, Nascimento E, Reis F, Symanczik S, Sousa JP, Milla R (2018) Crop traits drive soil carbon sequestration under organic farming. Journal of Applied Ecology 55, 2496–2505.
Crop traits drive soil carbon sequestration under organic farming.Crossref | GoogleScholarGoogle Scholar |

Gattinger A, Muller A, Haeni M, Skinner C, Fliessbach A, Buchmann N, Mäder P, Stolze M, Smith P, El-Hage Scialabba N, Niggli U (2012) Enhance top soil carbon stocks under organic farming. Proceedings of the National Academy of Science 109, 18226–18231.
Enhance top soil carbon stocks under organic farming.Crossref | GoogleScholarGoogle Scholar |

Gurevitch J, Hedges LV (1999) Statistical issues in ecological meta-analysis. Ecology 80, 1142–1149.
Statistical issues in ecological meta-analysis.Crossref | GoogleScholarGoogle Scholar |

Gurevitch J, Hedges LV (2001) Meta-analysis. Combining the results of independent experiments. In ‘Design and analysis of ecological experiments’. (Eds SM Scheiner, J Gurevitch) pp. 347–369. (Oxford University Press)

Hedges LV, Gurevitch J, Curtis PS (1999) The meta-analysis of response ratios in experimental ecology. Ecology 80, 1150–1156.
The meta-analysis of response ratios in experimental ecology.Crossref | GoogleScholarGoogle Scholar |

Hedges LV, Olkin I (1985) ‘Statistical methods for meta-analysis’. p. 369. (Academic Press, London)

Hughner RS, McDonagh P, Prothero A, Schultz CJ, Stanton J (2007) Who are organic food consumers? A compilation and review of why people purchase organic food. Journal of Consumer Behavior 6, 94–110.
Who are organic food consumers? A compilation and review of why people purchase organic food.Crossref | GoogleScholarGoogle Scholar |

Jennions MD, Lortie CJ, Rosenberg MS, Rothstein HR (2013) Publication and related bias. In ‘Handbook of meta-analysis in ecology and evolution’. (Eds J Koricheva, J Gurevich, K Mengersen) pp. 207–236. (Princeton University Press, Princeton, New Jersey, USA)

Kallenbach C, Grandy AS (2011) Controls over soil microbial biomass responses to carbon amendments in agricultural systems: a meta-analysis. Agriculture, Ecosystems & Environment 144, 241–252.
Controls over soil microbial biomass responses to carbon amendments in agricultural systems: a meta-analysis.Crossref | GoogleScholarGoogle Scholar |

Kirchmann H, Bergsteöm L, Kätterer T, Andrén O, Andersson R (2008) Can organic crop production feed the world? In ‘Organic crop production-ambitions and limitations’. (Eds H Kirchmann, L Bergsteöm) pp. 39–72, (Springer: Dordrecht, The Netherlands)

Kirchmann H, Kätterer T, Bergström L, Börjesson G, Bolinder MA (2016) Flaws and criteria for design and evaluation of comparative organic and conventional cropping systems. Field Crops Research 186, 99–106.
Flaws and criteria for design and evaluation of comparative organic and conventional cropping systems.Crossref | GoogleScholarGoogle Scholar |

Kopittke PM, Dalal RC, Finn D, Menzies NW (2017) Global changes in soil stocks of carbon, nitrogen, phosphorus, and sulphur as influenced by long-term agricultural production. Global Change Biology 23, 2509–2519.
Global changes in soil stocks of carbon, nitrogen, phosphorus, and sulphur as influenced by long-term agricultural production.Crossref | GoogleScholarGoogle Scholar | 27670741PubMed |

Lajeunesse MJ (2013) Recovering missing or partial data from studies: a survey of conversions and imputations for meta-analysis. In ‘Handbook of meta-analysis in ecology and evolution’. (Eds J Koricheva, J Gurevich, K Mengersen) pp. 195–206. (Princeton University Press, Princeton, New Jersey, USA)

Leifeld J, Angers DA, Chenu C, Fuhrer J, Kätterer T, Powlson DS (2013) Organic farming gives no climate change benefit through soil carbon sequestration. Proceedings of the National Academy of Science 110, E984
Organic farming gives no climate change benefit through soil carbon sequestration.Crossref | GoogleScholarGoogle Scholar |

Leifeld J, Fuhrer J (2010) Organic farming and soil carbon sequestration: what do we really know about benefits? AMBIO 39, 585–599.
Organic farming and soil carbon sequestration: what do we really know about benefits?Crossref | GoogleScholarGoogle Scholar | 21141778PubMed |

Leithold G, Hülsbergen K-J, Brock C (2015) Organic matter returns to soils must be higher under organic compared to conventional farming. Journal of Plant Nutrition and Soil Science 178, 4–12.
Organic matter returns to soils must be higher under organic compared to conventional farming.Crossref | GoogleScholarGoogle Scholar |

Liu C, Lu M, Cui J, Li B, Fang C (2014) Effects of straw carbon input on carbon dynamics in agricultural soils: a meta-analysis. Global Change Biology 20, 1366–1381.
Effects of straw carbon input on carbon dynamics in agricultural soils: a meta-analysis.Crossref | GoogleScholarGoogle Scholar | 24395454PubMed |

Lorenz K, Lal R (2016) Environmental impact of organic agriculture. Advances in Agronomy 139, 99–152.
Environmental impact of organic agriculture.Crossref | GoogleScholarGoogle Scholar |

Luo Y, Hui D, Zhang D (2006) Elevated CO2 stimulates net accumulation of carbon and nitrogen in land ecosystems: a meta-analysis. Ecology 87, 53–63.
Elevated CO2 stimulates net accumulation of carbon and nitrogen in land ecosystems: a meta-analysis.Crossref | GoogleScholarGoogle Scholar | 16634296PubMed |

Luo Z, Wang E, Sun OJ (2010) Can no-tillage stimulate carbon sequestration in agricultural soils? A meta-analysis of paired experiments. Agriculture, Ecosystems & Environment 139, 224–231.
Can no-tillage stimulate carbon sequestration in agricultural soils? A meta-analysis of paired experiments.Crossref | GoogleScholarGoogle Scholar |

Maillard É, Angers DA (2014) Animal manure application and soil organic carbon stocks: a meta-analysis. Global Change Biology 20, 666–679.
Animal manure application and soil organic carbon stocks: a meta-analysis.Crossref | GoogleScholarGoogle Scholar | 24132954PubMed |

Meemken E-M, Qaim M (2018) Organic agriculture, food security, and the environment. Annual Review of Resource Economics 10, 39–63.
Organic agriculture, food security, and the environment.Crossref | GoogleScholarGoogle Scholar |

Migliorini P, Wezel A (2017) Converging and diverging principles and practices of organic agriculture regulations and agroecology. A review. Agronomy for Sustainable Development 37, 63
Converging and diverging principles and practices of organic agriculture regulations and agroecology. A review.Crossref | GoogleScholarGoogle Scholar |

Mondelaers K, Aertsen J, Van Huylenbroeck G (2009) A meta-analysis of the differences in environmental impacts between organic and conventional farming. British Food Journal 111, 1098–1119.
A meta-analysis of the differences in environmental impacts between organic and conventional farming.Crossref | GoogleScholarGoogle Scholar |

Nelson DW, Sommers LE (1996) Total carbon, organic carbon, and organic matter. In ‘Methods of soil analysis. Part 3: chemical methods’. SSSA Book Series 5. (Ed. DL Sparks, AL Page, PA Helmke, et al.). (SSSA: Madison, USA)
| Crossref |

Noble DWA, Lagisz M, O’dea RE, Nakagawa S (2017) Nonindependence and sensitivity analyses in ecological and evolutionary meta-analyses. Molecular Ecology 26, 2410–2425.
Nonindependence and sensitivity analyses in ecological and evolutionary meta-analyses.Crossref | GoogleScholarGoogle Scholar | 28133832PubMed |

Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, Moher D (2021) The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 372, n71
The PRISMA 2020 statement: an updated guideline for reporting systematic reviews.Crossref | GoogleScholarGoogle Scholar | 33782057PubMed |

Poeplau C, Don A (2015) Carbon sequestration in agricultural soils via cultivation of cover crops-a meta-analysis. Agriculture, Ecosystems & Environment 200, 33–41.
Carbon sequestration in agricultural soils via cultivation of cover crops-a meta-analysis.Crossref | GoogleScholarGoogle Scholar |

Post WM, Kwon KC (2000) Soil carbon sequestration and land use change: processes and potential. Global Change Biology 6, 317–327.
Soil carbon sequestration and land use change: processes and potential.Crossref | GoogleScholarGoogle Scholar |

Poulton P, Johnston J, Macdonald A, White R, Powlson D (2018) Major limitations to achieving ‘4 per 1000’ increases in soil prganic carbon stock in temperate regions: Evidence from long-term experiments at Rothamsted Research, United Kingdon. Global Change Biology 24, 2563–2584.
Major limitations to achieving ‘4 per 1000’ increases in soil prganic carbon stock in temperate regions: Evidence from long-term experiments at Rothamsted Research, United Kingdon.Crossref | GoogleScholarGoogle Scholar | 29356243PubMed |

Powlson DS, Whitmore AP, Goulding KWT (2011) Soil carbon sequestration to mitigate climate change: a critical re-examination to identify the true and the false. European Journal of Soil Science 62, 42–55.
Soil carbon sequestration to mitigate climate change: a critical re-examination to identify the true and the false.Crossref | GoogleScholarGoogle Scholar |

Reeve JR, Hoagland LA, Villalba JJ, Carr PM, Atucha A, Cambardela C, Davis DR, Delate K (2016) Organic farming, soil health, and food quality: considering possible links. Advances in Agronomy 137, 319–367.
Organic farming, soil health, and food quality: considering possible links.Crossref | GoogleScholarGoogle Scholar |

Rosenberg MS, Adams DC, Gurevitch J (2000) MetaWin. Statistical software for meta-analysis, version 2.0. Sinauer Associates Sunderland, MA, USA. p. 133.

Schlesinger WH (2000) Carbon sequestration in soils: some cautions amidst optimism. Agriculture, Ecosystems & Environment 82, 121–127.
Carbon sequestration in soils: some cautions amidst optimism.Crossref | GoogleScholarGoogle Scholar |

Sharma P, Laor Y, Raviv M, Medina S, Saadi I, Krasnovsky A, Vager M, Levy G, Bartal A, Borisolver M (2017a) Green manure as part of organic management cycle: effects on changes in organic matter characteristics across the soil profile. Geoderma 305, 197–207.
Green manure as part of organic management cycle: effects on changes in organic matter characteristics across the soil profile.Crossref | GoogleScholarGoogle Scholar |

Sharma P, Laor Y, Raviv M, Medina S, Saadi I, Krasnovsky A, Vager M, Levy G, Bartal A, Borisolver M (2017b) Compositional characteristics of organic matter and its water-extractable components across a profile of organically managed soil. Geoderma 286, 73–82.
Compositional characteristics of organic matter and its water-extractable components across a profile of organically managed soil.Crossref | GoogleScholarGoogle Scholar |

Song C, Peacor SD, Osenberg CW, Bence JR (2020) An assessment of statistical methods for nonindependent data in ecological meta-analysis. Ecology 101, e03184
An assessment of statistical methods for nonindependent data in ecological meta-analysis.Crossref | GoogleScholarGoogle Scholar | 32893349PubMed |

Steinbach HS, Alvarez R (2006) Changes in soil organic carbon contents and nitrous oxide emissions alter introduction of no till in Pampean agroecosystems. Journal of Environmental Quality 35, 3–13.
Changes in soil organic carbon contents and nitrous oxide emissions alter introduction of no till in Pampean agroecosystems.Crossref | GoogleScholarGoogle Scholar | 16391272PubMed |

Te Pas CM, Rees RM (2014) Analysis of differences in productivity, profitability and soil fertility between organic and conventional cropping systems in the tropics and sub-tropics. Journal of Integrative Agriculture 13, 2299–2310.
Analysis of differences in productivity, profitability and soil fertility between organic and conventional cropping systems in the tropics and sub-tropics.Crossref | GoogleScholarGoogle Scholar |

Tian K, Zhao Y, Xu X, Hai N, Huang B, Deng W (2015) Effects of long-term fertilization and residue management on soil organic carbon changes in paddy soils of China: a meta-analysis. Agriculture, Ecosystems & Environment 204, 40–50.
Effects of long-term fertilization and residue management on soil organic carbon changes in paddy soils of China: a meta-analysis.Crossref | GoogleScholarGoogle Scholar |

Tuomisto HL, Hodge ID, Riordan P, Macdonald DW (2012) Does organic farming reduce environmental impacts? – A meta-analysis of European research. Journal of Environmental Management 112, 309–320.
Does organic farming reduce environmental impacts? – A meta-analysis of European research.Crossref | GoogleScholarGoogle Scholar | 22947228PubMed |

Ugarte CM, Kwon H, Andrews SS, Wander MM (2014) A meta-analysis of soil organic matter response to soil management practices: an approach to evaluate conservation indicators. Journal of Soil and Water Conservation 69, 422–430.
A meta-analysis of soil organic matter response to soil management practices: an approach to evaluate conservation indicators.Crossref | GoogleScholarGoogle Scholar |

Velthof GL, Bannink A, Oenema O, van der Meer HG, Spoelstra SF (2000) Relationships between animal nutrition and manure quality. A literature review on C, N, P and S compounds. Alterra, Green World Research, Wageningen, p. 43.

Wander MM, Yun W, Goldstein WA, Aref S, Khan SA (2007) Organic N and particulate organic matter fractions in organic and conventional farming systems with a history of manure application. Plant and Soil 291, 311–321.
Organic N and particulate organic matter fractions in organic and conventional farming systems with a history of manure application.Crossref | GoogleScholarGoogle Scholar |

Weir CJ, Butcher I, Assi V, Lewis SC, Murray GD, Langhome P, Brady MC (2018) Dealing with missing standard deviation and mean values in meta-analysis of continuous outcomes: a systematic review. BMC Medical Research Methodology 18, 25
Dealing with missing standard deviation and mean values in meta-analysis of continuous outcomes: a systematic review.Crossref | GoogleScholarGoogle Scholar | 29514597PubMed |

West TO, Post WM (2002) Soil organic carbon sequestration rates by tillage and crop rotation. Soil Science Society of America Journal 66, 1930–1946.
Soil organic carbon sequestration rates by tillage and crop rotation.Crossref | GoogleScholarGoogle Scholar |

Wiebe N, Vandermeer B, Platt RW, Klassen TP, Moher D, Barrowman NJ (2006) A systematic review identifies a lack of standardization in methods for handling missing variance data. Journal of Clinical Epidemiology 59, 342–353.
A systematic review identifies a lack of standardization in methods for handling missing variance data.Crossref | GoogleScholarGoogle Scholar | 16549255PubMed |

Wolf J, Asrar GR, West TO (2017) Revised methane emissions factors and spatially distributed annual carbon fluxes for global livestock. Carbon Balance and Management 12, 16
Revised methane emissions factors and spatially distributed annual carbon fluxes for global livestock.Crossref | GoogleScholarGoogle Scholar | 28959823PubMed |

Yanai RD, Stehman SV, Arthur MA, Prescott CE, Friedland AJ, Siccama TG, Binkley D (2003) Detecting change in forest floor carbon. Soil Science Society of America Journal 67, 1583–1593.
Detecting change in forest floor carbon.Crossref | GoogleScholarGoogle Scholar |

Zavattaro L, Bechini L, Grignani C, van Evert FK, Mallast J, Spiegel H, Sandén T, Pecio A, Giraldez Cervera JV, Guzmán G, Vanderlinden K, D’Hose T, Ruysschaert G, ten Berge HFM (2017) Agronomic effects of bovine manure: a review of long-term European field experiments. European Journal of Agronomy 90, 127–138.
Agronomic effects of bovine manure: a review of long-term European field experiments.Crossref | GoogleScholarGoogle Scholar |

Zhao X, Zhang R, Xue J-F, Pu C, Zhang X-Q, Liu S-L, Chen F, Lal R, Zhang H-L (2015) Management-induced changes to soil organic carbon in China: a meta-analysis. Advances in Agronomy 134, 1–50.
Management-induced changes to soil organic carbon in China: a meta-analysis.Crossref | GoogleScholarGoogle Scholar |