Addressing data gaps in sustainability reporting: A benchmark dataset for greenhouse gas emission extraction

Beck, Jacob; Steinberg, Anna; Dimmelmeier, Andreas; Domenech Burin, Laia; Kormanyos, Emily; Fehr, Maurice; Schierholz, Malte (2025): Addressing data gaps in sustainability reporting: A benchmark dataset for greenhouse gas emission extraction. Scientific Data, 12: 1497. ISSN 2052-4463

Abstract

Abstract

Reliable company-level greenhouse gas (GHG) emissions data are essential for stakeholders addressing the climate crisis. However, existing datasets are often fragmented, inconsistent, and lack transparent methodologies, making it difficult to obtain reliable emissions data. To address this challenge, we present a gold standard dataset containing emission metrics extracted from 139 sustainability reports collected from company websites. This dataset acts as an intermediate step to validate and fine-tune models for large-scale extraction of emissions data from thousands of reports. We employ a Large Language Model (LLM)-powered extraction pipeline to automatically extract emissions metrics. These values are then independently assessed by two non-expert annotators. Reports with full agreement are directly considered gold standard, while discrepancies undergo expert review in two stages, with remaining disagreements resolved through in-person discussions. This structured process ensures high data quality while reducing reliance on experts. Our dataset serves as a benchmark for human and automated annotation, with significant reuse potential for information extraction tasks in sustainable finance as well as other downstream tasks such as greenwashing analysis.

• Dokumententyp: Artikel (LMU)
• Organisationseinheit (Fakultäten): 16 Mathematik, Informatik und Statistik > Statistik
• DFG-Fachsystematik der Wissenschaftsbereiche: Geistes- und Sozialwissenschaften
• DFG: Gefördert durch die Deutsche Forschungsgemeinschaft (DFG) - 460037581
• DFG: Gefördert durch die Deutsche Forschungsgemeinschaft (DFG) - 491502892