EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Early Crop Classification via Multi-Modal Satellite Data Fusion and Temporal Attention

Frank Weilandt, Robert Behling, Romulo Goncalves, Arash Madadi, Lorenz Richter, Tiago Sanona, Daniel Spengler, Jona Welsch

Remote Sensing · 31.01.2023 · 15 (3) · 799

DOI: 10.3390/rs15030799 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 31.01.2023. Verfasst von Frank Weilandt und 7 weiteren Autor:innen. Die Arbeit wurde bisher 54-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: “Central Innovation Programme for small and medium-sized enterprises (ZIM)” of the German Federal Ministry for Economic Affairs and Climate Action.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this article, we propose a deep learning-based algorithm for the classification of crop types from Sentinel-1 and Sentinel-2 time series data which is based on the celebrated transformer architecture. Crucially, we enable our algorithm to do early classification, i.e., predict crop types at arbitrary time points early in the year with a single trained model (progressive intra-season classification). Such early season predictions are of practical relevance for instance for yield forecasts or the modeling of agricultural water balances, therefore being important for the public as well as the private sector. Furthermore, we improve the mechanism of combining different data sources for the prediction task, allowing for both optical and radar data as inputs (multi-modal data fusion) without the need for temporal interpolation. We can demonstrate the effectiveness of our approach on an extensive data set from three federal states of Germany reaching an average F1 score of 0.92 using data of a complete growing season to predict the eight most important crop types and an F1 score above 0.8 when doing early classification at least one month before harvest time. In carefully chosen experiments, we can show that our model generalizes well in time and space.

Förderung

  • “Central Innovation Programme for small and medium-sized enterprises (ZIM)” of the German Federal Ministry for Economic Affairs and Climate Action

Zitieren

APA

Weilandt, F., Behling, R., Goncalves, R., Madadi, A., Richter, L., Sanona, T., Spengler, D., & Welsch, J. (2023). Early Crop Classification via Multi-Modal Satellite Data Fusion and Temporal Attention. Remote Sensing, 15(3), 799. https://doi.org/10.3390/rs15030799

Vancouver

Weilandt F, Behling R, Goncalves R, Madadi A, Richter L, Sanona T, et al. Early Crop Classification via Multi-Modal Satellite Data Fusion and Temporal Attention. Remote Sensing. 2023;15(3):799. doi:10.3390/rs15030799

BibTeX
@article{Weilandt2023,
  author = {Weilandt, Frank and Behling, Robert and Goncalves, Romulo and Madadi, Arash and Richter, Lorenz and Sanona, Tiago and Spengler, Daniel and Welsch, Jona},
  title = {Early Crop Classification via Multi-Modal Satellite Data Fusion and Temporal Attention},
  journal = {Remote Sensing},
  year = {2023},
  volume = {15},
  number = {3},
  pages = {799},
  doi = {10.3390/rs15030799}
}
Kostenlos starten →