DDM-Former: Transformer networks for GNSS reflectometry global ocean wind speed estimation

• Published in: Remote sensing of environment Vol. 294; p. 113629
• Main Authors: Zhao, Daixin, Heidler, Konrad, Asgarimehr, Milad, Arnold, Caroline, Xiao, Tianqi, Wickert, Jens, Zhu, Xiao Xiang, Mou, Lichao
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 15.08.2023
• Subjects: data collection; Deep learning; environment; global positioning systems; GNSS reflectometry; Ocean wind speed; oceans; reflectometry; Transformer networks; wind speed; Deep learning; GNSS reflectometry; Ocean wind speed; Transformer networks
• ISSN: 0034-4257; 1879-0704
• DOI: 10.1016/j.rse.2023.113629

Global navigation satellite system reflectometry (GNSS-R) has shown a capability in recent years to be applied as a novel remote sensing technique to retrieve ocean wind speeds. The combination of GNSS-R observable delay-Doppler maps (DDMs) and deep learning algorithms provides the possibility to build an end-to-end pipeline for improving wind speed estimations. Recent studies have proven that data-driven approaches can be applied to generate enhanced estimation products. However, these are usually trained with convolutional neural networks (CNNs), which include inductive bias throughout the models. The inbuilt translation equivariance in CNNs represents an inexactitude for the feature extraction on DDMs. To address this issue, we propose Transformer-based models, named DDM-Former and DDM-Sequence-Former (DDM-Seq-Former), to exploit delay-Doppler correlation within and between DDMs, respectively. The advantages of our methods over conventional retrieval algorithms and other deep learning-based approaches are presented based on the Cyclone GNSS (CYGNSS) version 3.0 dataset. In addition, a comprehensive study on the attention mechanism for our models is demonstrated. The proposed DDM-Former yields the best overall performance with a root mean square error (RMSE) of 1.43m/s and a bias of −0.02m/s over the nine months test period. Moreover, with an RMSE of 2.89m/s and a bias of −1.88m/s, the proposed DDM-Seq-Former can promisingly improve the estimations in the cases with wind speeds higher than 12m/s. There are still opportunities for further enhancements in creating more robust models that could perform well in all wind regimes given a non-uniform wind distribution. We will make our code publicly available. •Transformer-based models are proposed for wind speed estimation with CYGNSS data.•Attention mechanism exploits delay-Doppler correlation within and between DDMs.•Models' explainabilities are demonstrated with attention maps.•Proposed models yield competitive results compared to competitor methods.•Great potential for migrating to other GNSS-R applications.