Assessing AI model performance in time-series GNSS data analysis with different neural network structures

- Authors: Truong Xuan Tran 1, Tinh Duc Le 2, Thao Phuong Thi Do 1, Man Van Pham 2, Trong Gia Nguyen 1,3 *
Affiliations:
1 Hanoi University of Mining and Geology, Hanoi, Vietnam
2 Naval Command, Vietnam Naval Service, Haiphong, Vietnam
3 Geodesy and Environment Research Group, Hanoi University of Mining and Geology, Hanoi, Vietnam
- *Corresponding:This email address is being protected from spambots. You need JavaScript enabled to view it.
- Received: 30th-Aug-2024
- Revised: 12th-Dec-2024
- Accepted: 4th-Jan-2025
- Online: 1st-Feb-2025
- Section: Geomatics and Land Administration
Abstract:
Artificial intelligence is widely used in time series data analysis in general, and specifically for GNSS time series data. The performance of each AI model used for analyzing GNSS time series data depends on the selection of the optimization function, loss function, the number of nodes in the hidden layers, and the number of epochs. The GRU (Gated Recurrent Unit) deep learning model has been proven to perform well in time series prediction. This paper presents the results of evaluating the performance of the GRU model with different parameter selections mentioned above. The input data for the model is the vertical coordinate component from the HYEN CORS station from 10/8/2019 to 18/3/2022, which is the result of analyzing GNSS data collected at this station using the Gamit/Globk software. The processing results show that when using the Adam optimizer and MSE loss function, the model’s performance decreases rapidly as the number of nodes in the hidden layer reduces from 200÷100. In this case, the model's performance metrics include an R2 decrease from 85÷20%, and the MAE value increases from 3.77÷8.37 mm. When replacing the MSE loss function with the Huber loss function, the model's performance significantly improves, with the R2 increasing by 7%, and the MAE value decreasing from 3.77÷3.21mm. This is a relatively high performance for predicting data using an AI model with a training-to-testing ratio of 60÷40%.

Alpaydin, E. (2020). Introduction to machine learning: MIT press.
Andreas, H., Abidin, H. Z., Sarsito, D. A., Meilano, I., and Susilo, S. (2018). Investigating the tectonic subsidence on Java Island using GNSS GPS campaign and continuous. Paper presented at the AIP Conference Proceedings.
Bishop, C. M., and Nasrabadi, N. M. (2006). Pattern recognition and machine learning (Vol. 4): Springer.
Cetin, S., Aydin, C., and Dogan, U. (2019). Comparing GPS positioning errors derived from GAMIT/GLOBK and Bernese GNSS software packages: A case study in CORS-TR in Turkey. Survey Review, 51(369), 533-543.
Chen, H., He, X., and Lu, T. (2024). Deep Learning Based GNSS Time Series. In Positioning Navigation Using Machine Learning Methods (pp. 99).
Chollet, F. (2021). Deep learning with Python: Simon and Schuster.
Ciaburro, G., and Venkateswaran, B. (2017). Neural Networks with R: Smart models using CNN, RNN, deep learning, and artificial intelligence principles: Packt Publishing Ltd.
Crocetti, L., Schartner, M., and Soja, B. (2021). Discontinuity detection in GNSS station coordinate time series using machine learning. Remote sensing, 13(19), 3906.
Gao, W., Li, Z., Chen, Q., Jiang, W., and Feng, Y. (2022). Modelling and prediction of GNSS time series using GBDT, LSTM and SVM machine learning approaches. Journal of Geodesy, 96(10), 71.
Goudarzi, M. A. (2016). GPS inferred velocity and strain rate fields in eastern Canada.
Haritonova, D., Balodis, J., Janpaule, I., and Morozova, K. (2015). Earth's Surface Displacements from the GPS Time Series. Paper presented at the IOP Conference Series: Materials Science and Engineering.
Khorrami, F., Ejigu, Y. G., Näränen, J., Raja-Halli, A., and Nordman, M. (2024). Exploring Non-tidal Atmospheric Loading Deformation Correction in GNSS Time Series Analysis Using GAMIT/GLOBK Software. In Springer.
Le, D. T., Huynh, N. D., and Nguyen, G. T. Q. (2024). Exploring the training results of machine learning models using different batch sizes and epochs: A case study with GNSS time series data. J. Hydro-Meteorol, 19, 90 - 99.
Meyer, G. P. (2021). An alternative probabilistic interpretation of the huber loss. Paper presented at the Proceedings of the IEEE/CVF conference on computer vision and pattern recognition.
Özbey, V., Ergintav, S., and Tarı, E. (2024). GNSS Time Series Analysis with Machine Learning Algorithms: A Case Study for Anatolia. Remote Sensing, 16(17), 3309.
Rizos, C. (2008). The contribution of GNSS CORS infrastructure to the mission of Modern Geodesy. Paper presented at the 7th Int. Symp. and Exhibition on Geoinformation.
Trọng, N. G., Nghĩa, N. V., Khải, P. C., Thành, N. H., Hà, L. L., Dũng, V. T., Quân, N. V., Quang, P. N. (2022). Xác định chuyển dịch trên phạm vi lãnh thổ Việt Nam dựa vào dữ liệu của các trạm CORS thuộc mạng lưới VNGEONET. Tạp chí Khí tượng Thủy văn, 739, 59-66.
Uzel, T., Eren, K., Gulal, E., Tiryakioglu, I., Dindar, A. A., and Yilmaz, H. (2013). Monitoring the tectonic plate movements in Turkey based on the national continuous GNSS network. Arabian Journal of Geosciences, 6, 3573-3580.
Vân Phong, D., Trọng, N. G., Chiến, N. V., Thành, N. H., Hà, L. L., Quân, N. V., and Quang, P. N. (2023). Phân tích chuyển dịch thẳng đứng vỏ Trái đất sử dụng hàm ANN từ kết quả xử lý chuỗi dữ liệu GNSS theo thời gian. Tạp chí Khí tượng thủy văn, 752, 41 - 50.
Wang, Q., Ma, Y., Zhao, K., and Tian, Y. (2020). A comprehensive survey of loss functions in machine learning. Annals of Data Science, 1-26.
Xie, Y., Wang, J., Li, H., Dong, A., Kang, Y., Zhu, J., Wang, Y., Yang, Y. (2024). Deep Learning CNN-GRU Method for GNSS Deformation Monitoring Prediction. Applied Sciences, 14(10), 4004.
Other articles