TOPICAL TENDENCIES IN OPTIMIZING LOGGING AND MONITORING PROCESSES IN CLOUD SYSTEMS

Authors

DOI:

https://doi.org/10.32782/IT/2024-2-3

Keywords:

logging, monitoring, cloud systems, AIOps, machine learning, DevOps, ELK Stack, CloudWatch, Azure Monitor, SaaS solutions

Abstract

The increasing popularity of cloud systems has led to a heightened role for logging and monitoring processes for ensuring their reliability, availability, and security. Currently these processes really have an essential importance. Effective use of logging and monitoring tools enables developers and support teams to understand the real-time behavior of cloud-deployed information systems and promptly respond to emerging issues. This paper analyzes current trends in this field. The purpose of the work. It investigates existing solutions for optimizing logging and monitoring processes in cloud systems. The methodology. Their detailed analysis was conducted. The advantages and disadvantages of these solutions were highlighted. Existing problems in ensuring proper optimization of logging and monitoring processes in cloud systems were identified. And practical recommendations for their step-by-step resolution were offered. The presented study covers such key aspects as a detailed overview of the infrastructure of logging and monitoring processes (software stacks, cloud platforms, SaaS solutions), tools and platforms for implementing these systems (ELK Stack, CloudWatch, Azure Monitor), and their automation (AIOps, machine learning). The scientific novelty. It is determined that today optimization of logging and monitoring processes is critically important for cloud systems, as it provides the reliability, high availability, and security of cloudbased information systems. A comprehensive approach to implementing logging and monitoring systems is offered, which should include log filtering, aggregation, and compression; anomaly detection in logs and metrics; the formation of key performance indicators (KPIs) for monitoring in accordance with the requirements of the information system; setting threshold values for receiving notifications about possible problems; analysis and visualization of monitoring data; and failure prediction using machine learning. Conclusions. Nowadays optimization of logging and monitoring processes in cloud systems is one of the key factors for the successful operation of modern organizations that strive to improve the stability of information systems, increase the level of data security, and ensure high availability of such systems. Therefore, it can be concluded that modern research in the field of cloud systems, which is aimed to develop new models and IT for improving the implementation of logging and monitoring processes in cloud systems, has significant prospects for development.

References

Mono status – uptime history. Mono Status. URL: https://status.mono.co/uptime?page=2 (date of access: 25.04.2024).

Глобальний збій інтернету по всьому світу стався через пошкодження хуситами кабелів у Червоному морі – АР. Mind.ua. URL: https://mind.ua/news/20270513-globalnij-zbij-internetu-po-vsomu-svitustavsya-cherez-poshkodzhennya-husitami-kabeliv-u-chervonomu-mori (дата звернення: 25.04.2024).

Form N., Richards M. Fundamentals of Software Architecture: A Comprehensive Guide to Patterns, Characteristics, and Best Practices. O’Reilly, 2020. 500 p.

Gartner. (2019). AIOps Platforms. URL: https://www.gartner.com/en/newsroom/pressreleases/2019-08-06-gartner-identifies-five-emerging-trends-that-will-drive-aiops-platforms-to-the-mainstream (дата звернення: 25.04.2024).

Heitor R., Pimentel J., Gomes P., Fonseca B. Log-based software monitoring: a systematic mapping study. PeerJ Computer Science, 2021. 7(5), e489.

Zeng Y, Chen J, Shang W, Chen T-HP. Studying the characteristics of logging practices in mobile apps: a case study on f-droid. Empirical Software Engineering. 2019. 24(6):3394–3434.

Wang J., Li C., Han S., Sarkar S., Zhou X. Predictive maintenance based on event-log analysis: a case study. IBM Journal of Research and Development, 2019. 61(1), 11:121–11:132. DOI: 10.1147/JRD.2017.2654301

Singh S. P., Ansari M. A., Kumar L. Analysis of Website in Web Data Mining using Web Log Expert Tool. 2023 IEEE 12th International Conference on Communication Systems and Network Technologies (CSNT), Bhopal, India, 8–9 April 2023. 2023. URL: https://doi.org/10.1109/csnt57126.2023.10134696 (дата звернення: 26.04.2024).

Трояновська, Т. І., Савицька, Л. А., Комаров, В. Л. Засоби та модель моніторингу даних мікросервісної системи. Наукові праці ВПІ НТУУ “КПІ”, 2019. 4(66), 80–88.

Performance Evaluation of Infrastructure as a Service across Cloud Service Providers / S. Sithiyopasakul et al. 2023 International Electrical Engineering Congress (iEECON), Krabi, Thailand, 8–10 March 2023. 2023. URL: https://doi.org/10.1109/ieecon56657.2023.10127100 (дата звернення: 26.04.2024).

Monitor, Debug and Improve Your Entire Stack. New Relic. URL: https://newrelic.com/ (дата звернення: 26.04.2024).

Cloud Monitoring as a Service | Datadog. Datadog. URL: https://www.datadoghq.com/ (дата звернення: 26.04.2024).

Dynatrace | Modern cloud done right. Dynatrace. URL: https://www.dynatrace.com/ (дата звернення: 26.04.2024).

Grafting log analysis method of power data based on multi-layer clustering / C. Yang et al. 2023 5th International Conference on Frontiers Technology of Information and Computer (ICFTIC), Qiangdao, China, 17–19 November 2023. 2023. URL: https://doi.org/10.1109/icftic59930.2023.10456321 (дата звернення: 26.04.2024).

What is Terraform | Terraform | HashiCorp Developer. What is Terraform | Terraform | HashiCorp Developer. URL: https://developer.hashicorp.com/terraform/intro (дата звернення: 26.04.2024).

Published

2024-07-31