The aviation sector is undergoing a great transformation, mainly due to digitalisation, in which future data and software-based solutions are being developed to address issues such as safety, efficiency, resilience or emissions. Four new terms have skyrocketed in popularity in recent years and now fill a multitude of blogs, presentations, publications and company/product descriptions: DevOps, MLOps, DataOps, AIOps and ModelOps. While they may all seem to refer to something similar, mainly because they all end with the suffix “Ops”, each of these approaches to managing software development and data infrastructure has its own set of methodologies, tools and techniques. Understanding the differences between these buzzwords is key in our fast-paced, tech-driven development era.
In this blog post, we will delve deeper into each of these terms and provide introductory definitions that can help you navigate the ever-changing landscape of software development and data science. We will also explore how each of these methodologies can benefit aviation and ATM, providing real-life examples of how they are being used in the industry today. So, whether you work in software development, data science, or aviation professional, get ready to discover the potential of Ops.
DevOps
DevOps is often considered the original foundation of the “Ops” philosophy. It is a methodology that aims to improve collaboration and communication between development and operations teams to deliver software quickly, reliably, and efficiently. DevOps mainly focuses on automating the entire software development lifecycle, from planning and coding to testing, deployment and monitoring, which in the end enables teams to build, test, and deploy software rapidly and frequently while maintaining high-quality standards. It emphasises the use of agile methodologies, continuous integration and delivery (CI/CD), infrastructure as code (IaC) and containerisation. It also emphasises the importance of monitoring and feedback, with the goal of continuously improving the software development process and the quality of the applications and services being delivered.
DevOps is one of the methodologies currently being used in DataBeacon for the development of Victor5. Victor5 is an AI digital assistant that supports Air Traffic Control and airspace managers in making informed decisions based on real-time data to improve airspace management efficiency and safety. Following DevOps best practices, the development works closely with the air traffic controllers (ATCOs) to understand their requirements and develop the required functionalities that meets their needs. The team also works with the operations team to ensure that the software is deployed and maintained correctly, reducing the risk of system failures.
MLOps
MLops stands for Machine Learning Operations and is a discipline that aims to streamline the machine learning development lifecycle. MLOps can be seen as the application of DevOps principles to the development, deployment, and maintenance of machine learning models. It involves automating the machine learning pipeline from data ingestion, feature engineering, model training, deployment, and monitoring. Similar to DevOps, MLOps provides a collaborative approach between machine learning engineers and operational experts/users to manage the ML lifecycle of a solution. The emergence and need for this methodology arose from the growing need for machine learning engineers to independently manage their production processes without relying on specific IT/Data teams.
MLOps and DevOps methodologies are not mutually exclusive. They can be used for different aspects of the solution, while DevOps could be used to focus more on the development of the entire software solution, MLOps could be used for the data-driven aspects of the same solution. For example, while the entire development of the Victor5 digital assistance follows a DevOps approach, which encompasses aspects such as security or UI/UX; specific data-driven predictive functionalities, such as medium/short term conflict detection or workload prediction, are developed following an MLOps methodology approach.
DataOps
DataOps is an approach that combines DevOps, agile methodologies, and data management principles to manage data pipelines and deliver high-quality data to end-users. DataOps focuses on automating the data pipeline from data collection to analysis and reporting, with an emphasis on data quality, security, and governance. By integrating automated testing, monitoring, and deployment practices, DataOps can quickly detect and resolve issues, reducing the time to deliver insights to end-users. It also facilitates collaboration between data scientists, analysts, and IT professionals, enabling them to work together seamlessly and drive better business outcomes.
DataOps can be leveraged in Air Traffic Management, to efficiently manage the massive amounts of data generated by air traffic management systems. An example of DataOps in action would be the development of an automated data pipeline to perform data cleansing, transformation, and analysis, which empowers air traffic controllers to monitor the performance of the air traffic management system continually. Allowing them to take corrective actions promptly and effectively if any issues arise.
AIOps
AIOps stands for Artificial Intelligence Operations and refers to the use of artificial intelligence and machine learning to enhance IT operations. AIOps aims to automate IT operations tasks such as monitoring, alerting, and incident management, by using machine learning algorithms to identify patterns, predict issues, and automate remediation. AIOps employs machine learning and other AI technologies to automate IT processes, similar to MLOps, and also includes principles from DataOps. However, unlike MLOps, AIOps focuses on automating processes within an organization’s IT operations department rather than machine learning and AI teams.
In aviation, AIOps can be applied to monitor the performance of air traffic management systems, identify anomalies, and predict potential issues. For example, in monitoring the performance of air traffic management systems, AIOps can be used to analyse data from various sources such as weather sensors, aircraft tracking systems, and communication systems. The machine learning algorithms can be trained to identify patterns and anomalies in the data, such as unusual flight patterns or communication disruptions. This can help the air traffic controllers to quickly identify and address potential issues before they cause any disruption to the system.
ModelOps
ModelOps is a methodology that focuses on the management and deployment of machine learning models in production environments. It aims to streamline the process of deploying, monitoring, and updating machine learning models at scale, by combining best practices from software development, data management, and machine learning. Similar to MLOps, ModelOps provides a framework for collaboration between data scientists, machine learning engineers, and operational experts. ModelOps also cover a wider range of IT tasks to ensure the successful deployment and ongoing management of machine learning models in production environments. ModelOps can be seen as an extension of MLOps that involves managing and operationalising all AI models used in production systems.
In the aviation industry, ModelOps can be used to manage and deploy predictive models for a wide range of use cases, from predicting aircraft maintenance needs to optimising flight routes. For example, airlines can use predictive maintenance models to detect and address potential equipment failures before they occur, ensuring that their aircraft remain safe and operational. By implementing ModelOps methodologies, airlines can ensure that their predictive models are accurate, up-to-date, and continuously improving, allowing them to make data-driven decisions that improve the safety and efficiency of their operations.
To conclude, as we have seen, although these methodologies may have different objectives, they all share the common goal of improving the efficiency and reliability of software development and data management processes. In addition, within these “core Ops”, one can find an almost infinite number of new “Ops” that are derived from them, such as: DevSecOps, which aims to ensure the security of the software development process by incorporating security measures at an early stage and throughout the software development life cycle; or DataGovOps a combination of DataOps and governance principles to ensure the quality, security, and compliance of data pipelines in an organisation. As the aviation industry continues to adopt digital transformation initiatives, DevOps, MLops, DataOps, AIOps and ModelOps are becoming increasingly important in ensuring the reliability and efficiency of any future data-based solutions. These methodologies can help reduce the time and resources required to develop, deploy, and maintain software applications and data infrastructure, while improving the quality of the end-product. They will play a critical role in ensuring that aviation systems operate safely and efficiently. We hope that this blog has provided you with a clearer understanding of all this jargon. For more interesting blogs on data science and the world of aviation, be sure to visit datascience.aero.
