DevOps is making strides into the data realm. Whether we call it DataOps, MLOps, or simply CI\/CD for Data, it is becoming easier to automate schema updates and data transformation processes. This week the community shared some excellent articles on the topic.<\/p>\n
No interest in data? No worries! There is some content for the front-end developers as well!<\/p>\n
Create Multi Stage YAML CI\/CD pipeline for deploying database changes using Maven, Liquibase and Azure DevOps<\/a> Using DBT to Execute ELT Pipelines in Snowflake<\/a> DevOps In Azure With Databricks And Data Factory<\/a> Azure DevOps ReactJS Unified Build and Release<\/a>
\nDatabase schema changes have always been more difficult to automate than updates to code, and despite the industry efforts, most databases out there are still updated manually. In this post, Mohit Goyal is taking on the challenge of creating a database CI\/CD pipeline using Liquibase and Maven in Azure YAML pipelines. Using a strategy like this can help you keep your schema changes in source control, and progressively roll them out to all of your environments!<\/p>\n
\nTaking it a step further, John Aven is bringing DevOps into data transformation. John’s post describes using an open-source Data Build Tool (DBT) to create an Extract Load and Transform (ELT) pipeline with Azure YAML pipelines, using DBT to compile, test and run the data transformation “models”. The ability to test your changes can truly make a difference!<\/p>\n
\nSince we’ve started on the Data path, I will also bring in a slightly older post by Alexandre Gattiker. The post features a detailed walkthrough of an Azure DevOps CI\/CD pipeline for Azure Data Bricks and Azure Data Factory based Big Data application which predicts bike rentals using time and weather information.<\/p>\n
\nBringing it back to the front-end development, let’s look at a YAML pipeline for a ReactJS application. In this post, Dara Oladapo is building and deploying a ReactJS application onto an Azure App Service on Linux using a Linux agent in Azure YAML Pipelines. Dara also shared his full YAML pipeline on GitHub here<\/a>. Great work leveraging the new multi-stage CI\/CD YAML pipelines!<\/p>\n