Sign in to view content

Sign in to view this lesson and continue learning.

Infrastructure Data Quality - Setting Up CI/CD with GitHub Actions for Data Quality Assurance (Day 2 Lab)

Week 5: Infrastructure Data Quality V2
50 mins
PythonMLOpsETL/ELTApache SparkAirflowGitCI/CD

Description

In this lab, viewers will be taken through the process of setting up CI/CD with GitHub Actions, along with an exploration of the importance of data quality in the infrastructure track. Demonstrations will include how to open a pull request, install dependencies, and trigger actions. Additionally, the challenges of managing multiple folders and dependencies in a mono repo will be discussed.