Sign in to view content

Sign in to view this lesson and continue learning.

Infrastructure Data Quality - Enhancing Data Quality and Infrastructure Efficiency in Data Engineering (Day 2 Lecture)

Week 5: Infrastructure Data Quality V2
57 mins
Data ModelingETL/ELTAirflowData WarehousingGitCI/CD

Description

In this lecture, the importance of data quality and infrastructure efficiency in data engineering is discussed, highlighting common misconceptions and challenges faced by data engineers in ensuring data correctness. The need for comprehensive data sets and proper documentation to build trust with stakeholders is emphasized, along with the significance of infrastructure efficiency and being a good neighbor in terms of resource utilization. Insights and practical tips to address these issues are provided throughout the video.