From the course: Data Quality: Transactions, Ingestions, and Storage
Introduction
From the course: Data Quality: Transactions, Ingestions, and Storage
Introduction
- So, you wanna learn data quality on upstream systems, such as transactional databases, but it takes a lot of effort to do that. You have to set up a database, you have to set up the data pipelines, put data into it. I've covered all that for you, by creating a whole sandbox environment with the data platform that we'll code together with on. In addition, we're gonna blow the whole thing up, because that's the best way to learn about data quality. We're gonna break all the things in the database and the data pipelines, read the logs to understand what's happening, and then create our own fixes via code to ensure you have reliable data platforms and pipelines. Hi, I'm Mark Freeman. I'm a Data Engineer, but I've also worked the entire data life cycle as a data scientist and a data analyst, so I've seen data quality in multiple places within the business. I'm here to help you, and we're gonna pair program together in this course, so let's get started.
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.