From the course: End-to-End Real-World Data Engineering Project with Snowflake
Unlock this course with a free trial
Join today to access over 24,900 courses taught by industry experts.
Create the stream in Snowflake to capture Customer table changes - Snowflake Tutorial
From the course: End-to-End Real-World Data Engineering Project with Snowflake
Create the stream in Snowflake to capture Customer table changes
- [Speaker] To identify what are the new rows are coming in, in our bronze customer layer, we need to create the stream. As we are doing an incremental load in the silver layer, we need to identify these rows. Let's just see how you can create this stream to get the incremental rules. So I just add one more worksheet. I call it stream creation. And let's select the layer as the bronze layer because we are trying to keep our watch on our bronze table to identify what are the new rows are coming inside it. So let me select Pacific Retail DB and bronze layer. Now, to create the stream, it's very easy. I have to just say, create or replace stream, customer changes, and I want to apply it on raw customer. So whenever a new record comes in or some record get updated in the raw customer, I get to know under this stream. So let's just execute and create the stream. Done. Now, whenever any changes happens in customer table, we perfectly get to know under this stream.
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
(Locked)
Create the Silver layer schema in the database4m 15s
-
(Locked)
Create the stream in Snowflake to capture Customer table changes1m 38s
-
(Locked)
Create the stream in Snowflake to capture Product table changes52s
-
(Locked)
Create the stream in Snowflake to capture Order table changes1m 44s
-
(Locked)
Create the task to merge customer changes in the Silver layer7m 2s
-
(Locked)
Create the task to merge product changes in the Silver layer4m 15s
-
(Locked)
Create the task to merge order changes in the Silver layer2m 32s
-
(Locked)
-
-