From the course: End-to-End Data Engineering Project

Unlock the full course today

Join today to access over 24,700 courses taught by industry experts.

Materializing assets using Dagit

Materializing assets using Dagit

From the course: End-to-End Data Engineering Project

Start my 1-month free trial Buy for my team

Materializing assets using Dagit

“

- [Instructor] We have come a long way in integrating our data tools. Now, it is time for the magic to happen. Let's finally click on the Materialize All button at the top right corner of the Dexter UI. This will trigger a run that goes through the whole process of materializing all our assets. Essentially, it is executing the ops contained within each asset, and saving the results to persistent storage. Let's go to the Airbyte UI and see how a sync has been triggered by Dexter. And now we see how the sync is running. We had already run our initial sync manually, and since there is no new data in our Postgres database, this sync will not ingest new data. A good challenge for you here would be to add new rows to the Postgres database, and materialize again to see new data flowing through the pipeline. As you can see, our whole pipeline is being materialized, and it will take some time for the process to complete. Feel…

Contents