In this Deep Dive webinar, discover how to rapidly develop data pipelines using DLT Hub and Dagster. Hosted by Colton Patton from Dagster Labs and featuring experts Alex Noonan, Alena Astrakhantseva, and Aashish Nair, this session covers the fundamentals of DLT, provides a hands-on demo integrating DLT with Dagster, and discusses advanced topics such as parallelization.

Learn how DLT simplifies data ingestion, schema management, and transformation, making it easier to switch data destinations seamlessly. Dive into real-world examples and see how Dagster and DLT can elevate your data engineering projects to the next level.

Demo project repo: https://github.com/dlt-hub/dlthub-education/tree/main/workshops/deep_dive_dagster

00:00 Introduction and Agenda
00:39 Meet the Team
02:08 Introduction to DLT
04:41 DLT and Dagster Integration
09:51 Demo: Building a Basic DLT Pipeline
17:58 Demo: Exposing DLT Pipeline as Dagster Asset
24:17 Advanced Concepts in Python with DLT
24:56 Setting Up Definitions and Imports
25:49 Creating and Configuring Jobs
27:08 Running and Testing the Integration
28:27 Optimizing with Parallelization
30:02 Implementing Parallel Pipelines
36:03 Modifying Definitions for Parallel Execution
37:20 Live Demo and Conclusion
41:38 Q&A Session

source