Data engineering guide: task orchestration and data processing pipelines

This guide shows how to process and analyze data using multi-task jobs and Delta Live Tables, the Databricks data processing pipeline framework.