Delta Live Tables release 2023.41

September 16 - October 20, 2023

These features and improvements were released with the 2023.41 release of Delta Live Tables.

Note

Releases are staged. Your Delta Live Tables release, including Databricks Runtime versions, might not be updated until a week or more after the initial release date.

Databricks Runtime versions used by this release

Channel:

  • CURRENT (default): Databricks Runtime 12.2.14

  • PREVIEW: Databricks Runtime 13.3.3

New features and improvements in this release

  • You can now add custom monitoring and alerting to your Delta Live Tables pipelines using event hooks (Public Preview). For example, using event hooks you can send emails or integrate with third-party monitoring solutions to send alerts when selected events occur.

  • This release improves the detection and error messaging for circular dependencies in a pipeline. For example, when a downstream table is referenced to create an upstream table.

Bug fixes in this release

  • This release fixes an issue causing a pipeline to fail when an SCD type 1 query with expectations enabled has a case mismatch in column names.

  • With this release, cluster policy default values are correctly applied when the apply_policy_default_values setting is set to true in the pipeline configuration. Previously, in some cases, cluster policy defaults were not correctly applied. See Select a cluster policy.