March 2022
These features and Databricks platform improvements were released in March 2022.
Note
Releases are staged. Your Databricks account may not be updated until a week or more after the initial release date.
Better performance and cost for your Delta Live Tables pipelines with Databricks Enhanced Autoscaling
March 31, 2022
Databricks Enhanced Autoscaling improves the existing cluster autoscaling functionality by adding streaming workload optimizations and improved support for batch workloads. Enhanced Autoscaling improvements provide more efficient cluster utilization, reduced resource usage, and lower cost. See Optimize the cluster utilization of Delta Live Tables pipelines with Enhanced Autoscaling.
Customer-managed VPC is Public Preview
March 31, 2022
By default, your Databricks workspace compute resources such as Databricks Runtime clusters are created within a GKE cluster within a Google Cloud Virtual Private Cloud (VPC) network. Databricks creates and configures this VPC in your Google Cloud account.
You can now choose to create your Databricks workspaces in an existing customer-managed VPC that you create in your Google Cloud account. See Configure a customer-managed VPC. This feature is available in Public Preview and requires that your account is on the Premium plan.
Files in Repos enabled by default in new workspaces
March 30, 2022
The Files in Repos feature is now enabled by default in newly created workspaces.
Databricks Feature Store is generally available
March 22, 2022
Databricks Feature Store is generally available. Databricks Feature Store enables feature sharing and discovery across your organization and also ensures consistent feature computation code for model training and inference.
RStudio Workbench bug fix
March 21-28, 2022: Version 3.68
The latest RStudio Workbench depends on cookies when you use a license file. These cookies were not allowlisted for proxying. This issue has been fixed.
New workspace language options
March 21, 2022
Workspaces are now available in the following languages:
Español
Português (Brasil)
Databricks Runtime 10.4 LTS and 10.4 LTS ML are GA; 10.4 Photon is Public Preview
March 18, 2022
Databricks Runtime 10.4 LTS and Databricks Runtime 10.4 LTS ML are now generally available. Databricks Runtime 10.4 Photon is in Public Preview.
Note
LTS means this version is under long-term support. See Databricks Runtime LTS version lifecycle.
See Databricks Runtime 10.4 LTS and Databricks Runtime 10.4 LTS for Machine Learning.
Enhanced access control for Delta Live Tables pipelines
March 9, 2022
You now have more control over access to your Delta Live Tables pipelines, including the owner of a pipeline, who can view or manage the pipeline, and who can run the pipeline. See Delta Live Tables ACLs.
Test Delta Live Tables preview functionality with the new channel
setting (Public Preview)
March 7-March 14, 2022: Version 3.67
You can test upcoming features in your Delta Live Tables pipelines with the new channel
setting. To test your pipeline with upcoming features, set channel
to preview
. To switch back to the current release, set channel
to current
.
Improved error handling for Delta Live Tables Python functions (Public Preview)
March 7-March 14, 2022: Version 3.67
This release adds type checking to validate that Delta Live Tables Python functions use the string
data type when setting names and values for table properties. Previously, setting table properties using non-string values could cause your pipeline to fail without an error message indicating the underlying cause.
Improvements to Databricks Repos
March 7-14, 2022: Version 3.67
The following improvements have been made to Databricks Repos.
Text search and replace in files in repos. The file editor now has File and Edit menus that provide search, replace, and replace all functionality.
Previously, Databricks recommended that the total number of notebooks and files in a repo not exceed 2000. That limit has been increased to 5000.
Audit logging for cluster policy changes
March 7-14, 2022: Version 3.67
When audit logging is enabled, an audit event is now logged when you create, update, or delete a cluster policy, or when you update user permissions for a cluster policy. For more information, see Audit log reference.
Databricks Runtime 10.4 (Beta)
March 4, 2022
Databricks Runtime 10.4, 10.4 Photon, and 10.4 ML are now available as Beta releases.
See the full release notes at Databricks Runtime 10.4 LTS and Databricks Runtime 10.4 LTS for Machine Learning.