Google
Cloud Platform
Amazon Web Services
Microsoft AzureApril 2023
These features and Databricks platform improvements were released in April 2023.
Note
Releases are staged. Your Databricks account might not be updated until a week or more after the initial release date.
Databricks Marketplace (Public Preview): an open marketplace for data, analytics, and AI
April 27, 2023
You can now use Databricks Marketplace to discover, access, and deploy hundreds of data products into your AI and analytics workflows. Databricks Marketplace takes advantage of Delta Sharing to provide secure and seamless sharing of both free and commercial data products across any cloud or region. See What is Databricks Marketplace?.
Customer-managed keys for workspace storage (Public Preview)
April 26, 2023
You can now configure your own key to encrypt the data on the GCS bucket associated with the Google Cloud project that you specify when you create your workspace. The same key is also used to encrypt your cluster’s GCE persistent disks. For more information, see Customer-managed keys for encryption.
Configure the Python formatter
April 25, 2023
For files and notebooks in Databricks Repos, you can now configure the Python formatter based on a Black specification. See Python black formatter library.
Workspace files are GA
April 24, 2023
You can now work with non-notebook files in Databricks. Workspaces files are enabled by default in all workspaces. See What are workspace files?.
Cluster-scoped init scripts can now be stored in workspace files
April 24, 2023
You can now store cluster-scoped init scripts in workspace files, regardless of Databricks Runtime version used by your compute. Databricks recommends storing all cluster-scoped init scripts in workspace files. See Store init scripts in workspace files.
Databricks Runtime 13.0 is GA
April 14, 2023
Databricks Runtime 13.0 and Databricks Runtime 13.0 ML are now generally available.
See Databricks Runtime 13.0 (EoS) and Databricks Runtime 13.0 for Machine Learning (EoS).
Compute resource usage for Google Cloud Marketplace aggregates under a single SKU
April 14, 2023
The compute resource usage information for Google Cloud Marketplace now aggregates under a single Google Cloud Marketplace SKU named “Databricks Consumption Units” instead of the previous multiple SKUs. Your detailed product usage data continues to be available in the Databricks account console and is unchanged.
Control access to the account console by IP address ranges (Public Preview)
April 17, 2023
Databricks account console now supports IP access lists to control access to the account console by IP address ranges, similar to the existing support for IP access lists for workspaces. Use either an account console UI or a REST API to manage access. See Configure IP access lists for the account console.
When Databricks blocks a request, Databricks generates a new event in the account-level audit logs with service accounts and event accountIpAclsValidationFailed. See Audit log reference.
Databricks Terraform provider updated to version 1.14.3
April 14, 2023
Version 1.14.3 adds exporter support for databricks_sql_alert, adds support for notifications in databricks_pipeline, and more. For more details, see the changelog for version 1.14.3.
Audit log entries for changed admin settings for workspaces and accounts
April 14, 2023
There are now audit log events for changes to some admin settings in the workspace-level logs (for workspace admin settings) and the account-level logs (for account admin settings). Within the accounts service for both types of logs, the new event action names are deleteSetting and setSetting. See Audit log reference. Not all settings generate auditable events.
Databricks Terraform provider updated to versions 1.14.1 and 1.14.2
April 4-6, 2023
Version 1.14.1 excludes roles in SCIM API list calls to reduce load on the Databricks SCIM service, and more. Version 1.14.2 adds a SQL file task to the databricks_job resource, fixes several bugs, and more. For more details, see the changelog for versions 1.14.1 and 1.14.2.
Combined SQL user settings and general user settings
April 3-5, 2023
The SQL user settings have been combined with the general workspace user settings to create a unified experience for workspace users. All SQL user settings are now accessed from Settings:
The Password tab is now the Account & Password tab.
The Query snippets tab is visible to users with the SQL entitlement.
Legacy notebook visualizations deprecated
April 4, 2023
Creation and editing of legacy notebook visualizations are deprecated and will be removed from the product soon. Existing legacy visualizations will continue to be rendered. Details will appear in notifications within the product.
Create or modify table from file upload page supports JSON file uploads
April 3, 2023
The Create or modify table from file upload page now supports JSON file uploads. For more information, see Create or modify a table using file upload.
New API support for configuring Private Service Connect (Public Preview)
April 3, 2023
Databricks added new API support for configuring Private Service Connect for both front-end and back-end support. The new API endpoints are part of the Account API.