January 2023

These features and Databricks platform improvements were released in January 2023.

Note

Releases are staged. Your Databricks account may not be updated until a week or more after the initial release date.

Create a workspace using Terraform (Public Preview)

January 31, 2022

Use the Terraform infrastructure-as-code software tool to create workspaces. This is available as a Public Preview.

Create a workspace using the Account API (Public Preview)

January 31, 2022

Use the Account API to create workspaces, delete workspaces, and manage workspace network resources. This account-level API is available as a Public Preview. Authentication requires a Google ID, and some operations require an access token. See Authentication with Google ID tokens, Account API, and Create a workspace using the Account API.

Authenticate to Databricks REST APIs using a Google ID

January 31, 2022

Authenticate to Databricks REST APIs using Google-issued OpenID Connect (OIDC) tokens, commonly known as Google ID tokens. For workspace-level APIs, this is an alternative to Databricks personal access tokens. For account-level APIs, you must use Google IDs. See Authentication with Google ID tokens.

Account SCIM is now GA

January 31, 2023

The Account SCIM API is now generally available.

Account SCIM lets you use an identity provider (IdP) to create users in a Databricks account, give users the proper level of access, and remove access (deprovision users) when they leave your organization or no longer need access to Databricks.

You can use a SCIM provisioning connector in your IdP or invoke the SCIM APIs to manage provisioning. For more information, see Sync users and groups from your identity provider.

Easier creation and editing of Databricks jobs in the UI

January 30, 2023

The Databricks Jobs user interface now shows a view of your entire job when you add or make changes to job tasks. This unified view simplifies job creation and editing by allowing you to see the full details of your job as you make changes. See Schedule and orchestrate workflows.

Improvements to the Databricks Jobs UI when viewing job runs

January 30, 2023

The Databricks Jobs user interface now shows the job runs matrix and the job runs list in a single panel, improving your visibility into the status and details of your job runs. Previously, viewing the runs matrix or the runs list required switching between the two views. See View runs for a job.

REST API Reference is now available for browsing API documentation

January 27, 2023

Try the new Databricks REST API Reference documentation experience in beta. The API Reference includes the latest versions of the Databricks REST API documentation.

The existing REST API documentation remains available as we gather feedback and develop this new experience. To send us your feedback on this beta experience, click Send feedback link in the upper-left corner of the page.

Databricks Terraform provider updated to version 1.9.1

January 25, 2023

Version 1.9.1 adds max_clusters_per_user to databricks_cluster_policy, support for cluster_mount_infos in databricks_cluster, a parent attribute to databricks_sql_query and databricks_sql_dashboard, and more. For more details, see the changelog for version 1.9.1.

Account users can update email preferences in the account console

January 23, 2023

You can now update instructional product and feature email preferences in your Databricks account console. For more information, see Manage email preferences.

New account console home screen provides better account management experience

January 20, 2023

Admins can use the new account console home screen to better navigate between Databricks products.

Region support consolidated onto one page

January 20, 2023

A new supported regions article consolidates all information about supported regions, including:

  • Region-specific feature support

  • IP addresses, domains, and endpoints for allow lists and custom network configurations

You can also switch between the AWS, Azure, and Google Cloud version of this article using the documentation site’s cloud switcher.

Databricks Runtime 12.1 and Databricks Runtime 12.1 ML are GA

January 19, 2023

Databricks Runtime 12.1 and Databricks Runtime 12.1 ML are now generally available.

See Databricks Runtime 12.1 (EoS) and Databricks Runtime 12.1 for Machine Learning (EoS).

Cluster policies now support limiting the max number of clusters per user

January 18, 2023

You can now use cluster policies to restrict the number of clusters a user can create. For more information, see restrict the number of clusters per user.

Databricks Terraform provider updated to version 1.9.0

January 17, 2023

Version 1.9.0 includes fixes to the databricks_sql_endpoint and databricks_sql_permissions resources, makes several documentation improvements, and more. For more details, see the changelog for version 1.9.0.

Databricks Terraform provider updated to version 1.8.0

January 10, 2023

Version 1.8.0 adds support for Databricks on Google Cloud workspace deployments. New resources include databricks_instance_pool, databricks_provider, and databricks_permission_assignment. For more details, see the changelog for version 1.8.0.

Databricks Runtime 12.1 (Beta)

January 9, 2023

Databricks Runtime 12.1 and Databricks Runtime 12.1 ML are now available as Beta releases.

See Databricks Runtime 12.1 (EoS) and Databricks Runtime 12.1 for Machine Learning (EoS).

Partner Connect supports Sigma

January 9-17, 2022

You can now easily create a connection between Sigma and your Databricks workspace using Partner Connect. For more information, see Connect to Sigma using Partner Connect.

New left and right sidebars in Databricks notebooks

January 5-12, 2023

We have added left and right sidebars to the Databricks notebook. You can now find the notebook’s table of contents in the left-hand sidebar, and you can find comments, MLflow experiments, and the notebook version history in the right-hand sidebar.