June 2024

These features and Databricks platform improvements were released in June 2024.

Note

Releases are staged. Your Databricks account might not be updated until a week or more after the initial release date.

Column mapping is now GA

June 10, 2024

Delta Lake column mapping is now generally available. You can now use DROP FEATURE to disable column mapping and downgrade table protocol. See Rename and drop columns with Delta Lake column mapping.

Workflow system tables are now available (Public Preview)

June 10, 2023

The system.workflow schema contains four new tables you can use to monitor jobs in your account. See Jobs system table reference.

If you don’t have access to these system tables, ensure you have enabled the system.workflow schema in your account. See Enable system table schemas.

Databricks Assistant: Threads & queries experience enabled by default

June 6, 2024

Databricks Assistant (Public Preview) now tracks query threads and history throughout editor contexts in your session experience by default. You can manage enablement for all workspaces in an account or individual workspaces.

For more information, see What is Databricks Assistant?

Improved notebook Markdown editor

June 5, 2024

You can now see a live preview of your Markdown cells in notebooks and access a toolbar for common Markdown elements like headers, lists, and links. Spend more time communicating your ideas and less time remembering syntax.

Quickly access Catalog Explorer tables from notebooks

June 5, 2024

You can now easily access Catalog Explorer tables directly from notebooks. Hover over a table name in a notebook cell to get a link to its catalog explorer page to see details like columns, permissions, and more.

Databricks ODBC driver 2.8.2

June 4, 2024

Databricks ODBC Driver (download) version 2.8.2 is now available. This release adds the following new features and enhancements:

  • Customers can now use extended SQL PUT, GET, and REMOVE commands to ingest and manage large datasets in Unity Catalog volumes.

  • Default OAuth configuration values are now updated and compliant. The updated configuration options include the authorization endpoint, OAuth client ID, OAuth user-to-machine scope, and OAuth machine-to-machine scope. For more details, see the release notes.

  • Third-party libraries have been updated, including expat 2.6.2 (previously 2.6.0) and libCURL 8.7.1 (previously 8.6.0).

  • The driver now accepts a private signed certification authority (CA) if it is added to the Windows Trusted Root CA certificate store.

This release also fixes the following issues:

  • The client previously returned an error if a table comment’s length exceeded MaxCommentLen. The default behavior now truncates the table comment to conform to the limit specified in MaxCommentLen.

  • The client previously returned an error when issuing SQLCancel under certain circumstances.

The new Databricks Notebook UI is now generally available

June 4, 2024

The new Databricks Notebooks UI provides developers with a streamlined, data-focused authoring experience. Key features include:

  • Modern UX: Enjoy a streamlined coding experience with an updated UI and other features to enhance Notebook organization.

  • New results table: Perform no-code data exploration with search and filtering capabilities directly on result outputs.