What’s coming?
Learn about upcoming Databricks releases.
Update to Databricks Marketplace and Partner Connect UI
We are simplifying the sidebar by merging Partner Connect and Marketplace into a single Marketplace link. The new Marketplace link will be higher on the sidebar.
IPYNB notebooks will become the default notebook format for Databricks on December 2024
Currently, Databricks creates all new notebooks in the “Databricks source format” by default. In December 2024, the new default notebook format will be IPYNB (.ipynb
). This new default can be changed by the user in the workspace user Settings pane if they prefer the Databricks source format.
Workspace files will be enabled for all Databricks workspaces on Feb 1, 2025
Databricks will enable workspace files for all Databricks workspaces on February 1, 2025. This change unblocks workspace users from using new workspace file features. After February 1, 2025, you won’t be able to disable workspace files using the enableWorkspaceFilesystem
property with the Databricks PATCH workspace-conf/setstatus REST API. For more details on workspace files, see What are workspace files?.
Changes to enablement defaults for AI/BI Genie
On November 14, 2024, the toggle to opt in to the Genie Public Preview will be turned on by default. To manage previews, see Manage Databricks Previews. AI/BI Genie will become generally available on December 9, 2024, at which point users with elevated privileges, such as account and workspace admins, can control access to Genie using the toggle that controls access to Partner-powered assistive features. See Use Databricks Assistant.
Changes to legacy dashboard version support
Databricks recommends using AI/BI dashboards (formerly Lakeview dashboards). Earlier versions of dashboards, previously referred to as Databricks SQL dashboards are now called legacy dashboards. Databricks does not recommend creating new legacy dashboards. AI/BI dashboards offer improved features compared to legacy dashboards, including AI-assisted authoring, draft and published modes, and cross-filtering.
To help transition to the latest version, upgrade tools are available in both the user interface and the API. For instructions on how to use the built-in migration tool in the UI, please see Clone a legacy dashboard to an AI/BI dashboard. For tutorials about creating and managing dashboards using the REST API at Use Databricks APIs to manage dashboards.
The sourceIpAddress field in audit logs will no longer include a port number
Due to a bug, certain authorization and authentication audit logs include a port number in addition to the IP in the sourceIPAddress
field (for example, "sourceIPAddress":"10.2.91.100:0"
). The port number, which is logged as 0
, does not provide any real value and is inconsistent with the rest of the Databricks audit logs. To enhance the consistency of audit logs, Databricks plans to change the format of the IP address for these audit log events. This change will gradually roll out starting in early August 2024.
If the audit log contains a sourceIpAddress
of 0.0.0.0
, Databricks might stop logging it.
Legacy Git integration is EOL on January 31
After January 31, 2024, Databricks will remove legacy notebook Git integrations. This feature has been in legacy status for more than two years, and a deprecation notice has been displayed in the product UI since November 2023.
For details on migrating to Databricks Git folders (formerly Repos) from legacy Git integration, see Switching to Databricks Repos from Legacy Git integration. If this removal impacts you and you need an extension, contact your Databricks account team.
External support ticket submission will soon be deprecated
Databricks is transitioning the support ticket submission experience from help.databricks.com
to the help menu in the Databricks workspace. Support ticket submission via help.databricks.com
will soon be deprecated. You’ll continue to view and triage your tickets at help.databricks.com
.
The in-product experience, which is available if your organization has a Databricks Support contract, integrates with Databricks Assistant to help address your issues quickly without having to submit a ticket.
To access the in-product experience, click your user icon in the top bar of the workspace, and then click Contact Support or type “I need help” into the assistant.
The Contact support modal opens.
If the in-product experience is down, send requests for support with detailed information about your issue to help@databricks.com. For more information, see Get help.
JDK8 and JDK11 will be unsupported
Databricks plans to remove JDK 8 support with the next major Databricks Runtime version, when Spark 4.0 releases. Databricks plans to remove JDK 11 support with the next LTS version of Databricks Runtime 14.x.
Automatic enablement of Unity Catalog for new workspaces
Databricks has begun to enable Unity Catalog automatically for new workspaces. This removes the need for account admins to configure Unity Catalog after a workspace is created. Rollout is proceeding gradually across accounts.
sqlite-jdbc upgrade
Databricks Runtime plans to upgrade the sqlite-jdbc version from 3.8.11.2 to 3.42.0.0 in all Databricks Runtime maintenance releases. The APIs of version 3.42.0.0 are not fully compatible with 3.8.11.2. Confirm your methods and return type use version 3.42.0.0.
If you are using sqlite-jdbc in your code, check the sqlite-jdbc compatibility report.