September 2024

These features and Databricks platform improvements were released in September 2024.

Note

Releases are staged. Your Databricks account might not be updated until a week or more after the initial release date.

September 30, 2024

Git folders and Repos (Legacy) now support 1GB and 20000 workspace assets per working branch.

Publish to Power BI is now generally available

September 24, 2024

The Publish to Power BI feature is now generally available. This feature allows users to seamlessly create semantic models from tables/schemas on Databricks and publish them directly to Power BI Service.

To get started, see Publish to Power BI Online from Databricks.

Use @ to reference tables in Databricks Assistant prompts

September 24, 2024

To quickly reference tables in Assistant prompts, use the @ symbol. See Reference tables in prompts using @.

Control external access to data in Unity Catalog using the new EXTERNAL USE SCHEMA privilege

September 18, 2024

The new EXTERNAL USE SCHEMA privilege enables you to restrict access to data in Unity Catalog when external processing engines like Iceberg clients or Microsoft Fabric use Unity Catalog open APIs or Iceberg APIs to access that data. See Control external access to data in Unity Catalog.

Databricks Assistant Quick Fix debugs code inline

September 12, 2024

Assistant Quick Fix recommends single-line fixes for running code when it returns an error. Accept the fix and continue to run the code.

See Quick Fix.

Warehouse events system table is now available (Public Preview)

September 12, 2024

The system.compute.warehouse_events table records when SQL warehouses start, stop, scale up and down. You can use the table to monitor the SQL warehouses in your workspaces. See Warehouse events system table reference.

Extended AI-generated comments support

September 6, 2024

AI-generated comments support now includes catalogs, schemas, functions, models, and volumes in addition to tables and table columns. An inline assistant also helps edit comments in Catalog Explorer. See Add AI-generated comments to Unity Catalog objects.

Databricks extension for Visual Studio Code is GA

September 4, 2024

The Databricks extension for Visual Studio Code is now generally available. The extension allows you to connect to your remote Databricks workspaces from Visual Studio Code and then easily define, deploy, and run Databricks Asset Bundles, debug notebooks and run them as jobs, run files on clusters and as jobs, and synchronize local code to your workspace, all from the VSCode IDE.

To install the Databricks extension for Visual Studio Code and quickly get started, see What is the Databricks extension for Visual Studio Code?.

System tables are now generally available

September 3, 2024

The Databricks system tables platform is now generally available. This launch also includes the GA release of the system.billing.usage and system.billing.list_price tables. See Monitor usage with system tables.