Google
Cloud Platform
Amazon Web Services
Microsoft AzureApril 2021
These features and Databricks platform improvements were released in April 2021.
Note
Releases are staged. Your Databricks account may not be updated until a week or more after the initial release date.
Databricks Runtime 8.2 (GA)
April 22, 2021
Databricks Runtime 8.2 and Databricks Runtime 8.2 ML are now generally available.
For information, see the full release notes at Databricks Runtime 8.2 (EoS) and Databricks Runtime 8.2 for ML (EoS).
Easier job management with the enhanced jobs user interface
April 20-26, 2021: Version 3.44
Databricks has redesigned the Schedule and orchestrate workflows user interface to make it easier to manage jobs. You can use the new job details page to perform all job related actions, including running, cloning, and deleting jobs.
MLflow sidebar reflects the most recent experiment
April 20-26, 2021: Version 3.44
The MLflow Experiment Runs sidebar now displays runs from the experiment that the notebook most recently logged to. Previously the sidebar showed runs only from the notebook experiment.
For details, see Track model development using MLflow.
Change to default channel for conda.yaml files in MLflow
April 20-26, 2021: Version 3.44
When you save a model to MLflow, you can specify a conda.yaml file specifying package dependencies. Previously, if you did not specify channels in the conda.yaml file, the model used the defaults channel. This has changed. If you do not specify a channel, the new default channel is conda-forge.
Secret management
April 9, 2021
Databricks on Google Cloud now supports secret management, which enables you to store credentials for external data sources as secrets and reference those secrets in notebooks and jobs.
Notebook-scoped libraries
April 8, 2021
Databricks on Google Cloud now has support for Notebook-scoped Python libraries, which allow you to install Python libraries and create an environment scoped to a notebook session. Notebook-scoped libraries do not affect other notebooks running on the same cluster. These libraries do not persist and must be re-installed for each session.
Databricks Runtime 8.2 (Beta)
April 8, 2021
Databricks Runtime 8.2 and Databricks Runtime 8.2 ML are now available as Beta releases.
For information, see the full release notes at Databricks Runtime 8.2 (EoS) and Databricks Runtime 8.2 for ML (EoS).
User and group limits
April 5-12, 2021: Version 3.43
Each Databricks workspace is now limited to 10,000 users and 5,000 groups.
Easier monitoring of job run status
April 5-12, 2021: Version 3.43
The job run details page now automatically refreshes every 5 seconds to make it easier to monitor the progress of your jobs.
Receive email notification about activity in Model Registry
April 5-12, 2021: Version 3.43
You can now configure Model Registry to send an email notification of activity on a registered model or model version. Creators of model versions and registered models automatically receive notifications about activity on their models. Users who interact with model versions (for example, by adding a comment) also automatically receive notifications. To learn how to manage these notifications, see Control notification preferences.