Databricks Connect release notes

This page lists releases and maintenance updates issued for Databricks Connect.

The Databricks Connect major and minor package version must always match your Databricks Runtime version. Databricks recommends that you always use the most recent patch version of Databricks Connect that matches your Databricks Runtime version. For example, when you use a Databricks Runtime 7.3 cluster, use the latest databricks-connect==7.3.* package.

Databricks Connect for Databricks Runtime 11.3 LTS

Databricks Connect 11.3.7

March 8, 2023

  • Databricks Connect client update to support Databricks Runtime 11.3 maintenance release of March 8, 2023.

  • [ES-589567] Fixes java.lang.NoSuchMethodError error when enabling spark.databricks.io.cache.enabled

Databricks Connect 11.3.6

February 20, 2023

  • Databricks Connect client update to support Databricks Runtime 11.3 maintenance release of February 20, 2023.

  • [ES-573062] Fixes java.lang.ClassCastException when assigning fields to org.apache.spark.sql.catalyst.json.JSONOptions

Databricks Connect 11.3.0b0

December 8, 2022

  • Initial Databricks Connect client release to support Databricks Runtime 11.3 LTS.

  • There is a known issue in the R integration (some Spark plans will fail to execute).

Note

LTS means this version is under long-term support. See Long-term support (LTS) lifecycle.

Databricks Connect for Databricks Runtime 10.4 LTS

Databricks Connect 10.4.22

March 8, 2023

  • Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of March 8, 2023.

Databricks Connect 10.4.21

February 20, 2023

  • Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of February 20, 2023.

  • [ES-573062] Fixes java.lang.ClassCastException when assigning fields to org.apache.spark.sql.catalyst.json.JSONOptions

Databricks Connect 10.4.18

December 1, 2022

  • Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of December 1, 2022.

Databricks Connect 10.4.12

September 12, 2022

  • Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of September 6, 2022.

Databricks Connect 10.4.11

August 25, 2022

  • Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of August 25, 2022.

Databricks Connect 10.4.10

August 12, 2022

  • Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of August 12, 2022.

Databricks Connect 10.4.9

July 29, 2022

  • Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of July 29, 2022.

Databricks Connect 10.4.8

July 21, 2022

  • Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of July 19, 2022.

Databricks Connect 10.4.6

June 16, 2022

Databricks Connect 10.4 is now GA.

Databricks Connect 10.4.0b0

March 29, 2022

  • Initial Databricks Connect client release to support Databricks Runtime 10.4 LTS.

  • The Python and Java integrations are functioning correctly

  • There is a known issue in the R integration (some Spark plans will fail to execute)

Databricks Connect for Databricks Runtime 9.1 LTS

Databricks Connect 9.1.34

March 8, 2023

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of March 8, 2023.

Databricks Connect 9.1.33

February 20, 2023

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of February 20, 2023.

  • [ES-573062] Fixes java.lang.ClassCastException when assigning fields to org.apache.spark.sql.catalyst.json.JSONOptions

Databricks Connect 9.1.30

December 1, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of December 1, 2022.

Databricks Connect 9.1.24

September 12, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of September 6, 2022.

Databricks Connect 9.1.23

August 25, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of August 25, 2022.

Databricks Connect 9.1.22

August 12, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of August 12, 2022.

Databricks Connect 9.1.21

July 29, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of July 29, 2022.

Databricks Connect 9.1.20

July 15, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of July 14, 2022.

Databricks Connect 9.1.18

June 16, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of June 12, 2022.

Databricks Connect 9.1.17

June 7, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of June 2, 2022.

Databricks Connect 9.1.16

May 20, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of May 20, 2022.

Databricks Connect 9.1.15

May 5, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of May 5, 2022.

Databricks Connect 9.1.14

April 21, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of April 21, 2022.

Databricks Connect 9.1.13

April 7, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of April 7, 2022.

Databricks Connect 9.1.12

March 29, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of March 29, 2022.

Databricks Connect 9.1.11

March 10, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of March 10, 2022.

  • Fix ClassNotFoundException error message

Databricks Connect 9.1.10

February 23, 2022

  • Security enhancements

Databricks Connect 9.1.9

February 8, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of February 8, 2022.

Databricks Connect 9.1.8

January 26, 2022

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of January 26, 2022.

Databricks Connect 9.1.7

January 19, 2022

  • [ES-216554] Fixed an issue where cluster-attached libraries were not loaded correctly server-side in some cases

Databricks Connect 9.1.5

December 7, 2021

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of December 7, 2021.

Databricks Connect 9.1.4

November 16, 2021

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of November 16, 2021.

Databricks Connect 9.1.3

November 4, 2021

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of November 4, 2021.

Databricks Connect 9.1.2

October 20, 2021

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of October 20, 2021.

Databricks Connect 9.1.1

October 5, 2021

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of October 5, 2021.

Databricks Connect 9.1.0

September 23, 2021

Databricks Connect 9.1 is now GA.

Databricks Connect for Databricks Runtime 8.1

Databricks Connect 8.1.14

September 23, 2021

  • Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of September 23, 2021.

Databricks Connect 8.1.13

September 15, 2021

  • Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of September 15, 2021.

Databricks Connect 8.1.12

September 8, 2021

  • Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of September 8, 2021.

Databricks Connect 8.1.11

August 25, 2021

  • Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of August 25, 2021.

Databricks Connect 8.1.10

August 11, 2021

  • Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of August 11, 2021.

Databricks Connect 8.1.9

July 30, 2021

  • Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of July 30, 2021.

Databricks Connect 8.1.8

July 14, 2021

  • Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of July 14, 2021.

Databricks Connect 8.1.7

June 29, 2021

  • Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of June 29, 2021.

Databricks Connect 8.1.6

June 15, 2021

  • Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of June 15, 2021.

Databricks Connect 8.1.5

June 7, 2021

  • [ES-102916] Support no_proxy environment variable in DBConnnect client. Set it to a comma-separated list of fully qualified domain names for which the proxy set in https_proxy or http_proxy environment variable should not be used.

Databricks Connect 8.1.4

May 26, 2021

  • Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of May 26, 2021.

Databricks Connect 8.1.3

April 30, 2021

  • Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of April 30, 2021.

Databricks Connect 8.1.2

April 27, 2021

  • Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of April 27, 2021.

Databricks Connect 8.1.1

April 7, 2021

Databricks Connect 8.1.0

March 22, 2021

Databricks Connect 8.1 is now GA.

  • Improved support of Catalog API V2 commands

  • Improved support of SQL expressions in ANSI mode

Databricks Connect for Databricks Runtime 7.3 LTS

Databricks Connect 7.3.59

March 8, 2023

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of March 8, 2023.

Databricks Connect 7.3.58

February 20, 2023

  • Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of February 20, 2023.

  • [ES-573062] Fixes java.lang.ClassCastException when assigning fields to org.apache.spark.sql.catalyst.json.JSONOptions

Databricks Connect 7.3.55

December 1, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of December 1, 2022.

Databricks Connect 7.3.49

September 12, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of September 6, 2022.

Databricks Connect 7.3.48

August 25, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of August 25, 2022.

Databricks Connect 7.3.47

August 12, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of August 12, 2022.

Databricks Connect 7.3.46

July 29, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of July 29, 2022.

Databricks Connect 7.3.45

July 15, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of July 14, 2022.

Databricks Connect 7.3.43

June 16, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of June 12, 2022.

Databricks Connect 7.3.42

June 7, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of June 2, 2022.

Databricks Connect 7.3.41

May 20, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of May 20, 2022.

Databricks Connect 7.3.40

May 5, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of May 5, 2022.

Databricks Connect 7.3.39

April 21, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of April 21, 2022.

Databricks Connect 7.3.38

April 7, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of April 7, 2022.

Databricks Connect 7.3.37

March 29, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of March 29, 2022.

Databricks Connect 7.3.36

March 10, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of March 10, 2022.

Databricks Connect 7.3.35

February 23, 2022

  • Security enhancements

Databricks Connect 7.3.34

February 8, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of February 8, 2022.

Databricks Connect 7.3.33

January 26, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of January 26, 2022.

Databricks Connect 7.3.32

January 19, 2022

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of January 19, 2022.

Databricks Connect 7.3.30

December 7, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of December 7, 2021.

Databricks Connect 7.3.29

November 16, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of November 16, 2021.

Databricks Connect 7.3.28

November 4, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of November 4, 2021.

Databricks Connect 7.3.27

October 20, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of October 20, 2021.

Databricks Connect 7.3.26

October 5, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of October 5, 2021.

Databricks Connect 7.3.25

September 23, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of September 23, 2021.

Databricks Connect 7.3.24

September 15, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of September 15, 2021.

Databricks Connect 7.3.23

September 8, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of September 8, 2021.

Databricks Connect 7.3.22

August 25, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of August 25, 2021.

Databricks Connect 7.3.21

August 11, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of August 11, 2021.

Databricks Connect 7.3.20

July 30, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of July 30, 2021.

Databricks Connect 7.3.19

July 14, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of July 14, 2021.

Databricks Connect 7.3.18

June 29, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of June 29, 2021.

Databricks Connect 7.3.17

June 15, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of June 15, 2021.

Databricks Connect 7.3.16

June 7, 2021

  • [ES-102916] Support no_proxy environment variable in DBConnnect client. Set it to a comma-separated list of fully qualified domain names for which the proxy set in https_proxy or http_proxy environment variable should not be used.

Databricks Connect 7.3.15

May 26, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of May 26, 2021.

Databricks Connect 7.3.14

April 30, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of April 30, 2021.

Databricks Connect 7.3.13

April 27, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of April 27, 2021.

Databricks Connect 7.3.12

April 7, 2021

Databricks Connect 7.3.11

March 24, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of March 24, 2021

Databricks Connect 7.3.10

March 9, 2021

  • [ES-69946] Fix path separator on Windows for databricks-connect get-jar-dir

  • [ES-68776] Update Azure Blob File System client

  • Add support for FlatMapCoGroupsInPandas

  • Make initial connection process during cluster startup more robust

    Note

    The Databricks Runtime cluster must be running the latest maintenance release, and the Databricks Connect client must be updated to version 7.3.10 to continue to use the Azure Blob File System and mapPartitions and mapElements RDD operations with Databricks Connect. A restart of the Databricks Runtime cluster is required to update it to the latest maintenance release.

Databricks Connect 7.3.9

February 23, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of February 23, 2021

Databricks Connect 7.3.8

February 4, 2021

  • [ES-58153] Fix Analysis Exception when creating tables or views based on a query with aggregations.

Databricks Connect 7.3.7

January 20, 2021

  • Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of January 20, 2021

Databricks Connect 7.3.6

January 12, 2021

  • [ES-59054] Fix Delta Optimize Table command through Databricks Connect

  • [ES-53497] Fix Databricks Connect on Databricks Container Services (DCS)

Databricks Connect 7.3.5

December 9, 2020

Databricks Connect 7.3 is now GA.

  • [ES-49865] Prevent 500 Internal Server Errors due to automatic synchronization of dependent libraries when using Databricks Connect with SBT.

Databricks Connect 7.3.4 Beta

November 24, 2020

  • [ES-44382] Set spark.databricks.service.allowTerminatedClusterStart=false to prevent Databricks Connect from starting a terminated Databricks Runtime cluster.

  • Fix an error where client could not synchronize state with server correctly if INFO logging level was disabled.

Databricks Connect 7.3.3 Beta

November 3, 2020

Initial Databricks Connect release for Databricks Runtime 7.3. This release includes:

  • Support for Delta Lake time travel.

  • Easy transition between Databricks Connect clients and Databricks Runtime jobs or notebooks when using DBUtils. See Access DBUtils.

Known issues:

Databricks Runtime version validation is disabled in this beta release. Make sure to connect this client to a 7.3 Databricks Runtime cluster.