Databricks Connect release notes
This page lists releases and maintenance updates issued for Databricks Connect.
The Databricks Connect major and minor package version must always match your Databricks Runtime version. Databricks recommends that you always use the most recent patch version of Databricks Connect that matches your Databricks Runtime version. For example, when you use a Databricks Runtime 7.3 cluster, use the latest databricks-connect==7.3.*
package.
Databricks Connect for Databricks Runtime 11.3 LTS
Databricks Connect 11.3.7
March 8, 2023
Databricks Connect client update to support Databricks Runtime 11.3 maintenance release of March 8, 2023.
[ES-589567] Fixes java.lang.NoSuchMethodError error when enabling spark.databricks.io.cache.enabled
Databricks Connect 11.3.6
February 20, 2023
Databricks Connect client update to support Databricks Runtime 11.3 maintenance release of February 20, 2023.
[ES-573062] Fixes java.lang.ClassCastException when assigning fields to org.apache.spark.sql.catalyst.json.JSONOptions
Databricks Connect 11.3.0b0
December 8, 2022
Initial Databricks Connect client release to support Databricks Runtime 11.3 LTS.
There is a known issue in the R integration (some Spark plans will fail to execute).
Note
LTS means this version is under long-term support. See Long-term support (LTS) lifecycle.
Databricks Connect for Databricks Runtime 10.4 LTS
Databricks Connect 10.4.22
March 8, 2023
Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of March 8, 2023.
Databricks Connect 10.4.21
February 20, 2023
Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of February 20, 2023.
[ES-573062] Fixes java.lang.ClassCastException when assigning fields to org.apache.spark.sql.catalyst.json.JSONOptions
Databricks Connect 10.4.18
December 1, 2022
Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of December 1, 2022.
Databricks Connect 10.4.12
September 12, 2022
Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of September 6, 2022.
Databricks Connect 10.4.11
August 25, 2022
Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of August 25, 2022.
Databricks Connect 10.4.10
August 12, 2022
Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of August 12, 2022.
Databricks Connect 10.4.9
July 29, 2022
Databricks Connect client update to support Databricks Runtime 10.4 maintenance release of July 29, 2022.
Databricks Connect for Databricks Runtime 9.1 LTS
Databricks Connect 9.1.34
March 8, 2023
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of March 8, 2023.
Databricks Connect 9.1.33
February 20, 2023
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of February 20, 2023.
[ES-573062] Fixes java.lang.ClassCastException when assigning fields to org.apache.spark.sql.catalyst.json.JSONOptions
Databricks Connect 9.1.30
December 1, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of December 1, 2022.
Databricks Connect 9.1.24
September 12, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of September 6, 2022.
Databricks Connect 9.1.23
August 25, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of August 25, 2022.
Databricks Connect 9.1.22
August 12, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of August 12, 2022.
Databricks Connect 9.1.21
July 29, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of July 29, 2022.
Databricks Connect 9.1.20
July 15, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of July 14, 2022.
Databricks Connect 9.1.18
June 16, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of June 12, 2022.
Databricks Connect 9.1.17
June 7, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of June 2, 2022.
Databricks Connect 9.1.16
May 20, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of May 20, 2022.
Databricks Connect 9.1.15
May 5, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of May 5, 2022.
Databricks Connect 9.1.14
April 21, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of April 21, 2022.
Databricks Connect 9.1.13
April 7, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of April 7, 2022.
Databricks Connect 9.1.12
March 29, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of March 29, 2022.
Databricks Connect 9.1.11
March 10, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of March 10, 2022.
Fix
ClassNotFoundException
error message
Databricks Connect 9.1.9
February 8, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of February 8, 2022.
Databricks Connect 9.1.8
January 26, 2022
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of January 26, 2022.
Databricks Connect 9.1.7
January 19, 2022
[ES-216554] Fixed an issue where cluster-attached libraries were not loaded correctly server-side in some cases
Databricks Connect 9.1.5
December 7, 2021
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of December 7, 2021.
Databricks Connect 9.1.4
November 16, 2021
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of November 16, 2021.
Databricks Connect 9.1.3
November 4, 2021
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of November 4, 2021.
Databricks Connect 9.1.2
October 20, 2021
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of October 20, 2021.
Databricks Connect for Databricks Runtime 8.1
Databricks Connect 8.1.14
September 23, 2021
Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of September 23, 2021.
Databricks Connect 8.1.13
September 15, 2021
Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of September 15, 2021.
Databricks Connect 8.1.12
September 8, 2021
Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of September 8, 2021.
Databricks Connect 8.1.11
August 25, 2021
Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of August 25, 2021.
Databricks Connect 8.1.10
August 11, 2021
Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of August 11, 2021.
Databricks Connect 8.1.9
July 30, 2021
Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of July 30, 2021.
Databricks Connect 8.1.8
July 14, 2021
Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of July 14, 2021.
Databricks Connect 8.1.7
June 29, 2021
Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of June 29, 2021.
Databricks Connect 8.1.6
June 15, 2021
Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of June 15, 2021.
Databricks Connect 8.1.5
June 7, 2021
[ES-102916] Support
no_proxy
environment variable in DBConnnect client. Set it to a comma-separated list of fully qualified domain names for which the proxy set inhttps_proxy
orhttp_proxy
environment variable should not be used.
Databricks Connect 8.1.4
May 26, 2021
Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of May 26, 2021.
Databricks Connect 8.1.3
April 30, 2021
Databricks Connect client update to support Databricks Runtime 8.1 maintenance release of April 30, 2021.
Databricks Connect for Databricks Runtime 7.3 LTS
Databricks Connect 7.3.59
March 8, 2023
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of March 8, 2023.
Databricks Connect 7.3.58
February 20, 2023
Databricks Connect client update to support Databricks Runtime 9.1 maintenance release of February 20, 2023.
[ES-573062] Fixes java.lang.ClassCastException when assigning fields to org.apache.spark.sql.catalyst.json.JSONOptions
Databricks Connect 7.3.55
December 1, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of December 1, 2022.
Databricks Connect 7.3.49
September 12, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of September 6, 2022.
Databricks Connect 7.3.48
August 25, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of August 25, 2022.
Databricks Connect 7.3.47
August 12, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of August 12, 2022.
Databricks Connect 7.3.46
July 29, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of July 29, 2022.
Databricks Connect 7.3.45
July 15, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of July 14, 2022.
Databricks Connect 7.3.43
June 16, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of June 12, 2022.
Databricks Connect 7.3.42
June 7, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of June 2, 2022.
Databricks Connect 7.3.41
May 20, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of May 20, 2022.
Databricks Connect 7.3.40
May 5, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of May 5, 2022.
Databricks Connect 7.3.39
April 21, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of April 21, 2022.
Databricks Connect 7.3.38
April 7, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of April 7, 2022.
Databricks Connect 7.3.37
March 29, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of March 29, 2022.
Databricks Connect 7.3.36
March 10, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of March 10, 2022.
Databricks Connect 7.3.34
February 8, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of February 8, 2022.
Databricks Connect 7.3.33
January 26, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of January 26, 2022.
Databricks Connect 7.3.32
January 19, 2022
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of January 19, 2022.
Databricks Connect 7.3.30
December 7, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of December 7, 2021.
Databricks Connect 7.3.29
November 16, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of November 16, 2021.
Databricks Connect 7.3.28
November 4, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of November 4, 2021.
Databricks Connect 7.3.27
October 20, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of October 20, 2021.
Databricks Connect 7.3.26
October 5, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of October 5, 2021.
Databricks Connect 7.3.25
September 23, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of September 23, 2021.
Databricks Connect 7.3.24
September 15, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of September 15, 2021.
Databricks Connect 7.3.23
September 8, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of September 8, 2021.
Databricks Connect 7.3.22
August 25, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of August 25, 2021.
Databricks Connect 7.3.21
August 11, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of August 11, 2021.
Databricks Connect 7.3.20
July 30, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of July 30, 2021.
Databricks Connect 7.3.19
July 14, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of July 14, 2021.
Databricks Connect 7.3.18
June 29, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of June 29, 2021.
Databricks Connect 7.3.17
June 15, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of June 15, 2021.
Databricks Connect 7.3.16
June 7, 2021
[ES-102916] Support
no_proxy
environment variable in DBConnnect client. Set it to a comma-separated list of fully qualified domain names for which the proxy set inhttps_proxy
orhttp_proxy
environment variable should not be used.
Databricks Connect 7.3.15
May 26, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of May 26, 2021.
Databricks Connect 7.3.14
April 30, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of April 30, 2021.
Databricks Connect 7.3.13
April 27, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of April 27, 2021.
Databricks Connect 7.3.11
March 24, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of March 24, 2021
Databricks Connect 7.3.10
March 9, 2021
[ES-69946] Fix path separator on Windows for
databricks-connect get-jar-dir
[ES-68776] Update Azure Blob File System client
Add support for FlatMapCoGroupsInPandas
Make initial connection process during cluster startup more robust
Note
The Databricks Runtime cluster must be running the latest maintenance release, and the Databricks Connect client must be updated to version 7.3.10 to continue to use the Azure Blob File System and
mapPartitions
andmapElements
RDD operations with Databricks Connect. A restart of the Databricks Runtime cluster is required to update it to the latest maintenance release.
Databricks Connect 7.3.9
February 23, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of February 23, 2021
Databricks Connect 7.3.8
February 4, 2021
[ES-58153] Fix Analysis Exception when creating tables or views based on a query with aggregations.
Databricks Connect 7.3.7
January 20, 2021
Databricks Connect client update to support Databricks Runtime 7.3 maintenance release of January 20, 2021
Databricks Connect 7.3.6
January 12, 2021
[ES-59054] Fix Delta Optimize Table command through Databricks Connect
[ES-53497] Fix Databricks Connect on Databricks Container Services (DCS)
Databricks Connect 7.3.5
December 9, 2020
Databricks Connect 7.3 is now GA.
[ES-49865] Prevent 500 Internal Server Errors due to automatic synchronization of dependent libraries when using Databricks Connect with SBT.
Databricks Connect 7.3.4 Beta
November 24, 2020
[ES-44382] Set
spark.databricks.service.allowTerminatedClusterStart=false
to prevent Databricks Connect from starting a terminated Databricks Runtime cluster.Fix an error where client could not synchronize state with server correctly if
INFO
logging level was disabled.
Databricks Connect 7.3.3 Beta
November 3, 2020
Initial Databricks Connect release for Databricks Runtime 7.3. This release includes:
Support for Delta Lake time travel.
Easy transition between Databricks Connect clients and Databricks Runtime jobs or notebooks when using DBUtils. See Access DBUtils.