Use IDEs with Databricks

You can connect many popular third-party integrated development environments (IDEs), such as Visual Studio Code, to a Databricks cluster or a Databricks SQL warehouse. This allows you to write code on your local development machine and then run that code remotely on Databricks.

Name

Use this when you want to…

Databricks Connect

Use common IDEs, notebooks servers, or the Spark shell to run local Python code on a remote Databricks workspace.

Databricks extension for Visual Studio Code

Use Visual Studio Code to run local Python, R, Scala, and SQL code on a remote Databricks workspace.

dbx by Databricks Labs

Use an open source tool which is designed to provide functionality for rapid development lifecycle and continuous integration and continuous delivery/deployment (CI/CD) on the Databricks platform. dbx simplifies jobs launch and deployment processes across multiple environments. It also helps to package your project and deliver it to your Databricks environment in a versioned fashion. Designed in a CLI-first manner, it is built to be actively used both inside CI/CD pipelines and as a part of local tooling (such as local IDEs).

dbx with Visual Studio Code

Use Visual Studio Code, along with dbx by Databricks Labs, to automate Databricks.

dbx sync

Perform real-time synchronization of changes to files on your local development machine with their corresponding files in your Databricks workspaces.

Databricks Driver for SQLTools

Use Visual Studio Code to interact with Databricks SQL warehouses in remote Databricks workspaces.