Use IDEs with Databricks
You can connect many popular third-party integrated development environments (IDEs) to a Databricks cluster. This allows you to write code on your local development machine by using the Spark APIs and then run that code as jobs remotely on a Databricks cluster.
Name |
Use this when you want to… |
---|---|
Use an open source tool which is designed to provide functionality for rapid development lifecycle and continuous integration and continuous delivery/deployment (CI/CD) on the Databricks platform. |
|
Use third-party integrated development environments (IDEs), such as Visual Studio Code, PyCharm, IntelliJ IDEA, and Eclipse, along with |
|
Perform real-time synchronization of changes to files on your local development machine with their corresponding files in your Databricks workspaces. |
|
Use Visual Studio Code to interact with Databricks SQL warehouses in remote Databricks workspaces. |
Note
Databricks also supports a tool named Databricks Connect. However, Databricks recommends that you use dbx by Databricks Labs for local development instead of Databricks Connect.