Use CI/CD
To manage the lifecycle of Databricks assets and data, you can use continuous integration and continuous delivery (CI/CD) and data pipeline tools.
Area |
Use these tools when you want to… |
---|---|
Use GitHub and Databricks Repos for source control and CI/CD workflows. |
|
Build a CI/CD workflow on GitHub that uses GitHub Actions developed for Databricks. |
|
Develop a CI/CD pipeline for Databricks that uses Jenkins. |
|
Manage and schedule a data pipeline that uses Apache Airflow. |
|
Use service principals, instead of users, with CI/CD systems. |