Create a cluster
There are two types of clusters:
All-Purpose clusters can be shared by multiple users. These are typically used to run notebooks. All-Purpose clusters remain active until you terminate them.
Job clusters run a job. You create a job cluster when you create a job. Such clusters are terminated automatically after the job is completed.
This article describes how to create an all-purpose cluster. To learn how to create job clusters, see Create a job.
You can also create a cluster using the Clusters API 2.0.
Note
You must have permission to create a cluster. See Configure cluster creation entitlement.
Use the Create button
The easiest way to create a new cluster is to use the Create button:
Click
Create in the sidebar and select Cluster from the menu. The Create Cluster page appears.
Name and configure the cluster.
There are many cluster configuration options, which are described in detail in cluster configuration.
Click the Create Cluster button.
The cluster Configuration tab displays a spinning progress indicator while the cluster is in a
pending
state. When the cluster has started and is ready to use, the progress spinner turns into a green circle with a check mark. This indicates that cluster is in therunning
state, and you can now attach notebooks and start running commands and queries.
Use the cluster UI
Click
Compute in the sidebar.
Click the Create Cluster button.
Follow steps 2 and 3 in Use the Create button.
Use Terraform
You can create clusters by using the Databricks Terraform provider and databricks_cluster.
You can retrieve information about clusters by using the Databricks Terraform provider and databricks_clusters.
You can install a library on a cluster by using the Databricks Terraform provider and databricks_library.