Apache Spark API reference

Databricks is built on top of Apache Spark, a unified analytics engine for big data and machine learning. For more information, see Apache Spark on Databricks.

Apache Spark has DataFrame APIs for operating on large datasets, which include over 100 operators. For more information, see Databricks PySpark API Reference.

To learn how to use the Apache Spark APIs on Databricks, see: