Apache Spark is a multi-language engine for executing data engineering, data science, and machine learning on single-node machines or clusters.

To follow along with this guide, first, download a packaged release of Spark from the Spark website. Since we won’t be using HDFS, you can download a package for any version of Hadoop.

Spark SQL is a Spark module for structured data processing. Unlike the basic Spark RDD API, the interfaces provided by Spark SQL provide Spark with more information about the structure of both …

Dec 11, 2025 · PySpark combines Python’s learnability and ease of use with the power of Apache Spark to enable processing and analysis of data at any size for everyone familiar with Python. PySpark …

Spark 3.5.5 released We are happy to announce the availability of Spark 3.5.5! Visit the release notes to read about the new features, or download the release today. Spark News Archive

Apache Spark™ Documentation Setup instructions, programming guides, and other documentation are available for each stable version of Spark below: Spark Spark 4.1.0

There are more guides shared with other languages such as Quick Start in Programming Guides at the Spark documentation. There are live notebooks where you can try PySpark out without any other step:

Apache Spark 4.0.0 marks a significant milestone as the inaugural release in the 4.x series, embodying the collective effort of the vibrant open-source community.

Nov 19, 2025 · We’re proud to announce the release of Spark 0.7.0, a new major version of Spark that adds several key features, including a Python API for Spark and an alpha of Spark Streaming.

Spark 4.0.0 released We are happy to announce the availability of Spark 4.0.0! Visit the release notes to read about the new features, or download the release today. Spark News Archive