Installing and Upgrading Spark
To see which version of Spark is shipping in the current release, check the CDH Version and Packaging Information. For important information, see the CDH 5 Release Notes, in particular:
- New Features and Changes in CDH 5
- Apache Spark Incompatible Changes and Limitations
- Apache Spark Known Issues
-
RHEL-compatible system:
- To install all Spark packages:
$ sudo yum install spark-core spark-master spark-worker spark-history-server spark-python - To install only the packages needed to run Spark on YARN:
$ sudo yum install spark-core spark-history-server spark-python
- To install all Spark packages:
-
SLES system:
- To install all Spark packages:
$ sudo zypper install spark-core spark-master spark-worker spark-history-server spark-python - To install only the packages needed to run Spark on YARN:
$ sudo zypper install spark-core spark-history-server spark-python
- To install all Spark packages:
-
Ubuntu or Debian system:
- To install all Spark packages:
$ sudo apt-get install spark-core spark-master spark-worker spark-history-server spark-python - To install only the packages needed to run Spark on YARN:
$ sudo apt-get install spark-core spark-history-server spark-python
- To install all Spark packages:
You are now ready to configure and start Spark. See Managing Spark Standalone Using the Command Line.