Developing Spark Applications

When you are ready to move beyond running core Spark applications in an interactive shell, you need best practices for building, packaging, and configuring applications and using the more advanced APIs. This section describes:

How to develop, package, and run Spark applications.
Aspects of using Spark APIs beyond core Spark.
How to access data stored in various file formats, such as Parquet and Avro.
How to access data stored in cloud storage systems, such as Amazon S3 or Microsoft ADLS.
Best practices in building and configuring Spark applications.

Continue reading:

Developing and Running a Spark WordCount Application
Using Spark Streaming
Using Spark SQL
Using Spark MLlib
Accessing External Storage
Building Spark Applications
Configuring Spark Applications

Categories: Developers | Spark | All Categories

Spark Application Overview

Developing and Running a Spark WordCount Application