Learning Spark: Lightning-Fast Big Data Analysis

Data in all domains is getting bigger. How can you work with it efficiently? Learning Spark: Lightning-Fast Big Data Analysis introduces Apache Spark, the open source cluster computing system that makes data analytics fast to write and fast to run. With Spark, you can tackle big datasets quickly through simple APIs in Python, Java, and Scala.

Written by the developers of Spark, this book will have data scientists and engineers up and running in no time. You’ll learn how to express parallel jobs with just a few lines of code, and cover applications from simple batch jobs to stream processing and machine learning.

• Quickly dive into Spark capabilities such as distributed datasets, in-memory caching, and the interactive shell
• Leverage Spark’s powerful built-in libraries, including Spark SQL, Spark Streaming, and MLlib
• Use one programming paradigm instead of mixing and matching tools like Hive, Hadoop, Mahout, and Storm
• Learn how to deploy interactive, batch, and streaming applications
• Connect to data sources including HDFS, Hive, JSON, and S3
• Master advanced topics like data partitioning and shared variables

Table of Contents

Chapter 1 Introduction to Data Analysis with Spark
Chapter 2 Downloading Spark and Getting Started
Chapter 3 Programming with RDDs
Chapter 4 Working with Key/Value Pairs
Chapter 5 Loading and Saving Your Data
Chapter 6 Advanced Spark Programming
Chapter 7 Running on a Cluster
Chapter 8 Tuning and Debugging Spark
Chapter 9 Spark SQL
Chapter 10 Spark Streaming
Chapter 11 Machine Learning with MLlib