Spark GraphX in Action

Summary

Spark GraphX in Action starts out with an overview of Apache Spark and the GraphX graph processing API. This example-based tutorial then teaches you how to configure GraphX and how to use it interactively. Along the way, you’ll collect practical techniques for enhancing applications and applying machine learning algorithms to graph data.

Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications.

About the Technology

GraphX is a powerful graph processing API for the Apache Spark analytics engine that lets you draw insights from large datasets. GraphX gives you unprecedented speed and capacity for running massively parallel and machine learning algorithms.

About the Book

Spark GraphX in Action begins with the big picture of what graphs can be used for. This example-based tutorial teaches you how to use GraphX interactively. You’ll start with a crystal-clear introduction to building big data graphs from regular data, and then explore the problems and possibilities of implementing graph algorithms and architecting graph processing pipelines. Along the way, you’ll collect practical techniques for enhancing applications and applying machine learning algorithms to graph data.

What’s Inside

• Understanding graph technology
• Using the GraphX API
• Developing algorithms for big graphs
• Machine learning with graphs
• Graph visualization

About the Reader

Readers should be comfortable writing code. Experience with Apache Spark and Scala is not required.

About the Authors

Michael Malak has worked on Spark applications for Fortune 500 companies since early 2013. Robin East has worked as a consultant to large organizations for over 15 years and is a data scientist at Worldpay.

Table of Contents

Part 1 Spark and graphs
Chapter 1 Two important technologies: Spark and graphs
Chapter 2 GraphX quick start
Chapter 3 Some fundamentals

Part 2 Connecting vertices
Chapter 4 GraphX Basics
Chapter 5 Built-in algorithms
Chapter 6 Other useful graph algorithms
Chapter 7 Machine learning

Part 3 Over the arc
Chapter 8 The missing algorithms
Chapter 9 Performance and monitoring
Chapter 10 Other languages and tools

Appendix A Installing Spark
Appendix B Gephi visualization software
Appendix C Resources: where to go for more
Appendix D List of Scala tips in this book