Spark History Server

Apache Spark 2 / Spark Core

@jaceklaskowski / StackOverflow / GitHub / Mastering Apache Spark 2

Agenda

  1. Persisting Events using EventLoggingListener
  2. Spark History Server

Persisting Events using EventLoggingListener

  1. EventLoggingListener is a SparkListener that logs JSON-encoded events to a file.
  2. Switch to Mastering Apache Spark 2

Spark History Server

  1. Spark History Server is the web UI for reviewing execution logs of completed and running (aka incomplete) Spark applications.
  2. Switch to Mastering Apache Spark 2

Recap

  1. Persisting Events using EventLoggingListener
  2. Spark History Server

Questions?