Using TaskCompletionListener, TaskFailureListener, TaskContext

Apache Spark 2 Workshop Exercises

@jaceklaskowski / StackOverflow / GitHub / Mastering Apache Spark 2

Using TaskCompletionListener, TaskFailureListener, TaskContext

  1. Create a Spark project using IDEA and sbt
  2. Run a Spark job
  3. Register a TaskCompletion- and TaskFailureListeners
  4. Cause a failure == throw an exception (hint: use TaskContext)
  5. Use web UI to see what you've done (you bad boy! :))
  6. Time to complete: 1 hour

Questions?