Using TaskCompletionListener, TaskFailureListener, TaskContext
Apache Spark 2 Workshop Exercises
Using TaskCompletionListener, TaskFailureListener, TaskContext
- Create a Spark project using IDEA and sbt
- Run a Spark job
- Register a TaskCompletion- and TaskFailureListeners
- Cause a failure == throw an exception (hint: use TaskContext)
- Use web UI to see what you've done (you bad boy! :))
- Time to complete: 1 hour