spark-workshop

Exercise: Your First Standalone Structured Streaming Application

Develop a standalone Spark Structured Streaming application (using IntelliJ IDEA) that uses rate streaming source and prints the result of query processing out to the console (using console streaming sink).

Use sbt package the application and spark-submit it.

Protip™: Use the available options of the rate and console data sources:

  1. RateStreamSource
  2. ConsoleSinkProvider

Module: Spark Structured Streaming

Duration: 30 mins