Develop a standalone Spark Structured Streaming application (using IntelliJ IDEA) that uses DataStreamWriter.foreachBatch operation to execute SQL statements coming in as records from Apache Kafka, e.g.
SELECT * FROM t1
Use sbt package
the application and spark-submit
it.
Module: Spark Structured Streaming
Duration: 30 mins