Spark 2.0 / Scala Workshop Day 1

Large-Scale Big Data Analytics

Jacek Laskowski / @jaceklaskowski / GitHub / Mastering Apache Spark Notes

Modules - Day 1 (1 of 2)

  • The Elements of Apache Spark (aka Why Spark)
  • Tools Intro - IntelliJ IDEA and Scala Worksheet
  • Introduction to Scala (aka Why Scala)
  • Spark Setup and Your First Spark Application
  • Exercise: My First Scala Application (using IntelliJ IDEA)

Modules - Day 1 (2 of 2)

  • sbt and sbt-assembly
  • Exercise: Running Scala Application from Command Line
  • Introduction to Spark SQL using spark-shell and web UI
  • Exercise: My First Spark SQL Application (using IntelliJ IDEA)
  • Introduction to spark-submit and run-example
  • Exercise: spark-submit Your Spark App / run-example SparkPi

Questions?