Copyright ©2017 Jacek Laskowski

Spark Thrift Server

(Spark for JDBC/ODBC clients)

Apache Spark 2 / Spark SQL

Yammer: AML Spark Training Class

Agenda

  1. Spark Thrift JDBC/ODBC Server
  2. Spark Thrift Server's Web Console
  3. Demo - Using JDBC Clients with Spark SQL

Spark Thrift JDBC/ODBC Server

  1. Thrift JDBC/ODBC Server or Spark Thrift Server is Spark SQL's JDBC/ODBC Interface
  2. Switch to Mastering Apache Spark 2

Spark Thrift Server's Architecture

Spark Thrift Server's Architecture From How HiveServer2 Brings Security and Concurrency to Apache Hive

Spark Thrift Server's Web Console

  1. ThriftServerTab is an extension to Spark's web UI
  2. Available at localhost:4040/sqlserver
  3. Demo Time!

Demo - Using JDBC Clients with Spark SQL

  1. Beeline JDBC Client (included in Spark)
  2. SQuirreL SQL Client 3.7.1 (external tool)
  3. Spark SQL’s DataSource API
  4. Switch to Mastering Apache Spark 2

Recap

  1. Spark Thrift JDBC/ODBC Server
  2. Spark Thrift Server's Web Console
  3. Demo - Using JDBC Clients with Spark SQL

Questions?