Skip to content

Catalog — Metastore Management Interface

Catalog is an abstraction of metadata catalogs for managing relational entities (e.g. database(s), tables, functions, table columns and temporary views).

Catalog is available using SparkSession.catalog property.

assert(spark.isInstanceOf[org.apache.spark.sql.SparkSession])
assert(spark.catalog.isInstanceOf[org.apache.spark.sql.catalog.Catalog])

Contract

cacheTable

cacheTable(
  tableName: String): Unit
cacheTable(
  tableName: String,
  storageLevel: StorageLevel): Unit

Caches a given table

Used for SQL's CACHE TABLE and AlterTableRenameCommand command.

Others

Implementations

Back to top