Skip to content

Table

Table is an abstraction of logical structured data set:

  • a directory or files on a file system
  • a topic of Apache Kafka
  • a table in a catalog
  • others

Contract

Table Capabilities

Set<TableCapability> capabilities()

TableCapabilities of the table

Used when Table is asked whether or not it supports a given capability

name

String name()

Name of the table

partitioning

Transform[] partitioning()

Partitions of the table (as Transforms)

Default: (empty)

Used when:

properties

Map<String, String> properties()

Table properties

Default: (empty)

Used when:

schema

StructType schema()

StructType of the table

Used when:

Implementations

  • ConsoleTable (Spark Structured Streaming)
  • FileTable
  • ForeachWriterTable (Spark Structured Streaming)
  • KafkaTable
  • MemorySink (Spark Structured Streaming)
  • MemoryStreamTable (Spark Structured Streaming)
  • NoopTable
  • RateStreamTable (Spark Structured Streaming)
  • Sink (Spark Structured Streaming)
  • StagedTable
  • SupportsRead
  • SupportsWrite
  • TextSocketTable (Spark Structured Streaming)
  • V1Table

Last update: 2020-11-13