Skip to content

PartitionReaderFactory

PartitionReaderFactory is an abstraction of partition reader factories that can create partition or columnar partition readers.

Contract

createColumnarReader

PartitionReader<ColumnarBatch> createColumnarReader(
    InputPartition partition)

Creates a columnar partition reader to read data from the given InputPartition.

By default, createColumnarReader throws an UnsupportedOperationException:

Cannot create columnar reader.

Used when...FIXME

createReader

PartitionReader<InternalRow> createReader(
    InputPartition partition)

Creates a row-based partition reader to read data from the given InputPartition.

Used when...FIXME

supportColumnarReads

boolean supportColumnarReads(
    InputPartition partition)

By default, supportColumnarReads indicates no support for columnar reads (and returns false).

Used when...FIXME

Implementations

  • ContinuousPartitionReaderFactory
  • FilePartitionReaderFactory
  • KafkaBatchReaderFactory
  • MemoryStreamReaderFactory
  • RateStreamMicroBatchReaderFactory
Back to top