Skip to content

BatchScanExec Physical Operator

BatchScanExec is a leaf physical operator.

Creating Instance

BatchScanExec takes the following to be created:

  • Output schema (Seq[AttributeReference])
  • Scan

BatchScanExec is created when DataSourceV2Strategy execution planning strategy is executed (for physical operators with DataSourceV2ScanRelation relations).

batch

batch: Batch

batch requests the Scan to toBatch.

batch is used when requested for partitions and readerFactory.

inputRDD

inputRDD: RDD[InternalRow]

inputRDD creates a DataSourceRDD.

inputRDD is part of the DataSourceV2ScanExecBase abstraction.

partitions

partitions: Seq[InputPartition]

partitions...FIXME

partitions is part of the DataSourceV2ScanExecBase abstraction.

readerFactory

readerFactory: Seq[InputPartition]

readerFactory...FIXME

readerFactory is part of the DataSourceV2ScanExecBase abstraction.


Last update: 2020-09-08