Skip to content

ShuffleExchangeLike Physical Operators

ShuffleExchangeLike is an extension of the Exchange abstraction for physical operators that...FIXME

Contract

getShuffleRDD

getShuffleRDD(
  partitionSpecs: Array[ShufflePartitionSpec]): RDD[_]

Used when:

  • CustomShuffleReaderExec physical operator is requested for the shuffleRDD

mapOutputStatisticsFuture

mapOutputStatisticsFuture: Future[MapOutputStatistics]

Used when:

numMappers

numMappers: Int

Used when:

numPartitions

numPartitions: Int

Used when:

runtimeStatistics

runtimeStatistics: Statistics

Used when:

shuffleOrigin

shuffleOrigin: ShuffleOrigin

Used when:

Implementations


Last update: 2021-05-17
Back to top