V2CommandExec Physical Commands¶

V2CommandExec is an extension of the SparkPlan abstraction for physical commands that can be executed and cache the result to prevent multiple executions.

Contract¶

Executing Command¶

run(): Seq[InternalRow]

Executing the command (and computing the result)

Used when V2CommandExec physical command is requested for a result.

Implementations¶

• AlterNamespaceSetPropertiesExec
• AlterTableExec
• AtomicReplaceTableExec
• CreateNamespaceExec
• CreateTableExec
• DeleteFromTableExec
• DescribeNamespaceExec
• DescribeTableExec
• DropNamespaceExec
• DropTableExec
• RefreshTableExec
• RenameTableExec
• ReplaceTableExec
• SetCatalogAndNamespaceExec
• ShowCurrentNamespaceExec
• ShowNamespacesExec
• ShowTablePropertiesExec
• ShowTablesExec
• V1FallbackWriters
• V2TableWriteExec

result¶

result: Seq[InternalRow]

result is the cached result of executing the physical command.

result is used when V2CommandExec physical command is requested to doExecute, executeCollect, executeToIterator, executeTake or executeTail.

Executing Physical Operator¶

doExecute(): RDD[InternalRow]

doExecute...FIXME

doExecute is part of the SparkPlan abstraction.

executeCollect¶

executeCollect(): Array[InternalRow]

executeCollect...FIXME

executeCollect is part of the SparkPlan abstraction.

executeToIterator¶

executeToIterator: Iterator[InternalRow]

executeToIterator...FIXME

executeToIterator is part of the SparkPlan abstraction.

executeTake¶

executeTake(
  limit: Int): Array[InternalRow]

executeTake...FIXME

executeTake is part of the SparkPlan abstraction.

executeTail¶

executeTail(
  limit: Int): Array[InternalRow]

executeTail...FIXME

executeTail is part of the SparkPlan abstraction.