DataWritingCommandExec Physical Operator¶
DataWritingCommandExec
is a <
DataWritingCommandExec
is <
[[metrics]] When requested for <DataWritingCommandExec
simply requests the <
[[internal-registries]] .DataWritingCommandExec's Internal Properties (e.g. Registries, Counters and Flags) [cols="1m,2",options="header",width="100%"] |=== | Name | Description
| sideEffectResult | [[sideEffectResult]] InternalRows (Seq[InternalRow]
) that is the result of executing the DataWritingCommand (with the SparkPlan)
Used when DataWritingCommandExec
is requested to <
=== [[creating-instance]] Creating DataWritingCommandExec Instance
DataWritingCommandExec
takes the following when created:
- [[cmd]] <
> - [[child]] Child <
>
=== [[executeCollect]] Executing Physical Operator and Collecting Results -- executeCollect
Method
[source, scala]¶
executeCollect(): Array[InternalRow]¶
NOTE: executeCollect
is part of the <
executeCollect
...FIXME
=== [[executeToIterator]] executeToIterator
Method
[source, scala]¶
executeToIterator: Iterator[InternalRow]¶
NOTE: executeToIterator
is part of the <
executeToIterator
...FIXME
=== [[executeTake]] Taking First N UnsafeRows -- executeTake
Method
[source, scala]¶
executeTake(limit: Int): Array[InternalRow]¶
NOTE: executeTake
is part of the <UnsafeRows
.
executeTake
...FIXME
=== [[doExecute]] Executing Physical Operator (Generating RDD[InternalRow]) -- doExecute
Method
[source, scala]¶
doExecute(): RDD[InternalRow]¶
doExecute
is part of the SparkPlan abstraction.
doExecute
simply requests the <parallelize
) the <