DataWritingCommandExec Physical Operator¶

DataWritingCommandExec is a <> that is the execution environment for a <> logical command at <>.

DataWritingCommandExec is <> exclusively when BasicOperators execution planning strategy is requested to plan a <> logical command.

[[metrics]] When requested for <>, DataWritingCommandExec simply requests the <> for <>.

[[internal-registries]] .DataWritingCommandExec's Internal Properties (e.g. Registries, Counters and Flags) [cols="1m,2",options="header",width="100%"] |=== | Name | Description

| sideEffectResult | [[sideEffectResult]] InternalRows (Seq[InternalRow]) that is the result of executing the DataWritingCommand (with the SparkPlan)

Used when DataWritingCommandExec is requested to <>, <>, <> and <> |===

=== [[creating-instance]] Creating DataWritingCommandExec Instance

DataWritingCommandExec takes the following when created:

• [[cmd]] <>
• [[child]] Child <>

=== [[executeCollect]] Executing Physical Operator and Collecting Results -- executeCollect Method

[source, scala]¶

executeCollect(): Array[InternalRow]¶

NOTE: executeCollect is part of the <> to execute the physical operator and collect results.

executeCollect...FIXME

=== [[executeToIterator]] executeToIterator Method

[source, scala]¶

executeToIterator: Iterator[InternalRow]¶

NOTE: executeToIterator is part of the <> to...FIXME.

executeToIterator...FIXME

=== [[executeTake]] Taking First N UnsafeRows -- executeTake Method

[source, scala]¶

executeTake(limit: Int): Array[InternalRow]¶

NOTE: executeTake is part of the <> to take the first n UnsafeRows.

executeTake...FIXME

=== [[doExecute]] Executing Physical Operator (Generating RDD[InternalRow]) -- doExecute Method

[source, scala]¶

doExecute(): RDD[InternalRow]¶

doExecute is part of the SparkPlan abstraction.

doExecute simply requests the <> for the SparkContext that is then requested to distribute (parallelize) the <> (over 1 partition).