KeyValueGroupedDataset — Typed Grouping¶

KeyValueGroupedDataset is an experimental interface to <> in a typed Dataset.

KeyValueGroupedDataset is created using spark-sql-basic-aggregation.md#groupByKey[Dataset.groupByKey] operator.

[source, scala]¶

val dataset: Dataset[Token] = ... scala> val tokensByName = dataset.groupByKey(_.name) tokensByName: org.apache.spark.sql.KeyValueGroupedDataset[String,Token] = org.apache.spark.sql.KeyValueGroupedDataset@1e3aad46

[[operators]] .KeyValueGroupedDataset's Aggregate Operators (KeyValueGroupedDataset API) [cols="1,3",options="header",width="100%"] |=== | Operator | Description

| agg | [[agg]]

KeyValueGroupedDataset holds keys that were used for the object.

[source, scala]¶

scala> tokensByName.keys.show +-----+ |value| +-----+ | aaa| | bbb| +-----+

=== [[aggUntyped]] aggUntyped Internal Method

[source, scala]¶

aggUntyped(columns: TypedColumn[, _]*): Dataset[]¶

aggUntyped...FIXME

NOTE: aggUntyped is used exclusively when <> typed operator is used.

=== [[logicalPlan]] logicalPlan Internal Method

[source, scala]¶

logicalPlan: AnalysisBarrier¶

logicalPlan...FIXME

NOTE: logicalPlan is used when...FIXME