Skip to content

UnresolvedFunction Unevaluable Expression

UnresolvedFunction is an Catalyst expression that represents a function (application) in a logical query plan.

UnresolvedFunction is <> as a result of the following:

[[resolved]] UnresolvedFunction can never be[resolved] (and is replaced at analysis phase).

NOTE: UnresolvedFunction is first looked up in LookupFunctions logical rule and then resolved in ResolveFunctions logical resolution rule.

[[Unevaluable]][[eval]][[doGenCode]] Given UnresolvedFunction can never be resolved it should not come as a surprise that it cannot be evaluated either (i.e. produce a value given an internal row). When requested to evaluate, UnresolvedFunction simply reports a UnsupportedOperationException.

Cannot evaluate expression: [this]

TIP: Use Catalyst DSL's function or distinctFunction to create a UnresolvedFunction with <> flag off and on, respectively.

[source, scala]

// Using Catalyst DSL to create UnresolvedFunctions import org.apache.spark.sql.catalyst.dsl.expressions._

// Scala Symbols supported only val f = 'f.function() scala> :type f org.apache.spark.sql.catalyst.analysis.UnresolvedFunction

scala> f.isDistinct res0: Boolean = false

val g = 'g.distinctFunction() scala> g.isDistinct res1: Boolean = true

=== [[apply]] Creating UnresolvedFunction (With Database Undefined) -- apply Factory Method

[source, scala]

apply(name: String, children: Seq[Expression], isDistinct: Boolean): UnresolvedFunction

apply creates a FunctionIdentifier with the name and no database first and then creates a <> with the FunctionIdentifier, children and isDistinct flag.

apply is used when:

Creating Instance

UnresolvedFunction takes the following to be created:

  • [[name]] FunctionIdentifier
  • [[children]] Child[expressions]
  • [[isDistinct]] isDistinct flag
Back to top