Skip to content

CatalogUtils Helper Object

CatalogUtils is a Scala object with the <> to support PreprocessTableCreation post-hoc logical resolution rule (among others).

[[methods]] .CatalogUtils API [cols="1m,2",options="header",width="100%"] |=== | Name | Description

| maskCredentials a| [[maskCredentials]]

[source, scala]

maskCredentials(options: Map[String, String]): Map[String, String]

Used when:

| normalizeBucketSpec a| [[normalizeBucketSpec]]

[source, scala]

normalizeBucketSpec( tableName: String, tableCols: Seq[String], bucketSpec: BucketSpec, resolver: Resolver): BucketSpec


Used exclusively when PreprocessTableCreation post-hoc logical resolution rule is executed.

| normalizePartCols a| [[normalizePartCols]]

[source, scala]

normalizePartCols( tableName: String, tableCols: Seq[String], partCols: Seq[String], resolver: Resolver): Seq[String]


Used exclusively when PreprocessTableCreation post-hoc logical resolution rule is executed.

|===

=== [[normalizeColumnName]] normalizeColumnName Internal Method

[source, scala]

normalizeColumnName( tableName: String, tableCols: Seq[String], colName: String, colType: String, resolver: Resolver): String


normalizeColumnName...FIXME

NOTE: normalizeColumnName is used when CatalogUtils is requested to <> and <>.


Last update: 2021-03-18