KubernetesClientUtils Utility¶

Name of Config Map for Executors¶

configMapNameExecutor: String

KubernetesClientUtils defines the name of a config map for executors as follows:

spark-exec-[uniqueID]-conf-map

spark-exec-[uniqueID] is made under 54 characters to let configMapNameExecutor be at 63 characters maximum.

buildSparkConfDirFilesMap¶

buildSparkConfDirFilesMap(
  configMapName: String,
  sparkConf: SparkConf,
  resolvedPropertiesMap: Map[String, String]): Map[String, String]

buildSparkConfDirFilesMap...FIXME

buildSparkConfDirFilesMap is used when:

• BasicExecutorFeatureStep is requested to configure a pod
• Client is requested to run
• KubernetesClusterSchedulerBackend is requested to setUpExecutorConfigMap

loadSparkConfDirFiles¶

loadSparkConfDirFiles(
  conf: SparkConf): Map[String, String]

loadSparkConfDirFiles...FIXME