Skip to content

KubernetesExecutorConf

KubernetesExecutorConf is a KubernetesConf (for KubernetesExecutorBuilder to build a pod spec for executors).

KubernetesExecutorConf, ExecutorPodsAllocator and KubernetesExecutorBuilder

Creating Instance

KubernetesExecutorConf takes the following to be created:

  • SparkConf (Apache Spark)
  • Application ID
  • Executor ID
  • Driver Pod
  • Resource Profile ID (default: 0)

KubernetesExecutorConf is created when:

Volumes

volumes: Seq[KubernetesVolumeSpec]

volumes parses volume specs for the executor pod (with the spark.kubernetes.executor.volumes. prefix) from the SparkConf.

volumes is part of the KubernetesConf abstraction.

Resource Name Prefix

resourceNamePrefix: String

resourceNamePrefix is the value of the spark.kubernetes.executor.podNamePrefix (if defined) or the resource name prefix (for the appName).

resourceNamePrefix is part of the KubernetesConf abstraction.

Back to top