KubernetesExecutorConf¶
KubernetesExecutorConf
is a KubernetesConf (for KubernetesExecutorBuilder to build a pod spec for executors).
Creating Instance¶
KubernetesExecutorConf
takes the following to be created:
-
SparkConf
(Apache Spark) - Application ID
- Executor ID
- Driver Pod
- Resource Profile ID (default:
0
)
KubernetesExecutorConf
is created when:
ExecutorPodsAllocator
is requested for new executors (and createExecutorConf)
Volumes¶
volumes: Seq[KubernetesVolumeSpec]
volumes
parses volume specs for the executor pod (with the spark.kubernetes.executor.volumes. prefix) from the SparkConf.
volumes
is part of the KubernetesConf abstraction.
Resource Name Prefix¶
resourceNamePrefix: String
resourceNamePrefix
is the value of the spark.kubernetes.executor.podNamePrefix (if defined) or the resource name prefix (for the appName).
resourceNamePrefix
is part of the KubernetesConf abstraction.