Skip to content

KubernetesExecutorConf

KubernetesExecutorConf is a KubernetesConf (for KubernetesExecutorBuilder to build a pod spec for executors).

KubernetesExecutorConf, ExecutorPodsAllocator and KubernetesExecutorBuilder

Creating Instance

KubernetesExecutorConf takes the following to be created:

  • SparkConf
  • Application ID
  • Executor ID
  • Driver Pod

KubernetesExecutorConf is created when:

Volumes

volumes: Seq[KubernetesVolumeSpec]

volumes is part of the KubernetesConf abstraction.

volumes parses volume specs for the executor pod (with the spark.kubernetes.executor.volumes. prefix) from the SparkConf.


Last update: 2021-03-10