KubernetesFeatureConfigStep¶

KubernetesFeatureConfigStep is an abstraction of Kubernetes pod features for drivers and executors.

Contract¶

Configuring Pod¶

configurePod(
  pod: SparkPod): SparkPod

Used when:

• KubernetesDriverBuilder is requested to build a driver pod spec
• KubernetesExecutorBuilder is requested for a pod spec for executors

Additional Kubernetes Resources¶

getAdditionalKubernetesResources(): Seq[HasMetadata]

Additional Kubernetes resources (that are going to created when Client is requested to run)

Default: empty

Used when:

• KubernetesDriverBuilder is requested for a driver pod spec

Additional System Properties¶

getAdditionalPodSystemProperties(): Map[String, String]

Additional system properties of a driver pod (that are going to be part of spark.properties as a ConfigMap)

Default: empty

Used when:

• KubernetesDriverBuilder is requested for a driver pod spec

Implementations¶

• BasicDriverFeatureStep
• BasicExecutorFeatureStep
• DriverCommandFeatureStep
• DriverKubernetesCredentialsFeatureStep
• DriverServiceFeatureStep
• EnvSecretsFeatureStep
• ExecutorKubernetesCredentialsFeatureStep
• HadoopConfDriverFeatureStep
• KerberosConfDriverFeatureStep
• LocalDirsFeatureStep
• MountSecretsFeatureStep
• MountVolumesFeatureStep
• PodTemplateConfigMapStep