Skip to content

ExecutorPodsWatcher

ExecutorPodsWatcher is a Kubernetes' Watcher[Pod] to be notified about executor pod updates (and update the ExecutorPodsSnapshotsStore of the parent ExecutorPodsWatchSnapshotSource).

ExecutorPodsWatcher is an internal class of ExecutorPodsWatchSnapshotSource with full access to its internals.

Creating Instance

ExecutorPodsWatcher takes no arguments to be created.

ExecutorPodsWatcher is created when:

Executor Pod Update

eventReceived(
  action: Action,
  pod: Pod): Unit

eventReceived is part of the Kubernetes Client Watcher abstraction.

eventReceived prints out the following DEBUG message to the logs:

Received executor pod update for pod named [podName], action [action]

eventReceived requests the ExecutorPodsSnapshotsStore (of the parent ExecutorPodsWatchSnapshotSource) to updatePod.

Close Notification

onClose(
  e: KubernetesClientException): Unit

onClose is part of the Kubernetes Client Watcher abstraction.

onClose prints out the following WARN message to the logs:

Kubernetes client has been closed (this is expected if the application is shutting down.)

Logging

ExecutorPodsWatcher uses org.apache.spark.scheduler.cluster.k8s.ExecutorPodsWatchSnapshotSource logger for logging.


Last update: 2021-01-10