PollRunnable is a Java Runnable that ExecutorPodsPollingSnapshotSource schedules for full executor pod state snapshots from Kubernetes every spark.kubernetes.executor.apiPollingInterval in the Spark application.
PollRunnable is an internal class of ExecutorPodsPollingSnapshotSource with full access to its internals.
PollRunnable takes the following to be created:
- Application Id
PollRunnable is created when:
ExecutorPodsPollingSnapshotSourceis requested to start
run prints out the following DEBUG message to the logs:
Resynchronizing full executor pod state from Kubernetes.
run requests the KubernetesClient for Spark executor pods with the following labels and values.
| ||application Id|
| || |
|spark-exec-inactive||any value but |
PollRunnable uses org.apache.spark.scheduler.cluster.k8s.ExecutorPodsPollingSnapshotSource logger for logging.