PollRunnable¶
PollRunnable
is a Java Runnable that ExecutorPodsPollingSnapshotSource uses to run regularly for current snapshots of the executor pods of the application.
PollRunnable
is an internal class of ExecutorPodsPollingSnapshotSource with full access to its internals.
Creating Instance¶
PollRunnable
takes the following to be created:
- Application Id
PollRunnable
is created when:
ExecutorPodsPollingSnapshotSource
is requested to start
Starting Thread¶
run(): Unit
run
prints out the following DEBUG message to the logs:
Resynchronizing full executor pod state from Kubernetes.
run
requests the KubernetesClient for Spark executor pods that are pods with the following labels and values:
spark-app-selector
as the application Idspark-role
asexecutor
In the end, run
requests the ExecutorPodsSnapshotsStore to replace the snapshot.
Logging¶
PollRunnable
uses org.apache.spark.scheduler.cluster.k8s.ExecutorPodsPollingSnapshotSource logger for logging.
Last update: 2021-01-10