Skip to content

The Internals of Spark on Kubernetes

Logging

Initializing search

spark-kubernetes-book

Home
Internals
Features
Demos

The Internals of Spark on Kubernetes

spark-kubernetes-book

Home
Internals
Internals
- Overview
- Configuration Properties
- KubernetesClusterManager
- KubernetesClusterSchedulerBackend
- KubernetesDriverEndpoint
- Cluster Deploy Mode
  Cluster Deploy Mode
- ExecutorPodsLifecycleManager
- ExecutorPodsSnapshotsStore
- ExecutorPodsSnapshot
- Executor Pods Watchers
  Executor Pods Watchers
  - ExecutorPodsWatchSnapshotSource
  - ExecutorPodsWatcher
- ExecutorPodsPollingSnapshotSource
- ExecutorPodsSnapshotsStoreImpl
- SnapshotsSubscriber
- ExecutorPodsAllocator
- KubernetesExecutorBuilder
- LoggingPodStatusWatcher
- PollRunnable
- ClientArguments
- Configuration Metadata
  Configuration Metadata
- Kubernetes Pod Feature Steps
  Kubernetes Pod Feature Steps
- K8SSparkSubmitOperation
- KubernetesVolumeSpec
- Utilities
  Utilities
- Logging
Features
Features
- Volumes
Demos
Demos
- minikube
  minikube
- Google Kubernetes Engine
  Google Kubernetes Engine

Logging¶

Spark uses log4j for logging.

Note

Learn more on Spark Logging in The Internals of Apache Spark online book.

Last update: 2021-01-06

Previous SparkKubernetesClientFactory

Copyright © 2021 Jacek Laskowski

Made with Material for MkDocs Insiders