Skip to content

SupportsAdmissionControl

SupportsAdmissionControl is an extension of the SparkDataStream abstraction for streaming sources that want to control the rate of data ingested in Micro-Batch Stream Processing.

Contract

Default ReadLimit

ReadLimit getDefaultReadLimit()

Default: ReadLimit.allAvailable

Used when MicroBatchExecution stream execution engine is requested for the analyzed logical plan (of the streaming query)

Latest Offset

Offset latestOffset(
  Offset startOffset,
  ReadLimit limit)

Used when MicroBatchExecution stream execution engine is requested for the next micro-batch

Implementations