SupportsAdmissionControl¶

SupportsAdmissionControl is an extension of the SparkDataStream abstraction for streaming sources that want to control the rate of data ingested in Micro-Batch Stream Processing.

Contract¶

Default ReadLimit¶

ReadLimit getDefaultReadLimit()

Default: ReadLimit.allAvailable

Used when MicroBatchExecution stream execution engine is requested for the analyzed logical plan (of the streaming query)

Latest Offset¶

Offset latestOffset(
  Offset startOffset,
  ReadLimit limit)

Used when MicroBatchExecution stream execution engine is requested for the next micro-batch

Implementations¶

• FileStreamSource
• KafkaMicroBatchStream
• KafkaSource