SupportsAdmissionControl¶
SupportsAdmissionControl
is an extension of the SparkDataStream abstraction for streaming sources that want to control the rate of data ingested in Micro-Batch Stream Processing.
Contract¶
Default ReadLimit¶
ReadLimit getDefaultReadLimit()
Default: ReadLimit.allAvailable
Used when MicroBatchExecution
stream execution engine is requested for the analyzed logical plan (of the streaming query)
Latest Offset¶
Offset latestOffset(
Offset startOffset,
ReadLimit limit)
Used when MicroBatchExecution
stream execution engine is requested for the next micro-batch