pyspark.sql.datasource.DataSourceStreamReader.commit#
- DataSourceStreamReader.commit(end)[source]#
Informs the source that Spark has completed processing all data for offsets less than or equal to end and will only request offsets greater than end in the future.
- Parameters:
- enddict
The latest offset that the streaming query has processed for this source.