[ 
https://issues.apache.org/jira/browse/BEAM-6466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16747715#comment-16747715
 ] 

Raghu Angadi commented on BEAM-6466:
------------------------------------

BoundedReadFromUnboundedSource does not seem to be waiting till the processing 
committed. I know that in streaming finalize is called after the first stages 
is committed. This could be a separate jira since it is not related to KafkaIO 
itself. 


> KafkaIO doesn't commit offsets while being used as bounded source
> -----------------------------------------------------------------
>
>                 Key: BEAM-6466
>                 URL: https://issues.apache.org/jira/browse/BEAM-6466
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-kafka
>    Affects Versions: 2.9.0
>            Reporter: Alexey Romanenko
>            Priority: Major
>
> While using KafkaIO as bounded source (with {{withMaxReadTime()}} or 
> {{withMaxNumRecords()}}) it seems doesn't commit offsets all the time.
> See the details in [the 
> discussion|https://lists.apache.org/thread.html/bcec8a1fb166029a4adf3f3491c407d49843406020b20f203ec3c2d2@%3Cuser.beam.apache.org%3E]
>  on user@list.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to