[ 
https://issues.apache.org/jira/browse/BEAM-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17052385#comment-17052385
 ] 

Alexey Romanenko edited comment on BEAM-9420 at 3/5/20, 5:55 PM:
-----------------------------------------------------------------

Why increasing a {{request.timeout.ms}} wouldn't work in this case?


was (Author: aromanenko):
Why \{{request.timeout.ms}} wouldn't work in this case?

> Configurable timeout for Kafka setupInitialOffset()
> ---------------------------------------------------
>
>                 Key: BEAM-9420
>                 URL: https://issues.apache.org/jira/browse/BEAM-9420
>             Project: Beam
>          Issue Type: Bug
>          Components: io-java-kafka
>    Affects Versions: 2.19.0
>            Reporter: Jozef Vilcek
>            Assignee: Jozef Vilcek
>            Priority: Major
>
> If bootstrap brokers does contain an unhealthy server, it can break the start 
> of a whole Beam job. During the start, `KafkaUnboundedReader` is waiting for  
> `setupInitialOffset()`. Wait timeout is either a double time of `request. 
> timeout.ms` or some default constant. In both cases, it might not be enough 
> time for kafka-client to initiate fallback and retry metadata discovery via 
> another broker from given bootstrap list.
> The client should be able to specify timeout for `setupInitialOffset()` 
> explicitly as a setting to KafkaIO read.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to