Re: Problem with KafkaIO

2018-09-18 Thread Raghu Angadi
Hi Eduardo, There another work around you can try without having to wait for 2.7.0 release: Use a wrapper to catch exception from KafkaConsumer#poll() and pass the wrapper to withConsumerFactoryFn() for KafkIO reader [1]. Using something like (such a wrapper is used in KafkasIO tests [2]): privat

Re: [Discuss] Upgrade story for Beam's execution engines

2018-09-18 Thread Maximilian Michels
FYI, I opened a PR with a compatibility table for the Flink Runner page: https://github.com/apache/beam-site/pull/553 On 17.09.18 09:31, Robert Bradshaw wrote: On Mon, Sep 17, 2018 at 2:02 AM Austin Bennett mailto:whatwouldausti...@gmail.com>> wrote: Do we currently maintain a finer grain

Re: Problem with KafkaIO

2018-09-18 Thread Eduardo Soldera
Hi Raghu, we're not sure how long the network was down. According to the logs no longer than one minute. A 30 second shutdown would work for the tests. Regards Em sex, 14 de set de 2018 às 21:41, Raghu Angadi escreveu: > Thanks. I could repro myself as well. How long was the network down? > > T