Re: Kinesis getRecords read timeout and retry

2018-04-02 Thread Thomas Weise
PR to provide the hooks: https://github.com/apache/flink/pull/5803 On Mon, Apr 2, 2018 at 6:14 PM, Thomas Weise wrote: > Hi, > > I’m working on implementing retry for getRecords in FlinkKinesisConsumer. > We occasionally get transient socket read timeouts. Instead of bubbling

[jira] [Created] (FLINK-9124) Allow customization of KinesisProxy.getRecords read timeout and retry

2018-04-02 Thread Thomas Weise (JIRA)
Thomas Weise created FLINK-9124: --- Summary: Allow customization of KinesisProxy.getRecords read timeout and retry Key: FLINK-9124 URL: https://issues.apache.org/jira/browse/FLINK-9124 Project: Flink

Kinesis getRecords read timeout and retry

2018-04-02 Thread Thomas Weise
Hi, I’m working on implementing retry for getRecords in FlinkKinesisConsumer. We occasionally get transient socket read timeouts. Instead of bubbling up the exception and forcing a topology reset to checkpoint, we want to retry getRecords. We also want to work with a lower socket read timeout

[jira] [Created] (FLINK-9123) Scala version of ProcessFunction doesn't work

2018-04-02 Thread Julio Biason (JIRA)
Julio Biason created FLINK-9123: --- Summary: Scala version of ProcessFunction doesn't work Key: FLINK-9123 URL: https://issues.apache.org/jira/browse/FLINK-9123 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9122) NFASerialize deserailze failed and cause other exception

2018-04-02 Thread aitozi (JIRA)
aitozi created FLINK-9122: - Summary: NFASerialize deserailze failed and cause other exception Key: FLINK-9122 URL: https://issues.apache.org/jira/browse/FLINK-9122 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9120) Task Manager Fault Tolerance issue

2018-04-02 Thread dhiraj prajapati (JIRA)
dhiraj prajapati created FLINK-9120: --- Summary: Task Manager Fault Tolerance issue Key: FLINK-9120 URL: https://issues.apache.org/jira/browse/FLINK-9120 Project: Flink Issue Type: Bug