Async and checkpointing

2019-10-10 Thread anurag
Hi All, Thanks for your help in advance. I am using async I/O with flink 1.5.5, I am using AsyncDataStream.unorderedWait method also my capacity is set to 100.My question is since my capacity is 100, each thread will be processing one record.Say sequence number of my records is S1,S2S100 and

async and checkpointing

2019-07-26 Thread anurag
Hi , Thanks in advance for your help. I am trying to write a flink function which reads from kafka using kafka-flinkconsumer and sends messages to an indexer. I am not clear on how async and checkpointing will work in this case. My flow is like this: a) Messages are ingested into kafka. b)The

Re: Async and checkpointing

2019-10-10 Thread Yun Tang
3 To: user@flink.apache.org Subject: Async and checkpointing Hi All, Thanks for your help in advance. I am using async I/O with flink 1.5.5, I am using AsyncDataStream.unorderedWait method also my capacity is set to 100.My question is since my capacity is 100, each thread will be processing one record.Sa

Re: Async and checkpointing

2019-10-10 Thread anurag
hat sub-task to fail, nothing > would happen and job continues to run but this might be not what you want. > > Best > Yun Tang > -- > *From:* anurag > *Sent:* Friday, October 11, 2019 2:03 > *To:* user@flink.apache.org > *Subject:* Async and c