Hi! In 1.2-SNAPSHOT, we recently fixed issues due to the "eventual consistency" nature of S3. The fix is not in v1.1 - that is the only known issue I can think of.
It results in occasional (seldom) periods of heavy restart retries, until all files are visible to all participants. If you run into that issue, may be worthwhile to look at Flink 1.2-SNAPSHOT. Best, Stephan On Tue, Oct 11, 2016 at 12:13 AM, Vijay Srinivasaraghavan < vijikar...@yahoo.com.invalid> wrote: > Hello, > Per documentation (https://ci.apache.org/projects/flink/flink-docs- > master/setup/aws.html), it looks like S3/S3A FS implementation is > supported using standard Hadoop S3 FS client APIs. > In the absence of using standard HCFS and going with S3/S3A, > 1) Are there any known limitations/issues? > 2) Does checkpoint/savepoint works properly? > Regards > Vijay
