[
https://issues.apache.org/jira/browse/FLINK-13597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907962#comment-16907962
]
Andrey Zagrebin commented on FLINK-13597:
-----------------------------------------
Tested in AWS EMR Yarn: 1 master and 4 worker nodes (m5.xlarge: 4 vCore, 16
GiB).
EMR runs only on Java 8. Fine-grained recovery is enabled by default.
Modified E2E test scripts can be found here (asserting output):
[https://github.com/azagrebin/flink/commits/FLINK-13597]
Batch SQL:
* S3(a) filesystem over HADOOP works out-of-the-box (already on AWS class
path) and also if put in plugins
Streaming SQL:
* Hadoop output (s3 does not support recoverable writers)
> Test Flink 1.9.0 on cluster
> ---------------------------
>
> Key: FLINK-13597
> URL: https://issues.apache.org/jira/browse/FLINK-13597
> Project: Flink
> Issue Type: Test
> Components: Tests
> Affects Versions: 1.9.0
> Reporter: Till Rohrmann
> Assignee: Aljoscha Krettek
> Priority: Blocker
> Fix For: 1.9.0
>
>
> In order to verify the Flink {{1.9.0}} release, we should try it out on one
> of the available cloud providers (AWS, GCP). I would suggest to run a
> non-trivial workload on the cluster with using some of the new features:
> - SQL job
> - Filesystem being loaded as a plugin
> - Enable fine-grained recovery for batch job
> - Java 9
> - Checkpoints to GFS
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
