Behaviour when a task in a running job fails

2017-08-08 Thread Luis Alves
Hello, What happens when a task in a running job fails? Will all the current executions of the job's tasks fail? Will all the slots being used by the job tasks (failed and non-failed ones) be released. Assuming all the slots are released, wouldn’t it make sense to:  1. “stop” the non-failed

[jira] [Created] (FLINK-7393) Refactor FlinkKinesisConsumerTest

2017-08-08 Thread Bowen Li (JIRA)
Bowen Li created FLINK-7393: --- Summary: Refactor FlinkKinesisConsumerTest Key: FLINK-7393 URL: https://issues.apache.org/jira/browse/FLINK-7393 Project: Flink Issue Type: Test Components:

[jira] [Created] (FLINK-7392) Enable more predicate push-down in joins

2017-08-08 Thread Haohui Mai (JIRA)
Haohui Mai created FLINK-7392: - Summary: Enable more predicate push-down in joins Key: FLINK-7392 URL: https://issues.apache.org/jira/browse/FLINK-7392 Project: Flink Issue Type: Improvement

[ANNOUNCE] Apache Flink-shaded 1.0 released

2017-08-08 Thread Chesnay Schepler
The Apache Flink community is pleased to announce the release of Apache Flink-shaded 1.0. The flink-shaded project contains a number of shaded dependencies for Apache Flink. This release includes asm-all:5.0.4, guava:18.0, netty-all:4.0.27-FINAL and netty-router:1.10 . Note that netty-all

[jira] [Created] (FLINK-7391) Normalize release entries

2017-08-08 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-7391: --- Summary: Normalize release entries Key: FLINK-7391 URL: https://issues.apache.org/jira/browse/FLINK-7391 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-7390) Download links for broken for 1.2.0 to 1.3.1

2017-08-08 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-7390: --- Summary: Download links for broken for 1.2.0 to 1.3.1 Key: FLINK-7390 URL: https://issues.apache.org/jira/browse/FLINK-7390 Project: Flink Issue Type:

Re: How to run wordcount program on Multi-node Cluster.

2017-08-08 Thread P. Ramanjaneya Reddy
Basically I have added input and outputfiles to HDFS. But how to specify access the input file in commandline to run wordcount program? bin/flink run ./examples/streaming/WordCount.jar --input *hdfs:///user/wordcount_input.txt* --output *hdfs:///user/wordcount_output.txt * On Tue, Aug 8, 2017

[jira] [Created] (FLINK-7389) Remove Calcite PushProjector

2017-08-08 Thread Timo Walther (JIRA)
Timo Walther created FLINK-7389: --- Summary: Remove Calcite PushProjector Key: FLINK-7389 URL: https://issues.apache.org/jira/browse/FLINK-7389 Project: Flink Issue Type: Improvement

Re: How to run wordcount program on Multi-node Cluster.

2017-08-08 Thread P. Ramanjaneya Reddy
Yes Felix, I have created input and output files in HDFS. http://localhost:50070/explorer.html#/user But how we can access it ? bin/flink run ./examples/streaming/WordCount.jar --input *hdfs:///user/wordcount_input.txt* --output *hdfs:///user/wordcount_output.txt * On Tue, Aug 8, 2017 at

[jira] [Created] (FLINK-7388) ProcessFunction.onTimer() sets processing time as timestamp

2017-08-08 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-7388: Summary: ProcessFunction.onTimer() sets processing time as timestamp Key: FLINK-7388 URL: https://issues.apache.org/jira/browse/FLINK-7388 Project: Flink

Re: How to run wordcount program on Multi-node Cluster.

2017-08-08 Thread Felix Neutatz
Hi, like Timo said e.g. you need a distributed filesystem like HDFS. Best regards, Felix On Aug 8, 2017 09:01, "P. Ramanjaneya Reddy" wrote: Hi Timo, How to make access the files across TM? Thanks & Regards, Ramanji. On Mon, Aug 7, 2017 at 7:45 PM, Timo Walther

[jira] [Created] (FLINK-7387) Let RpcEndpoint directly implement RpcGateways

2017-08-08 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7387: Summary: Let RpcEndpoint directly implement RpcGateways Key: FLINK-7387 URL: https://issues.apache.org/jira/browse/FLINK-7387 Project: Flink Issue Type:

[jira] [Created] (FLINK-7386) Flink Elasticsearch 5 connector is not compatible with Elasticsearch 5.2+ client

2017-08-08 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-7386: --- Summary: Flink Elasticsearch 5 connector is not compatible with Elasticsearch 5.2+ client Key: FLINK-7386 URL: https://issues.apache.org/jira/browse/FLINK-7386

Re: How to run wordcount program on Multi-node Cluster.

2017-08-08 Thread P. Ramanjaneya Reddy
Hi Timo, How to make access the files across TM? Thanks & Regards, Ramanji. On Mon, Aug 7, 2017 at 7:45 PM, Timo Walther wrote: > Flink is a distributed software for clusters. You need something like a > distributed file system. So that input file and output files can be >