Re: Apache Flink:ProgramInvocationException on Yarn

2015-08-27 Thread Hanan Meyer
Hi I'm currently using flink 0.9.0 which by maven support Hadoop 1 . By using flink-clients-0.7.0-hadoop2-incubating.jar with executePlan(Plan p) method instead, I'm getting the same exception Hanan On Fri, Aug 28, 2015 at 8:35 AM, Hanan Meyer wrote: > > Hi > > 1. I have restarted Flink servi

Re: Apache Flink:ProgramInvocationException on Yarn

2015-08-27 Thread Hanan Meyer
Hi 1. I have restarted Flink service via stop/start-loval.sh - it have been restarted successfully ,no errors in log folder 2. default flink port is -6123 Getting this via Eclips IDE: Thanks org.apache.flink.client.program.ProgramInvocationException: Failed to resolve JobManager at org.apache.

[jira] [Created] (FLINK-2588) Implement KillOptions

2015-08-27 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created FLINK-2588: -- Summary: Implement KillOptions Key: FLINK-2588 URL: https://issues.apache.org/jira/browse/FLINK-2588 Project: Flink Issue Type: Improvement Com

Re: Apache Flink:ProgramInvocationException on Yarn

2015-08-27 Thread Robert Metzger
I guess you are getting an entire exception after the "org.apache.flink .client.program.ProgramInvocationException: Failed to resolve JobManager". Can you post it here to help us understanding the issue? On Thu, Aug 27, 2015 at 6:55 PM, Alexey Sapozhnikov wrote: > Hello all. > > Some clarificati

[jira] [Created] (FLINK-2587) FlinkKafkaConsumer may fail with a NPE

2015-08-27 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-2587: - Summary: FlinkKafkaConsumer may fail with a NPE Key: FLINK-2587 URL: https://issues.apache.org/jira/browse/FLINK-2587 Project: Flink Issue Type: Bug

Re: Apache Flink:ProgramInvocationException on Yarn

2015-08-27 Thread Alexey Sapozhnikov
Hello all. Some clarification: locally everything works great. However once we run our Flink on remote linux machine and try to run the client program from our machine, using create remote environment- Flink JobManager is raising this exception On Thu, Aug 27, 2015 at 7:41 PM, Stephan Ewen wrote

Re: Apache Flink:ProgramInvocationException on Yarn

2015-08-27 Thread Stephan Ewen
Please subscribe to the mailing list. All your mails are held back and need to be manually approved. On Thu, Aug 27, 2015 at 6:49 PM, Alexey Sapozhnikov wrote: > Hello all. > > Some clarification: locally everything works great. > However once we run our Flink on remote linux machine and try to

[jira] [Created] (FLINK-2586) Unstable Storm Compatibility Tests

2015-08-27 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-2586: --- Summary: Unstable Storm Compatibility Tests Key: FLINK-2586 URL: https://issues.apache.org/jira/browse/FLINK-2586 Project: Flink Issue Type: Bug Comp

Re: Apache Flink:ProgramInvocationException on Yarn

2015-08-27 Thread Alexey Sapozhnikov
Hello all. Some clarification: locally everything works great. However once we run our Flink on remote linux machine and try to run the client program from our machine, using create remote environment- Flink JobManager is raising this exception On Thu, Aug 27, 2015 at 7:41 PM, Stephan Ewen wrote

Re: [RESULT] [VOTE] Release Apache Flink 0.9.1 (RC0)

2015-08-27 Thread Robert Metzger
Stephan pushed a fix for the ASM problem. I noticed that guava is also not shaded properly. As part of https://issues.apache.org/jira/browse/FLINK-2584, I'm going to add a script to our travis build which will automatically check the contents of the fat jar for improperly shaded classes. On Thu,

Re: Apache Flink:ProgramInvocationException on Yarn

2015-08-27 Thread Stephan Ewen
If you start the job via the "bin/flink" script, then simply use "ExecutionEnvironment.getExecutionEnvironment()" rather then creating a remote environment manually. That way, hosts and ports are configured automatically. On Thu, Aug 27, 2015 at 6:39 PM, Robert Metzger wrote: > Hi, > > Which va

Re: Apache Flink:ProgramInvocationException on Yarn

2015-08-27 Thread Robert Metzger
Hi, Which values did you use for FLINK_SERVER_URL and FLINK_PORT? Every time you deploy Flink on YARN, the host and port change, because the JobManager is started on a different YARN container. On Thu, Aug 27, 2015 at 6:32 PM, Hanan Meyer wrote: > Hello All > > When using Eclipse IDE to submit

Apache Flink:ProgramInvocationException on Yarn

2015-08-27 Thread Hanan Meyer
Hello All When using Eclipse IDE to submit Flink to Yarn single node cluster I'm getting : "org.apache.flink.client.program.ProgramInvocationException: Failed to resolve JobManager" Using Flink 0.9.0 The Jar copy a file from one location in Hdfs to another and works fine while executed locally o

[jira] [Created] (FLINK-2585) KafkaSource not working

2015-08-27 Thread Boyang Jerry Peng (JIRA)
Boyang Jerry Peng created FLINK-2585: Summary: KafkaSource not working Key: FLINK-2585 URL: https://issues.apache.org/jira/browse/FLINK-2585 Project: Flink Issue Type: Bug Rep

Re: Testing the 0.9.1 Candidate

2015-08-27 Thread Ufuk Celebi
The vote has been cancelled. Most tests can be forwarded. I will update the document as soon as the new RC is out. On Thu, Aug 27, 2015 at 1:38 PM, Ufuk Celebi wrote: > Hey all, > > we've just started the vote for a new bugfix release with version 0.9.1. > > I've created the following document t

Re: [VOTE] Release Apache Flink 0.9.1 (RC0)

2015-08-27 Thread Stephan Ewen
+/- 0 One minor issue: - The binary distribution LICENSE file mentions a wrong version of javakaffee (mentions 27, but we reference 36). If we redo the release candidate, this should be fixed. Performed the following checks: - Checked LICENSE / NOTICE files - Checked the README file - Built

[RESULT] [VOTE] Release Apache Flink 0.9.1 (RC0)

2015-08-27 Thread Ufuk Celebi
This vote is cancelled in favor of RC1, due to FLINK-2584. In the current snapshot and release-0.9 branch, shading of ASM is not working correctly. The corresponding issue is here: https://issues.apache.org/jira/browse/FLINK-2584. Robert is working on a quick fix for 0.9.1. The good thing is tha

[jira] [Created] (FLINK-2584) ASM dependency is not shaded away

2015-08-27 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-2584: -- Summary: ASM dependency is not shaded away Key: FLINK-2584 URL: https://issues.apache.org/jira/browse/FLINK-2584 Project: Flink Issue Type: Bug Compone

[jira] [Created] (FLINK-2583) Add Stream Sink For Rolling HDFS Files

2015-08-27 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-2583: --- Summary: Add Stream Sink For Rolling HDFS Files Key: FLINK-2583 URL: https://issues.apache.org/jira/browse/FLINK-2583 Project: Flink Issue Type: New Fe

[jira] [Created] (FLINK-2582) Document how to build Flink with other Scala versions

2015-08-27 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-2582: --- Summary: Document how to build Flink with other Scala versions Key: FLINK-2582 URL: https://issues.apache.org/jira/browse/FLINK-2582 Project: Flink Issue Type:

Testing the 0.9.1 Candidate

2015-08-27 Thread Ufuk Celebi
Hey all, we've just started the vote for a new bugfix release with version 0.9.1. I've created the following document to synchronize testing efforts. Feel free to assign yourself to certain tests in the document. The list of tests is taken from the Wiki. https://docs.google.com/document/d/1GwDYS

[VOTE] Release Apache Flink 0.9.1 (RC0)

2015-08-27 Thread Ufuk Celebi
Dear community, Please vote on releasing the following candidate as Apache Flink version 0.9.1. This is a maintenance release for Flink's latest stable version. The candidate fixes 37 issues [1] and adds 46 commits. - The commit to be vo

[jira] [Created] (FLINK-2581) Add warning to the YARN client when using an older Hadoop version

2015-08-27 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-2581: - Summary: Add warning to the YARN client when using an older Hadoop version Key: FLINK-2581 URL: https://issues.apache.org/jira/browse/FLINK-2581 Project: Flink

Re: Bug fix release 0.9.1

2015-08-27 Thread Ufuk Celebi
Hey all, the artifacts are uploading at the moment. I will start a vote thread as soon as everything is up. :-) – Ufuk On Wed, Aug 26, 2015 at 10:26 AM, Ufuk Celebi wrote: > I went over all issues and pinged a couple of people about open issues. > Thanks for all the help! All JIRA issues tagge

[jira] [Created] (FLINK-2580) HadoopDataOutputStream does not expose enough methods of org.apache.hadoop.fs.FSDataOutputStream

2015-08-27 Thread Arnaud Linz (JIRA)
Arnaud Linz created FLINK-2580: -- Summary: HadoopDataOutputStream does not expose enough methods of org.apache.hadoop.fs.FSDataOutputStream Key: FLINK-2580 URL: https://issues.apache.org/jira/browse/FLINK-2580

[jira] [Created] (FLINK-2579) StreamExecutionEnvironment & ExecutionEnvironment do not share interface but have a lot in common

2015-08-27 Thread Arnaud Linz (JIRA)
Arnaud Linz created FLINK-2579: -- Summary: StreamExecutionEnvironment & ExecutionEnvironment do not share interface but have a lot in common Key: FLINK-2579 URL: https://issues.apache.org/jira/browse/FLINK-2579