[jira] [Created] (FLINK-1933) Add distance measure interface and basic implementation to machine learning library

2015-04-22 Thread Chiwan Park (JIRA)
Chiwan Park created FLINK-1933: -- Summary: Add distance measure interface and basic implementation to machine learning library Key: FLINK-1933 URL: https://issues.apache.org/jira/browse/FLINK-1933 Project

Re: Extracting detailed Flink execution plan

2015-04-22 Thread Amit Pawar
Many thanks Stephan. I followed your instructions and it was working fine when I had the required flink projects in the build path, later when I substituted it by adding respective dependencies with the snapshots in pom, I am getting the below exception at OptimizedPlan opPlan = op.compile(env.cre

[jira] [Created] (FLINK-1932) Add L-BFGS to the optimization framework

2015-04-22 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1932: Summary: Add L-BFGS to the optimization framework Key: FLINK-1932 URL: https://issues.apache.org/jira/browse/FLINK-1932 Project: Flink Issue Type: New Featur

[jira] [Created] (FLINK-1931) Add ADMM to optimization framework

2015-04-22 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1931: Summary: Add ADMM to optimization framework Key: FLINK-1931 URL: https://issues.apache.org/jira/browse/FLINK-1931 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-1930) NullPointerException in vertex-centric iteration

2015-04-22 Thread Vasia Kalavri (JIRA)
Vasia Kalavri created FLINK-1930: Summary: NullPointerException in vertex-centric iteration Key: FLINK-1930 URL: https://issues.apache.org/jira/browse/FLINK-1930 Project: Flink Issue Type: Bu

Re: About Operator and OperatorBase

2015-04-22 Thread Stephan Ewen
I think the main difference to the Java API is right now that the JavaAPI is fluent and the common API is compositional. Otherwise there is not much in the common API any more. Not sure whether this warrants an extra API... On Wed, Apr 22, 2015 at 3:52 PM, Kostas Tzoumas wrote: > I think Step

Re: About Operator and OperatorBase

2015-04-22 Thread Kostas Tzoumas
I think Stephan meant Meteor, an old API when Flink was Stratosphere. This was never part of the code that made it to Apache. Not sure if we want to remove the common API, as it provides a dataflow abstraction that is higher level than the JobGraph. Admittedly, I don't have a better argument other

[jira] [Created] (FLINK-1929) Add code to cleanly stop a running streaming topology

2015-04-22 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1929: - Summary: Add code to cleanly stop a running streaming topology Key: FLINK-1929 URL: https://issues.apache.org/jira/browse/FLINK-1929 Project: Flink Issue T

Re: Fault Tolerance for Flink Iterations

2015-04-22 Thread Stephan Ewen
I think it should circumvent many of the problems. If you re-submit the program from the client with a lower DOP, all intermediae state (saved by you in files) will be re-partitioned, because no assumptions about prior properties are made. I may not be getting the whole picture here, so sorry, if

[jira] [Created] (FLINK-1928) BlobManager can be a bottleneck on large deployments

2015-04-22 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1928: - Summary: BlobManager can be a bottleneck on large deployments Key: FLINK-1928 URL: https://issues.apache.org/jira/browse/FLINK-1928 Project: Flink Issue Ty

[jira] [Created] (FLINK-1927) [Py] Rework operator distribution

2015-04-22 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-1927: --- Summary: [Py] Rework operator distribution Key: FLINK-1927 URL: https://issues.apache.org/jira/browse/FLINK-1927 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-1926) [Py] Sync Python API with otehr API's

2015-04-22 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-1926: --- Summary: [Py] Sync Python API with otehr API's Key: FLINK-1926 URL: https://issues.apache.org/jira/browse/FLINK-1926 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-1925) Split SubmitTask method up into two phases: Receive TDD and instantiation of TDD

2015-04-22 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1925: Summary: Split SubmitTask method up into two phases: Receive TDD and instantiation of TDD Key: FLINK-1925 URL: https://issues.apache.org/jira/browse/FLINK-1925 Projec

[jira] [Created] (FLINK-1924) [Py] Refactor a few minor things

2015-04-22 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-1924: --- Summary: [Py] Refactor a few minor things Key: FLINK-1924 URL: https://issues.apache.org/jira/browse/FLINK-1924 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-1923) Replace asynchronous logging in JobManager with regular slf4j logging

2015-04-22 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1923: - Summary: Replace asynchronous logging in JobManager with regular slf4j logging Key: FLINK-1923 URL: https://issues.apache.org/jira/browse/FLINK-1923 Project: Flink

[jira] [Created] (FLINK-1922) Failed task deployment causes NPE on input split assignment

2015-04-22 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1922: - Summary: Failed task deployment causes NPE on input split assignment Key: FLINK-1922 URL: https://issues.apache.org/jira/browse/FLINK-1922 Project: Flink

[jira] [Created] (FLINK-1921) Rework parallelism/slots handling for per-job YARN sessions

2015-04-22 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1921: - Summary: Rework parallelism/slots handling for per-job YARN sessions Key: FLINK-1921 URL: https://issues.apache.org/jira/browse/FLINK-1921 Project: Flink

[jira] [Created] (FLINK-1920) Passing -D akka.ask.timeout=5 min to yarn client does not work

2015-04-22 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1920: - Summary: Passing -D akka.ask.timeout=5 min to yarn client does not work Key: FLINK-1920 URL: https://issues.apache.org/jira/browse/FLINK-1920 Project: Flink

Re: Fault Tolerance for Flink Iterations

2015-04-22 Thread Markus Holzemer
Hi Stephan, thanks for your answer! I thought about this, too, but I am not sure if this solves to problem. I think it works if there is only a temporary failure an the job can be restartet with the same dop. But it does not work if one node is permanently lost and the dop needs to be adjusted. If