Re: Web interface to submit jobs

2015-11-06 Thread Flavio Pompermaier
Hi Sachin, great work and very quickly! Just a question: do you already manage a jar contain multiple jobs (multiple main classes or Program interface implementation)? I have also a suggestion for a very nice feature: right now there's the ParameterTool API that centralize and standardize the

Question on Task Chaining

2015-11-06 Thread Isha Arkatkar
Hi all, I am new to flink and wanted to understand effects of setting task chaining and resource group allocation. I tried following configurations, with task slots set to 2: 1. map(..).disableChaining.filter(..) In this case, I can see 2 vertices for this application, both on the same

Roadmap for the 1.0 release

2015-11-06 Thread Stephan Ewen
Hi all! I have been asked a few times for a roadmap and time frame for Flink 1.0 a couple of times in the last weeks. I would like to start the discussion here, and create a doc that we can point these people to. The doc should define what our goals for version 1.0 are (what features we want in)

Re: 0.10 streaming state documentation out of date

2015-11-06 Thread Maximilian Michels
Looks good. Thanks for the update Stephan. On Thu, Nov 5, 2015 at 7:53 PM, Stephan Ewen wrote: > Fixed the docs. Should be updated on the website once when the build bot > rebuilds them over night. > > On Thu, Nov 5, 2015 at 6:03 PM, Stephan Ewen wrote: > >

Re: neo4j - Flink connector

2015-11-06 Thread Martin Junghanns
Hi, I could need your input on testing the input format with Flink. As I already mentioned, Neo4j offers a dedicated module (neo4j-harness) for unit testing server extensions / REST applications. The problem here is that the dependencies of Flink conflict with the dependencies of neo4j-harness

Re: neo4j - Flink connector

2015-11-06 Thread Robert Metzger
Hi Martin, what exactly were the issues you were facing with the dependency conflicts? There is a way around these issues, and its called shading: https://maven.apache.org/plugins/maven-shade-plugin/ In Flink we have several shaded modules (curator, hadoop) .. we could add a neo4j-harness-shaded

[jira] [Created] (FLINK-2983) Add StateLoader as an alternative to default KvState

2015-11-06 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-2983: - Summary: Add StateLoader as an alternative to default KvState Key: FLINK-2983 URL: https://issues.apache.org/jira/browse/FLINK-2983 Project: Flink Issue Type:

[jira] [Created] (FLINK-2984) Support lenient parsing of SVMLight input files

2015-11-06 Thread Johannes (JIRA)
Johannes created FLINK-2984: --- Summary: Support lenient parsing of SVMLight input files Key: FLINK-2984 URL: https://issues.apache.org/jira/browse/FLINK-2984 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-2985) Allow different field names for unionAll() in Table API

2015-11-06 Thread Timo Walther (JIRA)
Timo Walther created FLINK-2985: --- Summary: Allow different field names for unionAll() in Table API Key: FLINK-2985 URL: https://issues.apache.org/jira/browse/FLINK-2985 Project: Flink Issue

Re: Web interface to submit jobs

2015-11-06 Thread Sachin Goel
Update: I've finished most of the work on this. Here are a few screenshots: https://drive.google.com/file/d/0B0Xlv1qTgpjDRlMxRkQ5OG5PRUk/view?usp=sharing https://drive.google.com/file/d/0B0Xlv1qTgpjDczJwLU13ZWM5anM/view?usp=sharing