[MultipleProgramsTestBase][Cluster vs. Collection mode] Inconsistent Behavior

2015-03-04 Thread Andra Lungu
Hello, I have implemented a Bulk Synchronous Version of Triangle Count. The code can be found here: https://github.com/andralungu/gelly-partitioning/tree/triangles In this algorithm, the messages sent differ as the superstep differs. In order to distinguish between superstep numbers, I used the

Re: Documentation in the master

2015-03-04 Thread Henry Saputra
This is great news, Max! Thanks for picking up the task. Sorry I was late filing issue for this but did it anyway: FLINK-1647 I have assigned it to you so feel free to mark it as Resolved. Just small comment, next time please do let everyone know via dev@ list that you are working on it to make

Re: Documentation in the master

2015-03-04 Thread Maximilian Michels
Hi Henry, There wasn't a specific issue for pushing the latest documentation to the website but it was covered by the issue of automatically building the latest documentation [1]. I assigned the issue [1] to myself. So I think it's ok to skip the dev mailing list then. Kind regards, Max [1]

[jira] [Created] (FLINK-1647) Push master documentation (latest) to Flink website

2015-03-04 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-1647: Summary: Push master documentation (latest) to Flink website Key: FLINK-1647 URL: https://issues.apache.org/jira/browse/FLINK-1647 Project: Flink Issue

[jira] [Created] (FLINK-1648) Add a mode where the system automatically sets the parallelism to the available task slots

2015-03-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1648: --- Summary: Add a mode where the system automatically sets the parallelism to the available task slots Key: FLINK-1648 URL: https://issues.apache.org/jira/browse/FLINK-1648

Re: [MultipleProgramsTestBase][Cluster vs. Collection mode] Inconsistent Behavior

2015-03-04 Thread Vasiliki Kalavri
Hi, I have found the issue, but will need some help to resolve it :) In CollectionExecutor, if the superstep number is 0 (I guess this means iteration?) a new IterationRuntimeUDFContext is created for every unary and binary operator, being assigned this superstep number in its constructor.

Re: Documentation in the master

2015-03-04 Thread Ufuk Celebi
Nice, Max! :) On 04 Mar 2015, at 15:36, Stephan Ewen se...@apache.org wrote: Great, thanks Max! Concerning (1), in the snapshot master, we can have stubs, IMHO. I agree :)

Re: [MultipleProgramsTestBase][Cluster vs. Collection mode] Inconsistent Behavior

2015-03-04 Thread Stephan Ewen
My gut feeling would be that the IterationRuntimeContext should be the same across all iterations. It only needs to support returning a different superstep number in each superstep. On Wed, Mar 4, 2015 at 7:13 PM, Vasiliki Kalavri vasilikikala...@gmail.com wrote: Hi, I have found the issue,

[jira] [Created] (FLINK-1649) Give a good error message when a user program emits a null record

2015-03-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1649: --- Summary: Give a good error message when a user program emits a null record Key: FLINK-1649 URL: https://issues.apache.org/jira/browse/FLINK-1649 Project: Flink

[jira] [Created] (FLINK-1651) Running mvn test got stuck

2015-03-04 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-1651: Summary: Running mvn test got stuck Key: FLINK-1651 URL: https://issues.apache.org/jira/browse/FLINK-1651 Project: Flink Issue Type: Bug

Re: Documentation in the master

2015-03-04 Thread Henry Saputra
Hi Max, Sounds good to me. Thanks again for picking up the task. - Henry On Wed, Mar 4, 2015 at 8:07 AM, Maximilian Michels m...@apache.org wrote: Hi Henry, There wasn't a specific issue for pushing the latest documentation to the website but it was covered by the issue of automatically

[jira] [Created] (FLINK-1650) Suppress Akka's Netty Shutdown Errors through the log config

2015-03-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1650: --- Summary: Suppress Akka's Netty Shutdown Errors through the log config Key: FLINK-1650 URL: https://issues.apache.org/jira/browse/FLINK-1650 Project: Flink

[jira] [Created] (FLINK-1652) Wrong superstep number in VertexCentricIteration in Collection mode

2015-03-04 Thread Vasia Kalavri (JIRA)
Vasia Kalavri created FLINK-1652: Summary: Wrong superstep number in VertexCentricIteration in Collection mode Key: FLINK-1652 URL: https://issues.apache.org/jira/browse/FLINK-1652 Project: Flink

[jira] [Created] (FLINK-1654) Wrong scala example of POJO type in documentation

2015-03-04 Thread Chiwan Park (JIRA)
Chiwan Park created FLINK-1654: -- Summary: Wrong scala example of POJO type in documentation Key: FLINK-1654 URL: https://issues.apache.org/jira/browse/FLINK-1654 Project: Flink Issue Type: Bug

Re: Could not build up connection to JobManager

2015-03-04 Thread Dulaj Viduranga
Hi, I found many other places “localhost” is hard coded. I changed them in a better way I think. I made a pull request. Please review. b7da22a https://github.com/viduranga/flink/commit/b7da22a562d3da5a9be2657308c0f82e4e2f80cd On Mar 4, 2015, at 8:17 PM, Stephan Ewen se...@apache.org wrote:

Not Flink related: IntelliJ cannot open maven projects

2015-03-04 Thread Dulaj Viduranga
Hello, Not Flink related. IntelliJ cannot open maven projects. It is stuck on “Looking for available profiles….”. I can open the project in eclipse without any problem. Any ideas? No rush. Thanks.

Re: [jira] [Created] (FLINK-1651) Running mvn test got stuck

2015-03-04 Thread Henry Saputra
As I remember it was running test successfully last week. It is been a while I ran full test in my env. Will try to look more into it. On Wed, Mar 4, 2015 at 11:44 PM, Till Rohrmann trohrm...@apache.org wrote: That is odd. I just ran mvn clean verify -Dmaven.javadoc.skip=true on my mac work

Re: [jira] [Created] (FLINK-1651) Running mvn test got stuck

2015-03-04 Thread Till Rohrmann
That is odd. I just ran mvn clean verify -Dmaven.javadoc.skip=true on my mac work machine and it ran through successfully. Could you post which java processes are running when the console hangs? And also the stack traces of all surefirebooter processes? Maybe someone can make head or tail of it.

[jira] [Created] (FLINK-1653) Setting up Apache Jenkins CI for continuous tests

2015-03-04 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-1653: Summary: Setting up Apache Jenkins CI for continuous tests Key: FLINK-1653 URL: https://issues.apache.org/jira/browse/FLINK-1653 Project: Flink Issue Type:

Re: Could not build up connection to JobManager

2015-03-04 Thread Dulaj Viduranga
The every change in the commit b7da22a is not required but I thought they are appropriate. On Mar 5, 2015, at 8:11 AM, Dulaj Viduranga vidura...@icloud.com wrote: Hi, I found many other places “localhost” is hard coded. I changed them in a better way I think. I made a pull request. Please

Re: [jira] [Created] (FLINK-1651) Running mvn test got stuck

2015-03-04 Thread Till Rohrmann
Is this reproducible? If so, then a stack trace of the JVM would be helpful. With the stack trace we would know which test case stalls. On Wed, Mar 4, 2015 at 9:46 PM, Henry Saputra (JIRA) j...@apache.org wrote: Henry Saputra created FLINK-1651:

Re: [DISCUSS] Make a release to be announced at ApacheCon

2015-03-04 Thread Robert Metzger
+1 for Marton as a release manager. Thank you! On Tue, Mar 3, 2015 at 7:56 PM, Henry Saputra henry.sapu...@gmail.com wrote: Ah, thanks Márton. So we are chartering to the similar concept of Spark RRD staging execution =P I suppose there will be a runtime configuration or hint to tell the

Re: About FLINK-1537 Machine learning with Apache Flink

2015-03-04 Thread Stephan Ewen
@Till is working on bootstrapping a machine learning Library, he can probably give you some points... Am 04.03.2015 04:34 schrieb Dulaj Viduranga vidura...@icloud.com: Great. So can you assign me someone to brainstorm the project idea and make a proposal that would benefit flink the most? On

Re: Access flink-conf.yaml data

2015-03-04 Thread Robert Metzger
Hi Johannes, This change will allow users to pass a custom configuration to the LocalExecutor: https://github.com/apache/flink/pull/427. Is that what you're looking for? On Wed, Mar 4, 2015 at 11:46 AM, Kirschnick, Johannes johannes.kirschn...@tu-berlin.de wrote: Hi Stephan, I just came

[jira] [Created] (FLINK-1643) Detect tumbling policies where trigger and eviction match

2015-03-04 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-1643: - Summary: Detect tumbling policies where trigger and eviction match Key: FLINK-1643 URL: https://issues.apache.org/jira/browse/FLINK-1643 Project: Flink Issue

Re: Access flink-conf.yaml data

2015-03-04 Thread Kirschnick, Johannes
Good point #427 looks more complete - will wait for the merge and just use my workaround locally in the meantime Johannes -Ursprüngliche Nachricht- Von: ewenstep...@gmail.com [mailto:ewenstep...@gmail.com] Im Auftrag von Stephan Ewen Gesendet: Mittwoch, 4. März 2015 12:42 An:

Re: Access flink-conf.yaml data

2015-03-04 Thread Kirschnick, Johannes
Hi Stephan, I just came across the same problem in accessing the constants and in particular setting custom properties. In particular I noticed that the Minicluster started in the Local Environment cannot easily be customized as it does not take into account any custom environment variables -

[jira] [Created] (FLINK-1644) WebClient dies when no ExecutionEnvironment in main method

2015-03-04 Thread Jonathan Hasenburg (JIRA)
Jonathan Hasenburg created FLINK-1644: - Summary: WebClient dies when no ExecutionEnvironment in main method Key: FLINK-1644 URL: https://issues.apache.org/jira/browse/FLINK-1644 Project: Flink

Re: Documentation in the master

2015-03-04 Thread Stephan Ewen
Great, thanks Max! Concerning (1), in the snapshot master, we can have stubs, IMHO. Concerning (2), how do we fix the SVG files? On Wed, Mar 4, 2015 at 3:30 PM, Maximilian Michels m...@apache.org wrote: Hey there, Just letting you know, we now have the documentation of all releases,

[jira] [Created] (FLINK-1645) Move StreamingClassloaderITCase to flink-streaming

2015-03-04 Thread JIRA
Márton Balassi created FLINK-1645: - Summary: Move StreamingClassloaderITCase to flink-streaming Key: FLINK-1645 URL: https://issues.apache.org/jira/browse/FLINK-1645 Project: Flink Issue

Re: Access flink-conf.yaml data

2015-03-04 Thread Robert Metzger
Cool. I'll merge #427 as soon as https://github.com/apache/flink/pull/410 is in master. On Wed, Mar 4, 2015 at 12:48 PM, Kirschnick, Johannes johannes.kirschn...@tu-berlin.de wrote: Good point #427 looks more complete - will wait for the merge and just use my workaround locally in the

[jira] [Created] (FLINK-1646) Add name of required configuration value into the Insufficient number of network buffers exception

2015-03-04 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1646: - Summary: Add name of required configuration value into the Insufficient number of network buffers exception Key: FLINK-1646 URL: