Re: [jira] [Created] (FLINK-1651) Running mvn test got stuck

2015-03-04 Thread Henry Saputra
As I remember it was running test successfully last week. It is been a while I ran full test in my env. Will try to look more into it. On Wed, Mar 4, 2015 at 11:44 PM, Till Rohrmann wrote: > That is odd. I just ran mvn clean verify -Dmaven.javadoc.skip=true on my > mac work machine and it ran th

Re: [jira] [Created] (FLINK-1651) Running mvn test got stuck

2015-03-04 Thread Till Rohrmann
That is odd. I just ran mvn clean verify -Dmaven.javadoc.skip=true on my mac work machine and it ran through successfully. Could you post which java processes are running when the console hangs? And also the stack traces of all surefirebooter processes? Maybe someone can make head or tail of it.

Re: [jira] [Created] (FLINK-1651) Running mvn test got stuck

2015-03-04 Thread Henry Saputra
This is consistently repro in my mac work machine. Nothing really on the JStack thread dump or Java Mission Control =( The console just hang but do not see any deadlock from the thread trace. - Henry On Wed, Mar 4, 2015 at 11:02 PM, Till Rohrmann wrote: > Is this reproducible? If so, then a sta

Re: Could not build up connection to JobManager

2015-03-04 Thread Till Rohrmann
Hi Dulaj, I looked through your commit and noticed that the JobClient might not be listening on the right network interface. Your commit seems to fix it. I just want to understand the problem properly and therefore I opened a branch with a small change. Could you try out whether this change would

Re: Not Flink related: IntelliJ cannot open maven projects

2015-03-04 Thread Till Rohrmann
That is odd. Most of the committers are using the IntelliJ to develop Flink. Have you tried to delete the Flink directory and checking it out again. Make sure that all IntelliJ related files (*.iml) are deleted so that it is really a fresh import. I just cloned the flink repository and imported th

Re: [jira] [Created] (FLINK-1651) Running mvn test got stuck

2015-03-04 Thread Till Rohrmann
Is this reproducible? If so, then a stack trace of the JVM would be helpful. With the stack trace we would know which test case stalls. On Wed, Mar 4, 2015 at 9:46 PM, Henry Saputra (JIRA) wrote: > Henry Saputra created FLINK-1651: > > > Summary:

Not Flink related: IntelliJ cannot open maven projects

2015-03-04 Thread Dulaj Viduranga
Hello, Not Flink related. IntelliJ cannot open maven projects. It is stuck on “Looking for available profiles….”. I can open the project in eclipse without any problem. Any ideas? No rush. Thanks.

Re: Could not build up connection to JobManager

2015-03-04 Thread Dulaj Viduranga
The every change in the commit b7da22a is not required but I thought they are appropriate. > On Mar 5, 2015, at 8:11 AM, Dulaj Viduranga wrote: > > Hi, > I found many other places “localhost” is hard coded. I changed them in a > better way I think. I made a pull request. Please review. b7da22a

Re: Could not build up connection to JobManager

2015-03-04 Thread Dulaj Viduranga
Hi, I found many other places “localhost” is hard coded. I changed them in a better way I think. I made a pull request. Please review. b7da22a > On Mar 4, 2015, at 8:17 PM, Stephan Ewen wrote: > > If I recall

[jira] [Created] (FLINK-1654) Wrong scala example of POJO type in documentation

2015-03-04 Thread Chiwan Park (JIRA)
Chiwan Park created FLINK-1654: -- Summary: Wrong scala example of POJO type in documentation Key: FLINK-1654 URL: https://issues.apache.org/jira/browse/FLINK-1654 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-1653) Setting up Apache Jenkins CI for continuous tests

2015-03-04 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-1653: Summary: Setting up Apache Jenkins CI for continuous tests Key: FLINK-1653 URL: https://issues.apache.org/jira/browse/FLINK-1653 Project: Flink Issue Type: T

Re: [MultipleProgramsTestBase][Cluster vs. Collection mode] Inconsistent Behavior

2015-03-04 Thread Vasiliki Kalavri
Thanks! I created an issue [1] and will try to look into this during the weekend (unless someone gets to it faster :)) Cheers, V. [1]: http://issues.apache.org/jira/browse/FLINK-1652 On 4 March 2015 at 20:29, Stephan Ewen wrote: > My gut feeling would be that the IterationRuntimeContext shoul

[jira] [Created] (FLINK-1652) Wrong superstep number in VertexCentricIteration in Collection mode

2015-03-04 Thread Vasia Kalavri (JIRA)
Vasia Kalavri created FLINK-1652: Summary: Wrong superstep number in VertexCentricIteration in Collection mode Key: FLINK-1652 URL: https://issues.apache.org/jira/browse/FLINK-1652 Project: Flink

[jira] [Created] (FLINK-1651) Running mvn test got stuck

2015-03-04 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-1651: Summary: Running mvn test got stuck Key: FLINK-1651 URL: https://issues.apache.org/jira/browse/FLINK-1651 Project: Flink Issue Type: Bug Components

[jira] [Created] (FLINK-1649) Give a good error message when a user program emits a null record

2015-03-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1649: --- Summary: Give a good error message when a user program emits a null record Key: FLINK-1649 URL: https://issues.apache.org/jira/browse/FLINK-1649 Project: Flink

[jira] [Created] (FLINK-1650) Suppress Akka's Netty Shutdown Errors through the log config

2015-03-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1650: --- Summary: Suppress Akka's Netty Shutdown Errors through the log config Key: FLINK-1650 URL: https://issues.apache.org/jira/browse/FLINK-1650 Project: Flink Iss

Re: [MultipleProgramsTestBase][Cluster vs. Collection mode] Inconsistent Behavior

2015-03-04 Thread Stephan Ewen
My gut feeling would be that the IterationRuntimeContext should be the same across all iterations. It only needs to support returning a different superstep number in each superstep. On Wed, Mar 4, 2015 at 7:13 PM, Vasiliki Kalavri wrote: > Hi, > > I have found the issue, but will need some help

Re: [MultipleProgramsTestBase][Cluster vs. Collection mode] Inconsistent Behavior

2015-03-04 Thread Vasiliki Kalavri
Hi, I have found the issue, but will need some help to resolve it :) In CollectionExecutor, if the superstep number is > 0 (I guess this means iteration?) a new IterationRuntimeUDFContext is created for every unary and binary operator, being assigned this superstep number in its constructor. How

[jira] [Created] (FLINK-1648) Add a mode where the system automatically sets the parallelism to the available task slots

2015-03-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1648: --- Summary: Add a mode where the system automatically sets the parallelism to the available task slots Key: FLINK-1648 URL: https://issues.apache.org/jira/browse/FLINK-1648

Re: Documentation in the master

2015-03-04 Thread Ufuk Celebi
Nice, Max! :) On 04 Mar 2015, at 15:36, Stephan Ewen wrote: > Great, thanks Max! > > Concerning (1), in the snapshot master, we can have stubs, IMHO. I agree :)

Re: [MultipleProgramsTestBase][Cluster vs. Collection mode] Inconsistent Behavior

2015-03-04 Thread Vasiliki Kalavri
Hi Andra, judging from the output, it seems that all 3 supersteps are executed in the second case as well, but getSuperstepNumber() is returning the wrong superstep number. I confirmed that this is also the case in VertexCentricConnectedComponentsITCase and SpargelConnectedComponentsITCase, i.e. t

Re: Documentation in the master

2015-03-04 Thread Henry Saputra
Hi Max, Sounds good to me. Thanks again for picking up the task. - Henry On Wed, Mar 4, 2015 at 8:07 AM, Maximilian Michels wrote: > Hi Henry, > > There wasn't a specific issue for pushing the latest documentation to > the website but it was covered by the issue of automatically building > the

Re: Documentation in the master

2015-03-04 Thread Maximilian Michels
Hi Henry, There wasn't a specific issue for pushing the latest documentation to the website but it was covered by the issue of automatically building the latest documentation [1]. I assigned the issue [1] to myself. So I think it's ok to skip the dev mailing list then. Kind regards, Max [1] htt

Re: Documentation in the master

2015-03-04 Thread Henry Saputra
This is great news, Max! Thanks for picking up the task. Sorry I was late filing issue for this but did it anyway: FLINK-1647 I have assigned it to you so feel free to mark it as Resolved. Just small comment, next time please do let everyone know via dev@ list that you are working on it to make

[jira] [Created] (FLINK-1647) Push master documentation (latest) to Flink website

2015-03-04 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-1647: Summary: Push master documentation (latest) to Flink website Key: FLINK-1647 URL: https://issues.apache.org/jira/browse/FLINK-1647 Project: Flink Issue Type:

Re: Documentation in the master

2015-03-04 Thread Maximilian Michels
(2) I found out, it's actually not the SVG but the Webserver which sets the wrong content type for svg files. I checked on the ci.apache.org server. It serves SVGs as "Content-Type: text/html" which lets the browser assume html is in the SVG file but it is XML. The correct content type would be so

[MultipleProgramsTestBase][Cluster vs. Collection mode] Inconsistent Behavior

2015-03-04 Thread Andra Lungu
Hello, I have implemented a Bulk Synchronous Version of Triangle Count. The code can be found here: https://github.com/andralungu/gelly-partitioning/tree/triangles In this algorithm, the messages sent differ as the superstep differs. In order to distinguish between superstep numbers, I used the g

Re: Could not build up connection to JobManager

2015-03-04 Thread Stephan Ewen
If I recall correctly, we only hardcode "localhost" in the local mini cluster - do you think it is problematic there as well? Have you found any other places? On Mon, Mar 2, 2015 at 10:26 AM, Dulaj Viduranga wrote: > In some places of the code, "localhost" is hard coded. When it is resolved > b

Documentation in the master

2015-03-04 Thread Maximilian Michels
Hey there, Just letting you know, we now have the documentation of all releases, including the latest snapshot version, available on the Flink website. While checking out the latest master documentation, Marton and me were wondering if some of the documentation should really be available for the

Re: Documentation in the master

2015-03-04 Thread Stephan Ewen
Great, thanks Max! Concerning (1), in the snapshot master, we can have stubs, IMHO. Concerning (2), how do we fix the SVG files? On Wed, Mar 4, 2015 at 3:30 PM, Maximilian Michels wrote: > Hey there, > > Just letting you know, we now have the documentation of all releases, > including the late

[jira] [Created] (FLINK-1646) Add name of required configuration value into the "Insufficient number of network buffers" exception

2015-03-04 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1646: - Summary: Add name of required configuration value into the "Insufficient number of network buffers" exception Key: FLINK-1646 URL: https://issues.apache.org/jira/browse/FLINK-16

[jira] [Created] (FLINK-1645) Move StreamingClassloaderITCase to flink-streaming

2015-03-04 Thread JIRA
Márton Balassi created FLINK-1645: - Summary: Move StreamingClassloaderITCase to flink-streaming Key: FLINK-1645 URL: https://issues.apache.org/jira/browse/FLINK-1645 Project: Flink Issue Type

Re: Access flink-conf.yaml data

2015-03-04 Thread Robert Metzger
Cool. I'll merge #427 as soon as https://github.com/apache/flink/pull/410 is in master. On Wed, Mar 4, 2015 at 12:48 PM, Kirschnick, Johannes < johannes.kirschn...@tu-berlin.de> wrote: > Good point #427 looks more complete - will wait for the merge and just use > my workaround locally in the mean

Re: Access flink-conf.yaml data

2015-03-04 Thread Kirschnick, Johannes
Good point #427 looks more complete - will wait for the merge and just use my workaround locally in the meantime Johannes -Ursprüngliche Nachricht- Von: ewenstep...@gmail.com [mailto:ewenstep...@gmail.com] Im Auftrag von Stephan Ewen Gesendet: Mittwoch, 4. März 2015 12:42 An: dev@flink.

[jira] [Created] (FLINK-1644) WebClient dies when no ExecutionEnvironment in main method

2015-03-04 Thread Jonathan Hasenburg (JIRA)
Jonathan Hasenburg created FLINK-1644: - Summary: WebClient dies when no ExecutionEnvironment in main method Key: FLINK-1644 URL: https://issues.apache.org/jira/browse/FLINK-1644 Project: Flink

Re: Access flink-conf.yaml data

2015-03-04 Thread Stephan Ewen
I think that #427 is a good way to do this. It bypasses the singleton GlobalConfiguration that I personally hope to get rid of. On Wed, Mar 4, 2015 at 11:49 AM, Robert Metzger wrote: > Hi Johannes, > > This change will allow users to pass a custom configuration to the > LocalExecutor: https://gi

[jira] [Created] (FLINK-1643) Detect tumbling policies where trigger and eviction match

2015-03-04 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-1643: - Summary: Detect tumbling policies where trigger and eviction match Key: FLINK-1643 URL: https://issues.apache.org/jira/browse/FLINK-1643 Project: Flink Issue Type:

Re: Access flink-conf.yaml data

2015-03-04 Thread Robert Metzger
Hi Johannes, This change will allow users to pass a custom configuration to the LocalExecutor: https://github.com/apache/flink/pull/427. Is that what you're looking for? On Wed, Mar 4, 2015 at 11:46 AM, Kirschnick, Johannes < johannes.kirschn...@tu-berlin.de> wrote: > Hi Stephan, > > I just came

Re: Access flink-conf.yaml data

2015-03-04 Thread Kirschnick, Johannes
Hi Stephan, I just came across the same problem in accessing the constants and in particular setting custom properties. In particular I noticed that the Minicluster started in the Local Environment cannot easily be customized as it does not take into account any custom environment variables - n

[jira] [Created] (FLINK-1642) Flakey YARNSessionCapacitySchedulerITCase

2015-03-04 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1642: Summary: Flakey YARNSessionCapacitySchedulerITCase Key: FLINK-1642 URL: https://issues.apache.org/jira/browse/FLINK-1642 Project: Flink Issue Type: Bug

Re: About FLINK-1537 Machine learning with Apache Flink

2015-03-04 Thread Dulaj Viduranga
Great. Thanks. On Mar 04, 2015, at 02:48 PM, Stephan Ewen wrote: @Till is working on bootstrapping a machine learning Library, he can probably give you some points... Am 04.03.2015 04:34 schrieb "Dulaj Viduranga" : Great. So can you assign me someone to brainstorm the project idea and make

Re: About FLINK-1537 Machine learning with Apache Flink

2015-03-04 Thread Stephan Ewen
@Till is working on bootstrapping a machine learning Library, he can probably give you some points... Am 04.03.2015 04:34 schrieb "Dulaj Viduranga" : > Great. So can you assign me someone to brainstorm the project idea and > make a proposal that would benefit flink the most? > > On Mar 04, 2015, a

[jira] [Created] (FLINK-1641) Make projection operator chainable

2015-03-04 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-1641: - Summary: Make projection operator chainable Key: FLINK-1641 URL: https://issues.apache.org/jira/browse/FLINK-1641 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Make a release to be announced at ApacheCon

2015-03-04 Thread Robert Metzger
+1 for Marton as a release manager. Thank you! On Tue, Mar 3, 2015 at 7:56 PM, Henry Saputra wrote: > Ah, thanks Márton. > > So we are chartering to the similar concept of Spark RRD staging execution > =P > I suppose there will be a runtime configuration or hint to tell the > Flink Job manager