[jira] [Created] (FLINK-1609) FileSystem doesn't expose current user's home directory

2015-02-24 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-1609: --- Summary: FileSystem doesn't expose current user's home directory Key: FLINK-1609 URL: https://issues.apache.org/jira/browse/FLINK-1609 Project: Flink I

Re: k-means example behavior

2015-02-24 Thread Aljoscha Krettek
I think the behaviour is correct. If a cluster has not points then it has no centroid. If it has no centroid no points could ever be assigned to it again in the future since there is no way of calculating a distance. On Tue, Feb 24, 2015 at 6:57 PM, Vasiliki Kalavri wrote: > Hello everyone, > > I

[jira] [Created] (FLINK-1608) TaskManagers may pick wrong network interface when starting before JobManager

2015-02-24 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1608: --- Summary: TaskManagers may pick wrong network interface when starting before JobManager Key: FLINK-1608 URL: https://issues.apache.org/jira/browse/FLINK-1608 Project: Fl

Re: Could not build up connection to JobManager

2015-02-24 Thread Stephan Ewen
BTW: Does still work if you enter "localhost" for "jobmanager.rpc.address" in your flink-conf.yaml ? On Tue, Feb 24, 2015 at 7:50 PM, Stephan Ewen wrote: > Hi! > > I think that this is a problem in the current master (probably in there > since a few days ago). I am fixing it... > > Thanks for re

Re: Could not build up connection to JobManager

2015-02-24 Thread Stephan Ewen
Hi! I think that this is a problem in the current master (probably in there since a few days ago). I am fixing it... Thanks for reporting it! Stephan On Tue, Feb 24, 2015 at 6:52 PM, Stephan Ewen wrote: > Hi Dulaj! > > The log suggests that the JobManager binds itself to the IP > address 10.

Re: Flink Master broken...

2015-02-24 Thread Stephan Ewen
Hi Matthias! You are right, the package is actually wrong. Strange that the compiler never complained. Can you submit a patch? Stephan On Tue, Feb 24, 2015 at 7:02 PM, Matthias J. Sax < mj...@informatik.hu-berlin.de> wrote: > Hi, > > it builds after a fresh checkout. However, the file I menti

Re: Flink Master broken...

2015-02-24 Thread Matthias J. Sax
Hi, it builds after a fresh checkout. However, the file I mentioned is still buggy IMHO. > mjsax@T420s-dbis-mjsax:~/workspace_flink/dummy/flink$ grep package > flink-java/src/test/java/org/apache/flink/api/java/typeutils/runtime/kryo/KryoWithCustomSerializersTest.java > package org.apache.flink.

Re: Apache Flink GSOC 2015

2015-02-24 Thread Robert Metzger
Hi, There is a guide for new contributors here: http://flink.apache.org/how-to-contribute.html I would recommend you to run some examples to get familiar with Flink. Regards, Robert On Tue, Feb 24, 2015 at 3:58 PM, Kanwarpal Singh wrote: > Hi, > > I am working with Apache Hadoop and R languag

Re: Flink Master broken...

2015-02-24 Thread Robert Metzger
Hi Kanwarpal, please don't hijack other discussion threads on our mailinglist. I saw your message to the mailing list and I'm sure you'll get an answer to your question. Robert On Tue, Feb 24, 2015 at 6:56 PM, Kanwarpal Singh wrote: > Hi i am new to Flink,can anyone help me how i can work for t

k-means example behavior

2015-02-24 Thread Vasiliki Kalavri
Hello everyone, I'm using the k-means example as basis for a custom implementation and I noticed the following behavior: If during an iteration no point is assigned to a particular cluster, this cluster will then "disappear". This happens because SelectNearestCenter() outputs tuples, (where centr

Re: Flink Master broken...

2015-02-24 Thread Kanwarpal Singh
Hi i am new to Flink,can anyone help me how i can work for this community On Tue, Feb 24, 2015 at 11:06 PM, Fabian Hueske wrote: > The master builds for me as well. > Can you try to clone a new copy and do a "mvn -DskipTests clean install"? > > 2015-02-24 18:26 GMT+01:00 Matthias J. Sax >: > >

Re: Flink Master broken...

2015-02-24 Thread Stephan Ewen
Hi Matthias! Is it possible that at some point you pulled a non-fast.forward update and the automerge in git messed things up in your local repository? What you looks like a merge error on a rename - that may happen through git's automerge. I guess when you clone a fresh repo everything will be

Re: Could not build up connection to JobManager

2015-02-24 Thread Stephan Ewen
Hi Dulaj! The log suggests that the JobManager binds itself to the IP address 10.216.192.98 and the WebClient runs at 127.0.0.1 The 127.0.0.1 actor system cannot connect to the 10.216.192.98. Let me verify whether this is a quirk of your particular setup, or a bug recently introduces in the 0.9-

Re: Flink Master broken...

2015-02-24 Thread Fabian Hueske
The master builds for me as well. Can you try to clone a new copy and do a "mvn -DskipTests clean install"? 2015-02-24 18:26 GMT+01:00 Matthias J. Sax : > Hi, > > I build on command line: > > mjsax@T420s-dbis-mjsax:~/workspace_flink/flink$ git pull flink master > From https://github.com/apache/fl

Re: Flink Master broken...

2015-02-24 Thread Matthias J. Sax
Hi, I build on command line: mjsax@T420s-dbis-mjsax:~/workspace_flink/flink$ git pull flink master From https://github.com/apache/flink * branchmaster -> FETCH_HEAD Already up-to-date. The problem is in TEST: flink-java/src/test/java/org/apache/flink/api/java/typeutils/runtime/k

Re: Operating on Serialized Data

2015-02-24 Thread Max Michels
Apparently, the mailing list doesn't allow attachments. Here the example with syntax highlighting: https://gist.github.com/mxm/d1929b4b69dda87d5c37 public class CustomSerializer { public static class Vector implements Value { private transient double[] doubleValues; public Vect

Re: Flink Master broken...

2015-02-24 Thread Robert Metzger
How did you build Flink? I'm not so sure if the master is really broken because I've build it multiple times today, also our Travis says everything is fine: https://travis-ci.org/apache/flink/builds On Tue, Feb 24, 2015 at 5:29 PM, Matthias J. Sax < mj...@informatik.hu-berlin.de> wrote: > Hi, >

Re: Operating on Serialized Data

2015-02-24 Thread Max Michels
Hi Johannes, Thanks for your question. You can try to implement the Value interface for your Vector PoJo. It has to have an empty constructor and implement the write and read methods of the interface for serialization. Based on your description, I've implemented an example to demonstrate the use

Flink Master broken...

2015-02-24 Thread Matthias J. Sax
Hi, I just pulled the latest version "flink master" and I got a compilation error. I tracked the bug down. It seems that the following commit moved a class without changing the package statement... Cheers, Matthias commit 354efec0f9da0fa03ea9b337b02a1a2a03a9ac16 Author: Robert Metzger 2015-

Re: Could not build up connection to JobManager

2015-02-24 Thread Dulaj Viduranga
Is taskmanager.numberOfTaskSlots: -1 normal? > On Feb 24, 2015, at 9:44 PM, Robert Metzger wrote: > > Hi, > I could not find the logfiles attached to your mails. I think the > mailinglists are not accepting attachments. > Can you put the logs on gist.github.com? > > The configuration values are

Re: Could not build up connection to JobManager

2015-02-24 Thread Dulaj Viduranga
Oh, I can’t attach files. Here are my log data *Job manager 21:24:59,837 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where a

Re: Could not build up connection to JobManager

2015-02-24 Thread Robert Metzger
Hi, I could not find the logfiles attached to your mails. I think the mailinglists are not accepting attachments. Can you put the logs on gist.github.com? The configuration values are documented here: http://flink.apache.org/docs/0.8/config.html For the webclient's port its called webclient.port

Re: Could not build up connection to JobManager

2015-02-24 Thread Dulaj Viduranga
Hi, I still couldn’t figure out a solution. The logs for Jobmanager and webclient follows… It would be great if someone could take a look… Thanks > On Feb 24, 2015, at 1:41 PM, Stephan Ewen wrote: > > Hey Dulaj! > > As a contributor, I would go against the latest version, which is > 0.9-SNAP

Re: Could not build up connection to JobManager

2015-02-24 Thread Dulaj Viduranga
I tried to kill the job manager manually in the terminal and start it again but no luck. Also could you tell me if it’s possible to change webclient’s port (8080) ? > On Feb 24, 2015, at 1:41 PM, Stephan Ewen wrote: > > Hey Dulaj! > > As a contributor, I would go against the latest version, w

[jira] [Created] (FLINK-1607) SimpleRecoveryITCase fails spuriously on Travis

2015-02-24 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1607: Summary: SimpleRecoveryITCase fails spuriously on Travis Key: FLINK-1607 URL: https://issues.apache.org/jira/browse/FLINK-1607 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-1606) JobManagerFailsITCase fails spuriously for the Hadoop-2.0.0-alpha build profile on Travis

2015-02-24 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1606: Summary: JobManagerFailsITCase fails spuriously for the Hadoop-2.0.0-alpha build profile on Travis Key: FLINK-1606 URL: https://issues.apache.org/jira/browse/FLINK-1606

Apache Flink GSOC 2015

2015-02-24 Thread Kanwarpal Singh
Hi, I am working with Apache Hadoop and R language,i had good knowledge of Big Data concepts,i love to expolore emerging technologies,please tell me how i can contribute to this community,is there any task which i can do for this Apache Flink community. Regards, Kanwarpal Singh

Re: [DISCUSS] Discourage using the same class names even though in different packages

2015-02-24 Thread Henry Saputra
Thanks for the response, all. @Max, yes I second that the duplicate class names, at least the ones not on client facing APIs, add more confusion and it does not help, or even make it worse, the lack of code documentation in some of the classes to figure out how they work together. Agree we can an

Subscribe request from a developer

2015-02-24 Thread Rahul Kumar Singh
On Tue, Feb 24, 2015 at 7:25 PM, Rahul Kumar Singh < ra...@sigmoidanalytics.com> wrote: > Please accept. >

Re: [DISCUSS] Discourage using the same class names even though in different packages

2015-02-24 Thread Max Michels
Totally agree with you Henry. Duplicate class names just add confusion. However, the actual problem is the lack of documentation for a lot of classes. It would be great if we could have a documentation sprint in the near future to at least add a doc string for every class. This might be some work b

[jira] [Created] (FLINK-1605) Create a shaded Hadoop fat jar to resolve library version conflicts

2015-02-24 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1605: - Summary: Create a shaded Hadoop fat jar to resolve library version conflicts Key: FLINK-1605 URL: https://issues.apache.org/jira/browse/FLINK-1605 Project: Flink

Re: [DISCUSS] Discourage using the same class names even though in different packages

2015-02-24 Thread Till Rohrmann
+1 for Henry's proposition. On Tue, Feb 24, 2015 at 9:55 AM, Kostas Tzoumas wrote: > I agree, at least for all non-user facing classes (e.g., the examples in > Scala/Java/Streaming etc may have the same names) > > Kostas > > On Tue, Feb 24, 2015 at 9:10 AM, Stephan Ewen wrote: > > > That is a g

Operating on Serialized Data

2015-02-24 Thread Kirschnick, Johannes
Hi list, I have a general question on as to whether it's possible to significantly speed up the processing by cutting down on the serialization costs during iterations. The basic setup that I have are a couple of vectors that are repeatedly mutated (added & multiplied) as part of an iterative

[jira] [Created] (FLINK-1604) Livelock in PartitionRequestClientFactory

2015-02-24 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-1604: Summary: Livelock in PartitionRequestClientFactory Key: FLINK-1604 URL: https://issues.apache.org/jira/browse/FLINK-1604 Project: Flink Issue Type: Bug

Re: [DISCUSS] Discourage using the same class names even though in different packages

2015-02-24 Thread Kostas Tzoumas
I agree, at least for all non-user facing classes (e.g., the examples in Scala/Java/Streaming etc may have the same names) Kostas On Tue, Feb 24, 2015 at 9:10 AM, Stephan Ewen wrote: > That is a good comment, Henry. > > Let's try and follow this rule... > Am 24.02.2015 02:28 schrieb "Henry Sapu

Re: Could not build up connection to JobManager

2015-02-24 Thread Stephan Ewen
Hey Dulaj! As a contributor, I would go against the latest version, which is 0.9-SNAPSHOT. It may be in your case that the JobManager actor is down, but the process still lingers. (BTW: I have a patch pending that makes sure the process disappears when the actor via down). Could you have a look

Re: [DISCUSS] Discourage using the same class names even though in different packages

2015-02-24 Thread Stephan Ewen
That is a good comment, Henry. Let's try and follow this rule... Am 24.02.2015 02:28 schrieb "Henry Saputra" : > Just to be clear that I was not advocating flink to simplify the code > just for the sake of clarity :) > > Flink has a lot to offer by providing simple APIs by hiding complexity to >