Re: ApacheCon 2015 is coming to Austin, Texas, USA

2015-03-25 Thread Fabian Hueske
Thanks Henry for sharing! I will be in Austin and give a talk on Flink [1]. Just ping me if you'd like to meet and chat :-) Cheers, Fabian [1] http://sched.co/2P9s 2015-03-25 1:11 GMT+01:00 Henry Saputra : > Dear Apache Flink enthusiast, > > In just a few weeks, we'll be holding ApacheCon in A

Re: Affinity propagation for Gelly

2015-03-25 Thread Vasiliki Kalavri
Hello Yi Zhou, you are right that if every "data point"-vertex sends messages to every other vertex, this algorithm is too expensive and won't scale. However, I think that we don't need to consider all data points as exemplars for every vertex. Actually, you can see the input graph capturing thes

Re: [DISCUSS] Name of Expression API and DataSet abstraction

2015-03-25 Thread Aljoscha Krettek
I also prefer Relation. So what should we do? Doesn't really look like consensus. On Sat, Mar 21, 2015 at 6:02 PM, Paris Carbone wrote: > Both names look ok but if I had to choose I would go for the Relation API. > It defines a new DSL in contrast to data types (ie DataSet, DataStream) so it > d

TaskManagerFailsITCase gets stuck

2015-03-25 Thread Ufuk Celebi
I saw a similar issue yesterday as well: The following test gets stuck: TaskManagerFailsITCase should handle hard failing task manager Apparently, the task managers never registers. Can someone confirm this from the stack trace? Did someone run into this as well? $ jps 23800 surefirebooter6764

Re: [DISCUSS] Name of Expression API and DataSet abstraction

2015-03-25 Thread Alexander Alexandrov
+1 for DataTable as core abstraction name and "flink-table" or something similar as the package name. 2015-03-25 11:54 GMT+01:00 Aljoscha Krettek : > I also prefer Relation. So what should we do? Doesn't really look like > consensus. > > On Sat, Mar 21, 2015 at 6:02 PM, Paris Carbone wrote: > >

Re: [DISCUSS] Name of Expression API and DataSet abstraction

2015-03-25 Thread Aljoscha Krettek
But why DataTable? What other kind of Table could it be, CarTable? :D On Wed, Mar 25, 2015 at 1:53 PM, Alexander Alexandrov wrote: > +1 for DataTable as core abstraction name and "flink-table" or something > similar as the package name. > > 2015-03-25 11:54 GMT+01:00 Aljoscha Krettek : > >> I als

Re: [DISCUSS] Name of Expression API and DataSet abstraction

2015-03-25 Thread Fabian Hueske
I agree with Aljoscha on this. DataTable does not make a lot of sense to me... (except for going nicely with DataSet and DataStream). 2015-03-25 13:58 GMT+01:00 Aljoscha Krettek : > But why DataTable? What other kind of Table could it be, CarTable? :D > > On Wed, Mar 25, 2015 at 1:53 PM, Alexande

Re: TaskManagerFailsITCase gets stuck

2015-03-25 Thread Till Rohrmann
What do the logs say? It looks as if there is some issue with the TaskManager start up because the main is in the method waitForTaskManagersToBeRegistered. This happens for the initial ForkableFlinkMiniCluster start. On Wed, Mar 25, 2015 at 1:50 PM, Ufuk Celebi wrote: > I saw a similar issue yes

Re: [DISCUSS] Name of Expression API and DataSet abstraction

2015-03-25 Thread Henry Saputra
When consensus not happening we will go with VOTE. I think we have 2 candidates of names which are table and relation. - Henry On Wednesday, March 25, 2015, Aljoscha Krettek wrote: > I also prefer Relation. So what should we do? Doesn't really look like > consensus. > > On Sat, Mar 21, 2015 at

Re: ApacheCon 2015 is coming to Austin, Texas, USA

2015-03-25 Thread Henry Saputra
Hi Stephan, Glad to meet and chat for sure =) Love to see Flink represented in the ApacheCon. - Henry On Wed, Mar 25, 2015 at 3:12 AM, Fabian Hueske wrote: > Thanks Henry for sharing! > > I will be in Austin and give a talk on Flink [1]. > Just ping me if you'd like to meet and chat :-) > > Ch

Question about Streaming Windows in Join

2015-03-25 Thread Aljoscha Krettek
Hi, I noticed that the way you specify windows for a join differs from the way you specify windows on a DataStream. Maybe I'm missing something here. :D If not, is there are reason for this behaviour? Are there any plans to consolidate? Cheers, Aljoscha

Re: [jira] [Created] (FLINK-1781) Quickstarts broken due to Scala Version Variables

2015-03-25 Thread Alexander Alexandrov
Will take a look at that. The easiest solution would be to fix the version to 2.10 for now. Is this OK? 2015-03-25 1:48 GMT+01:00 Stephan Ewen (JIRA) : > Stephan Ewen created FLINK-1781: > --- > > Summary: Quickstarts broken due to Scala Version Variab

[jira] [Created] (FLINK-1784) KafkaITCase

2015-03-25 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-1784: Summary: KafkaITCase Key: FLINK-1784 URL: https://issues.apache.org/jira/browse/FLINK-1784 Project: Flink Issue Type: Bug Components: Streaming

[VOTE] Name of Expression API Representation

2015-03-25 Thread Aljoscha Krettek
Please vote on the new name of the equivalent to DataSet and DataStream in the new expression-based API. >From the previous discussion thread three names emerged: Relation, Table and DataTable. The vote is open for the next 72 hours. The name with the most votes is chosen. If the vote ends with n

Re: [VOTE] Name of Expression API Representation

2015-03-25 Thread Fabian Hueske
+Relation 2015-03-25 17:52 GMT+01:00 Aljoscha Krettek : > Please vote on the new name of the equivalent to DataSet and > DataStream in the new expression-based API. > > From the previous discussion thread three names emerged: Relation, > Table and DataTable. > > The vote is open for the next 72 h

Re: [VOTE] Name of Expression API Representation

2015-03-25 Thread Maximilian Michels
+DataTable On Wed, Mar 25, 2015 at 5:55 PM, Fabian Hueske wrote: > +Relation > > 2015-03-25 17:52 GMT+01:00 Aljoscha Krettek : > > > Please vote on the new name of the equivalent to DataSet and > > DataStream in the new expression-based API. > > > > From the previous discussion thread three name

Re: [VOTE] Name of Expression API Representation

2015-03-25 Thread Henry Saputra
+Relation PS Aljoscha, don't forget to cast your own vote :) On Wednesday, March 25, 2015, Aljoscha Krettek wrote: > Please vote on the new name of the equivalent to DataSet and > DataStream in the new expression-based API. > > From the previous discussion thread three names emerged: Relation,

Re: [jira] [Created] (FLINK-1781) Quickstarts broken due to Scala Version Variables

2015-03-25 Thread Robert Metzger
I haven't understood what the issue is actually. I though that maven is using the properties from "flink-parent", which is setting the scala version to 2.10 by default anyways. (By the way: mailing list replies to JIRA mails are not automatically added as comments to the JIRA) On Wed, Mar 25, 20

Re: [VOTE] Name of Expression API Representation

2015-03-25 Thread Vasiliki Kalavri
+Relation On Mar 25, 2015 6:29 PM, "Henry Saputra" wrote: > +Relation > > PS > Aljoscha, don't forget to cast your own vote :) > > > On Wednesday, March 25, 2015, Aljoscha Krettek > wrote: > > > Please vote on the new name of the equivalent to DataSet and > > DataStream in the new expression-bas

Re: Question about Streaming Windows in Join

2015-03-25 Thread Gyula Fóra
Hey Aljoscha, This is not an accident :D The reason behind only supporting time-window joins at the moment, is because time-window-joins can be implemented in a completely non-blocking fashion arising from the global nature of time. All other windows would need to be matched properly which inevi

UDP support in Streaming API

2015-03-25 Thread Janani Chakkaradhari
​Hi, Does Flink's streaming api has support for ​ reading streams of data via Java UDP (DatagramSocket)? If so kindly advise me in which release of Flink I can find it. Thanks, Janani

Re: [VOTE] Name of Expression API Representation

2015-03-25 Thread Ufuk Celebi
+Table, DataTable --- How are votes counted? When voting for the name of the project, we didn't vote for one name, but gave a preference ordering. In this case, I am for Table or DataTable, but what happens if I vote for Table and then there is a tie between DataTable and Relation? Will Table

Re: [VOTE] Name of Expression API Representation

2015-03-25 Thread Fabian Hueske
I think the voting scheme is clear. The mail that started the thread says: "The name with the most votes is chosen. If the vote ends with no name having the most votes, a new vote with an alternative voting scheme will be done." So let's go with a single vote and handle corner cases as they appea

Re: [VOTE] Name of Expression API Representation

2015-03-25 Thread Stephan Ewen
+Table API / Table I have a feeling that Relation is a name mostly used by people with a deeper background in (relational) databases, while table is more the pragmatic developer term. (As a reason for my choice) Am 25.03.2015 20:37 schrieb "Fabian Hueske" : > I think the voting scheme is clear. >

Re: UDP support in Streaming API

2015-03-25 Thread Stephan Ewen
Hi Janani! Do I understand you correctly in that you want a Flink stream source that receives UDP datagrams and turns them into Flink DataStream? Such a thing is not in there, yet. The interface to define custom data sources is rather simple, though, it should be possible to add something like th

Re: [GSoc][flink-streaming] Interested in pursuing FLINK-1617 and FLINK-1534

2015-03-25 Thread Akshay Dixit
Hi, The link to the draft proposal that I've prepared is https://gist.github.com/akshaydixi/88f3fbcebab0119a6a31 It would be great if I could get some feedback on it. Regards, Akshay Dixit On Wed, Mar 25, 2015 at 2:03 AM, Akshay Dixit wrote: > Thanks Gyula. > > I agree too that simple and workin

Master mvn test is broken with java.lang.NoSuchFieldError: IBM_JAVA error

2015-03-25 Thread Henry Saputra
Hi All, I just pulled from master and seemed like it fails mvn test: --- T E S T S --- --- T E S T S

Re: TaskManagerFailsITCase gets stuck

2015-03-25 Thread Henry Saputra
Just pull from master and saw different error when running mvn test. I just posted it to dev@ list. On Wed, Mar 25, 2015 at 7:05 AM, Till Rohrmann wrote: > What do the logs say? It looks as if there is some issue with the > TaskManager start up because the main is in the method > waitForTaskMan

[jira] [Created] (FLINK-1785) Master tests in flink-tachyon fail with java.lang.NoSuchFieldError: IBM_JAVA

2015-03-25 Thread Henry Saputra (JIRA)
Henry Saputra created FLINK-1785: Summary: Master tests in flink-tachyon fail with java.lang.NoSuchFieldError: IBM_JAVA Key: FLINK-1785 URL: https://issues.apache.org/jira/browse/FLINK-1785 Project: F