Re: ASF Board Meeting Summary - December 17, 2014

2014-12-18 Thread Sebastian Schelter
Congrats, awesome. On 12/17/2014 10:16 PM, Henry Saputra wrote: > Yay! With name like Flink it is hard to say no for graduation =P > > On Wed, Dec 17, 2014 at 12:49 PM, Alan Gates wrote: >> >> Congratulations, we're a TLP! >> >> Alan. >> >> *From:* Brett Porter >> *Date:* December 17, 2014 a

[jira] [Created] (FLINK-1332) Possible deadlock with two broadcast sets

2014-12-16 Thread Sebastian Schelter (JIRA)
Sebastian Schelter created FLINK-1332: - Summary: Possible deadlock with two broadcast sets Key: FLINK-1332 URL: https://issues.apache.org/jira/browse/FLINK-1332 Project: Flink Issue Type

[jira] [Created] (FLINK-1306) Scala API does not support standard sets

2014-12-05 Thread Sebastian Schelter (JIRA)
Sebastian Schelter created FLINK-1306: - Summary: Scala API does not support standard sets Key: FLINK-1306 URL: https://issues.apache.org/jira/browse/FLINK-1306 Project: Flink Issue Type

[jira] [Created] (FLINK-1305) Flink's hadoop compatibility layer cannot handle NullWritables

2014-12-05 Thread Sebastian Schelter (JIRA)
Sebastian Schelter created FLINK-1305: - Summary: Flink's hadoop compatibility layer cannot handle NullWritables Key: FLINK-1305 URL: https://issues.apache.org/jira/browse/FLINK-1305 Pr

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Sebastian Schelter
Board of Directors as the chair >>>> of the Apache Flink Project, and to have primary responsibility >>>> for management of the projects within the scope of >>>> responsibility of the Apache Flink Project; and be it further >>>> >>>> RESOLVED, that

Re: [DISCUSS] Graduation of Flink from the Incubator

2014-11-28 Thread Sebastian Schelter
IMHO, the main purpose of the incubator is to show that the project adheres to the Apache Way and is able to grow its community. I think Flink has proven both, so I concur that the project is ready to graduate. Best, Sebastian On 11/28/2014 08:56 AM, Stephan Ewen wrote: > Hi! > > I feel very exc

Re: Compression of network traffic

2014-11-24 Thread Sebastian Schelter
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 What reduction in network traffic can we expect from using compression? - -s On 11/24/2014 10:20 AM, Stephan Ewen wrote: > Will the compression Codec will be inserted in the Netty loops, or > before that? > > In any case, would it make sense to pr

[jira] [Created] (FLINK-1269) Easy way to "group count" dataset

2014-11-21 Thread Sebastian Schelter (JIRA)
Sebastian Schelter created FLINK-1269: - Summary: Easy way to "group count" dataset Key: FLINK-1269 URL: https://issues.apache.org/jira/browse/FLINK-1269 Project: Flink Issue

[jira] [Created] (FLINK-1255) Problems with generic types in Scala API

2014-11-19 Thread Sebastian Schelter (JIRA)
Sebastian Schelter created FLINK-1255: - Summary: Problems with generic types in Scala API Key: FLINK-1255 URL: https://issues.apache.org/jira/browse/FLINK-1255 Project: Flink Issue Type

Re: [ANNOUNCE] Welcome Vasia Kalavri as a new committer

2014-11-14 Thread Sebastian Schelter
Well deserved, welcome!!! On 11/14/2014 02:52 PM, Kostas Tzoumas wrote: Hi everyone, In the PPMC we have voted to add Vasia Kalavri as a new committer to Flink. Vasia, welcome! Kostas

Re: [DISCUSS] Logo for Flink

2014-09-16 Thread Sebastian Schelter
I think its really awesome. Great job, Linda! 2014-09-16 10:03 GMT-07:00 Kostas Tzoumas : > Hi everyone, > > Linda Gavin, an amazing Berlin-based designer (https://dribbble.com/jusum) > has made some logos for Flink based on the squirrel idea of a previous > discussion here. > > Here it is: > ht

Re: Proposal: Refactor distributed coordination to use the Akka Actor Library

2014-09-05 Thread Sebastian Schelter
+1 2014-09-05 6:46 GMT-07:00 Till Rohrmann : > +1 > > > On Fri, Sep 5, 2014 at 3:04 PM, Stephan Ewen wrote: > > > +1 > > > > > > On Fri, Sep 5, 2014 at 2:53 PM, Ufuk Celebi wrote: > > > > > +1 > > > > > > > > > On Fri, Sep 5, 2014 at 2:25 PM, Kostas Tzoumas > > > wrote: > > > > > > > +1 for r

Re: [VOTE] Using Scala to reimplement the JobManager and TaskManager

2014-09-03 Thread Sebastian Schelter
Hi Ufuk, It is up to the project where to vote upfront before working on a code change or whether to do it afterwards. --sebastian 2014-09-03 15:55 GMT-07:00 Ufuk Celebi : > Hey Daniel, > > I am sure that Till didn't try to set up the vote towards his desired > outcome. Actually it should con

Re: Change of logging infrastructure

2014-09-02 Thread Sebastian Schelter
Very nice! 2014-09-02 11:37 GMT-07:00 Robert Metzger : > Cool. > How about adding a new page in the build-in documentation (docs/ directory) > that contains general remarks for developers (such as logging infra, > configuration, IDE, tooling etc.). > > > > > On Tue, Sep 2, 2014 at 8:29 PM, Till

Re: MRQL on Flink

2014-08-27 Thread Sebastian Schelter
Awesome! 2014-08-27 13:49 GMT-07:00 Leonidas Fegaras : > Hello, > I would like to let you know that Apache MRQL can now run queries on Flink. > MRQL is a query processing and optimization system for large-scale, > distributed data analysis, built on top of Apache Hadoop/map-reduce, > Hama, Spark

Re: Release announcement draft

2014-08-26 Thread Sebastian Schelter
One more thing to consider: I would change Object-based APIs to POJO-based APIs as this is a known term in the developing world. Just a thought. Best, Sebastian 2014-08-26 9:15 GMT-07:00 Kostas Tzoumas : > Thanks everyone! I uploaded a changed post here: > http://flink.incubator.apache.org/news

Re: Release announcement draft

2014-08-26 Thread Sebastian Schelter
Sounds very good. I would just change "large intermediate datasets" to "large datasets" Best, Sebastian 2014-08-26 7:29 GMT-07:00 Vasiliki Kalavri : > /me likes it too :) > > Just a minor comment, in the end of the first paragraph: > "Releases up to 0.5 were under the name Stratosphere, from >

Re: Changing Scala Version to 2.11.x

2014-08-24 Thread Sebastian Schelter
Move fast / break things -- for now. > > > > On Sun, Aug 24, 2014 at 12:02 PM, Aljoscha Krettek > > wrote: > > > It would require users to move to 2.11 as well. So this might not be > > such a > > > good move right now, but that is why I'm askin

Re: Changing Scala Version to 2.11.x

2014-08-23 Thread Sebastian Schelter
What does this mean from a user perspective? I'm not sure whether most companies are already moving to Scala 2.11. I know from one large company that is only conducting the move from 2.9 to 2.10 right now. Best, Sebastian On 08/23/2014 05:22 PM, Stephan Ewen wrote: +1 Am 23.08.2014 17:16 sc

Re: Who is interested in starting a weekly or bi-weekly IRC / Hangout meeting?

2014-07-01 Thread Sebastian Schelter
Ted did the recording via youtube, better ask him -s Am 01.07.2014 10:04 schrieb "Stephan Ewen" : > I think Sebastian Schelter mentionted that they did this a couple of times > in Mahout. I'll ping him for pointers... > > > On Tue, Jul 1, 2014 at 7:02 PM, Henry S

Re: KMeans job gets stuck and never completes

2014-06-22 Thread Sebastian Schelter
edMapDriver.collect(ChainedMapDriver.java:71) > at > > eu.stratosphere.pact.runtime.task.DataSourceTask.invoke(DataSourceTask.java:228) > at > > eu.stratosphere.nephele.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:284) > at java.lang.Thread.run(Thread.java:744) > > > Thanks for your help Sebastian. > > Re

Re: KMeans job gets stuck and never completes

2014-06-22 Thread Sebastian Schelter
Have you looked at a jstack dump on one of the workera? That typically helps finding out, where the processes are stuck. -s Am 22.06.2014 13:32 schrieb "José Luis López Pino" : > Hi, > > I'm running the KMeans java and scala examples in two nodes. It works fine > with very small files (3MB) but w

Re: Java Primitive Collections in Flink

2014-06-19 Thread Sebastian Schelter
+1 for fastutils On 06/20/2014 08:50 AM, Robert Metzger wrote: Hi Robert, The Apache Commons Primitives Collection project seems to be pretty inactive. The last release was in 2003, there are many dead links on the website. I would not suggest to use it. HPPC and fastutil seem pretty similar t

Re: iterative processing

2014-06-17 Thread Sebastian Schelter
The internal state of pagerank is just the rank vector which would be 100k times 1. --sebastian Am 17.06.2014 17:56 schrieb "Yingjun Wu" : > Hi Stephan, > > Thanks for your quick reply. > > Let's just consider a simple iterative processing algorithm, say, pagerank. > If we wanna compute the pager

Re: Admin access to github.com/apache/incubator-flink

2014-06-13 Thread Sebastian Schelter
Dmitriy did a nice writeup for the new github integration of Mahout, that could be helpful here: https://mahout.apache.org/developers/github.html --sebastian On 06/13/2014 02:26 PM, Robert Metzger wrote: Ah, and reading the emails from the bot also helps. It says: To close this pull request,

Re: Non-Apache bug-fixing release 0.5.1

2014-06-11 Thread Sebastian Schelter
Sounds reasonable to me, especially given the fact that the namesearch w.r.t flink is not completed yet. --sebastian On 06/11/2014 09:01 AM, Tzoumas, Kostas wrote: Hi everyone, As mentioned in https://issues.apache.org/jira/browse/FLINK-886, a minor release that contains only bug fixes is p

Re: Infrastructure setup

2014-06-10 Thread Sebastian Schelter
Hi, In Mahout, we made very bad experiences with the wiki. Its superslow, hard to overlook and people often abuse it to ask questions. I would suggest to concentrate on the website and have users contribute content to the website instead. --sebastian On 06/10/2014 05:02 PM, Alan Gates wrot