Re: MODERATE for dev@flink.incubator.apache.org

2014-07-14 Thread Henry Saputra
Hi Martin, To start participating/ send emails to dev@flink.incubator.apache.org please send subscribe request first to dev-subscr...@flink.incubator.apache.org. Thanks, - Henry On Mon, Jul 14, 2014 at 4:23 AM, wrote: > > To approve: >dev-accept-1405337015.11291.ejgagdfpnegdnbgoe...@fli

Re: A wiki for Flink

2014-07-14 Thread Robert Metzger
If we go for a ASF hosted wiki, we can choose between a moin wiki ( http://moinmo.in/) and Confluence. We could write a little script that sends mails to the list on edits (the APIs of GitHub would allow for that) I vote for using Confluence. Getting a ASF-compliant GitHub Wiki is probably not wo

Re: Draft for Project Website

2014-07-14 Thread Robert Metzger
The two websites are basically using the same technologies behind the scenes. Having the main navigation always on top is very easy to implement. If others feel the same, its very easy to change the behavior. Regarding the navigation in the documentation: We changed some details here because we ar

[jira] [Created] (FLINK-1026) WordCount POJO fails with null pointer exception

2014-07-14 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1026: --- Summary: WordCount POJO fails with null pointer exception Key: FLINK-1026 URL: https://issues.apache.org/jira/browse/FLINK-1026 Project: Flink Issue Type: Bug

Re: Some notes from the first Flink Hangout

2014-07-14 Thread Henry Saputra
+1 How was it done last time to get the hangout invite? On Monday, July 14, 2014, Robert Metzger wrote: > If we stick to our decision to do a bi-weekly hangout, the next one would > be this Wednesday. > Are we going again for 9am PST / 6pm CET ? > > Robert > > > On Wed, Jul 2, 2014 at 7:12 PM,

Re: Adding the streaming project to the main repository

2014-07-14 Thread Márton Balassi
Hi guys, @Stefan: Thanks for the script, we've gone through the commits with Gabor, Gyula is reviewing it right now. https://github.com/mbalassi/incubator-flink/commits/streamrebase3 @Robert: We've went through the coding style, the update commit is already pushed to our old repo, I'm merging it

Re: Adding the streaming project to the main repository

2014-07-14 Thread Henry Saputra
@Stephan, yes unfortunately all the individuals who have contributed code need to send his/her ICLAs. Once we resolved the open issues then we ready to merge =) - Henry On Mon, Jul 14, 2014 at 7:58 AM, Stephan Ewen wrote: > Before adding this contribution to the project, there are some legal th

[jira] [Created] (FLINK-1025) Improve BLOB Service

2014-07-14 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-1025: --- Summary: Improve BLOB Service Key: FLINK-1025 URL: https://issues.apache.org/jira/browse/FLINK-1025 Project: Flink Issue Type: Improvement Components

Re: Ongoing Projects in stratosphere

2014-07-14 Thread Sudheer Sana
I will get back to you after reading about them

Re: Adding the streaming project to the main repository

2014-07-14 Thread Stephan Ewen
Before adding this contribution to the project, there are some legal things to do: - Obtain ICLAs from all major contributors. There are 7 in the streaming code, out of which three did the largest portion of the work: Márton Balassi, Gyula Fóra, Hermann Gábor - @mentors: Should the other 4 also

Re: Ongoing Projects in stratosphere

2014-07-14 Thread Kostas Tzoumas
Hi Sudheer, Here is a previous thread that mentioned a few longer-term research-y projects: http://mail-archives.eu.apache.org/mod_mbox/incubator-flink-dev/201406.mbox/%3CCAGWx-_uzeyW_HTjQtkfEktQeU=ozjgjgml-lgwzt5gyexdx...@mail.gmail.com%3E Let us know if any of those titles sounds interesting, a

Re: Some notes from the first Flink Hangout

2014-07-14 Thread Kostas Tzoumas
+1 On Mon, Jul 14, 2014 at 3:27 PM, Robert Metzger wrote: > If we stick to our decision to do a bi-weekly hangout, the next one would > be this Wednesday. > Are we going again for 9am PST / 6pm CET ? > > Robert > > > On Wed, Jul 2, 2014 at 7:12 PM, Márton Balassi > wrote: > > > Thanks for the

Re: Adding the streaming project to the main repository

2014-07-14 Thread Stephan Ewen
Ho guys! I made a scripted manual rebase of each commit (basically add the commit not via its diff, but such that it reflects the code base after the commit) https://github.com/StephanEwen/incubator-flink/commits/streamrebase No more merge commits that mess things up. You should be able to squas

Re: Some notes from the first Flink Hangout

2014-07-14 Thread Robert Metzger
If we stick to our decision to do a bi-weekly hangout, the next one would be this Wednesday. Are we going again for 9am PST / 6pm CET ? Robert On Wed, Jul 2, 2014 at 7:12 PM, Márton Balassi wrote: > Thanks for the write-up, I do agree with the streaming notes. > > Cheers, > > Marton > > > On W

Re: Ongoing Projects in stratosphere

2014-07-14 Thread Robert Metzger
Hi, you are right, the link there is broken. We recently updated the README (as part of the rename from Stratosphere to Flink). You can find the instructions here in an older version of the Readme: https://github.com/apache/incubator-flink/blob/0902829e4e9ef9a3a37ee6a89cfc52200796fd88/README.md#ec

Re: Ongoing Projects in stratosphere

2014-07-14 Thread Gyula Fóra
Generally you can just simply import it as a maven project using the Eclipse maven plugin and it should work. 2014.07.14. 15:18 ezt írta ("Sudheer Sana" ): > Hi > > When I am clicking the set up the Eclipse IDE for development >

Re: Ongoing Projects in stratosphere

2014-07-14 Thread Sudheer Sana
Hi When I am clicking the set up the Eclipse IDE for development , and how to build the code . in the link http://flink.incubator.apache.org/how-to-contribute.htm

Re: broadcast variable in spargel

2014-07-14 Thread Stephan Ewen
Hi Martin! There is an option to use BC variables in Spargel: The VertexCentricIteration has two methods " addBroadcastSetForMessagingFunction"and"addBroadcastSetForUpdateFunction". Stephan On Mon, Jul 14, 2014 at 1:23 PM, Martin Neumann wrote: > Hej, > > I'm using the latest trunk version

broadcast variable in spargel

2014-07-14 Thread Martin Neumann
Hej, I'm using the latest trunk version of Flink and the new JavaAPI. I'm writing some graph algorithms that need to know the number of nodes in the graph. To get the number of nodes I run a short count job and then get a DataSet that I need to give as input to the other calculations. It works fo

Re: Ongoing Projects in stratosphere

2014-07-14 Thread Sudheer Sana
Thanks for the reply, and I will start with your suggestion. -- Thanks & Regards *Sana Sudheer*, 4th year Undergraduate (Dual Degree), Department of Computer Science & Engineering, IIT Madras. On Mon, Jul 14, 2014 at 4:07 PM, Robert Metzger wrote: > Hi, > > 10 months is a good amount of time!

Re: Ongoing Projects in stratosphere

2014-07-14 Thread Robert Metzger
Hi, 10 months is a good amount of time! I think we can find a suitable project for you. I would still suggest to start working on a small task first. You'll figure out the setup (eclipse/IntelliJ, git, jira, mailinglist) and its a easier start into our code. In addition, I think its easier for you

Re: Ongoing Projects in stratosphere

2014-07-14 Thread Sudheer Sana
Hi, I can spend 10 months time on this project. I want to do this as my academic project.

Re: Adding the streaming project to the main repository

2014-07-14 Thread Gyula Fóra
So what we have figured out so far is that git rebasing "straightens" out the history, so all the merges will be omitted and they need to be merged again. Doing this with our 540 regular and 120 merge commits seems a little overkill. In the light of this adding the streaming files as new files to t

Re: Adding the streaming project to the main repository

2014-07-14 Thread Gyula Fóra
Hey, As you have said, our commit history is indeed a little messy in some places especially regarding some duplicate commits. We tried what you suggested to rebase it with git rebase -i , but our problem is that because -i ignores the merge commits, squashing and editing names make pretty much al

Re: Ongoing Projects in stratosphere

2014-07-14 Thread Robert Metzger
Hi Sudheer, thank you for your interest in contributing to our project. We have a "how to contribute" guide on our website: http://flink.incubator.apache.org/how-to-contribute.html that also contains a link to the "starter" JIRA tasks. Robert On Mon, Jul 14, 2014 at 10:32 AM, Ufuk Celebi wrot

Re: Ongoing Projects in stratosphere

2014-07-14 Thread Ufuk Celebi
Hey Sudheer, Stratosphere is now called Flink. We have finished the renaming and are going to have our first Apache release. I would suggest to go over the issues on JIRA and pick something from there as a starting point first (there is a label called "starter"). The GSoC projects are quite la

Ongoing Projects in stratosphere

2014-07-14 Thread Sudheer Sana
Hi I am interested to do one of the projects which are mentioned in https://github.com/stratosphere/stratosphere/wiki/Google-Summer-of-Code-2014 , so, i want to know which all projects are started/finished, so that i can work on the different problem. Eagerly waiting for reply -- Thanks & Regard