Re: Question about Commit Policy

2015-01-07 Thread Kostas Tzoumas
+1 Let's encourage the use of component tags, I don't see the need for enforcing it. For commits that affect one component, I expect people will use it. On Wed, Jan 7, 2015 at 3:40 PM, Fabian Hueske fhue...@apache.org wrote: +1 for the guide and JIRA references. I'd keep the component tags

Re: Graph API Questions

2015-01-06 Thread Kostas Tzoumas
From what I have been overhearing from the Graph API development, some hurdles were type extractor errors that could not be deciphered easily, and the inability to bring back data easily back to the client. But it would be great if Vasia could elaborate! On Tue, Jan 6, 2015 at 10:39 AM, Aljoscha

Re: Problems with Eclipse IDE

2015-01-06 Thread Kostas Tzoumas
Would it also make sense to file an issue to Scala IDE 4.0.0? On Tue, Jan 6, 2015 at 10:03 AM, Stephan Ewen se...@apache.org wrote: Brilliant, thanks a lot. I am adding a how-to guide for setting up eclipse to the docs. And the ReadMe Stephan On Tue, Jan 6, 2015 at 12:09 AM, Gyula Fóra

Re: Restructuring the maven projects

2015-01-05 Thread Kostas Tzoumas
+1 On Sat, Jan 3, 2015 at 6:46 PM, Aljoscha Krettek aljos...@apache.org wrote: And also combine flink-java and flink-scala? P. S. Happy new year, everyone.  On Jan 2, 2015 3:53 PM, Stephan Ewen se...@apache.org wrote: Hi everyone! I think that by now, quite a bit of the maven project

Community vote for Hadoop Summit is open

2015-01-03 Thread Kostas Tzoumas
Hi everyone, Just a reminder, the community vote for the talks that will be accepted at the 2015 Hadoop Summit Europe is open and lasts until January 16. There are 4 submitted talks related to Flink on The Future of Apache Hadoop track [1] and one on the Applications of Hadoop and the Data

Re: [VOTE] Graduate Flink from the Incubator

2014-12-09 Thread Kostas Tzoumas
This VOTE passes with 27 (!) +1s and 0 -1s. +1 (binding) Kostas Tzoumas Robert Metzger Fabian Hueske Sebastian Schelter Aljoscha Krettek Gyula Fora Marton Balassi Stephan Ewen Till Rohrmann Ufuk Celebi Henry Saputra Alan Gates +1 (non-binding) Flavio Pompermaier Vasiliki Kalavri Alexander

[RESULT][VOTE] Graduate Flink from the Incubator

2014-12-09 Thread Kostas Tzoumas
This VOTE passes with 27 (!) +1s and 0 -1s. +1 (binding) Kostas Tzoumas Robert Metzger Fabian Hueske Sebastian Schelter Aljoscha Krettek Gyula Fora Marton Balassi Stephan Ewen Till Rohrmann Ufuk Celebi Henry Saputra Alan Gates +1 (non-binding) Flavio Pompermaier Vasiliki Kalavri Alexander

Re: Setting up IRC channel to promote discussions and getting help

2014-12-08 Thread Kostas Tzoumas
+1 On Mon, Dec 8, 2014 at 11:26 PM, Paris Carbone par...@kth.se wrote: +1 It will certainly bring all teams closer On 08 Dec 2014, at 23:17, Fabian Hueske fhue...@apache.org wrote: +1 2014-12-08 23:05 GMT+01:00 Ufuk Celebi u...@apache.org: +1 great idea On Monday, December

Re: Streaming windowing rework

2014-12-07 Thread Kostas Tzoumas
their thoughts about the work they are doing? Would love to give some feedbacks. - Henry On Fri, Dec 5, 2014 at 12:38 PM, Kostas Tzoumas ktzou...@apache.org wrote: Super! Paris and Jonas have been doing a lot of silent work (= not very visible in the mailing list) recently

Re: New Flink website layout and frontage

2014-12-06 Thread Kostas Tzoumas
at 6:22 PM, Kostas Tzoumas ktzou...@apache.org wrote: Thanks a lot for all the comments! I am integrating most of them and will commit soon On Mon, Dec 1, 2014 at 7:09 PM, Henry Saputra henry.sapu...@gmail.com wrote: I like the new bold layout =) Instead

[VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Kostas Tzoumas
...@apache.org * Till Rohrmann trohrm...@apache.org * Henry Saputrahsapu...@apache.org * Sebastian Schelters...@apache.org * Kostas Tzoumasktzou...@apache.org * Timo Walther apache email to be set up * Daniel Warneke

JIRA pages don't show up in Google search results

2014-12-05 Thread Kostas Tzoumas
Hey, I have noticed that when I search for an issue (e.g., Google search for FLINK-1281) the issues.apache.org/jira/... page does not typically show up (the mailing list archives do). For me it is actually more convenient to use Google search than the search in JIRA :-) Does anyone have any

Re: Streaming windowing rework

2014-12-05 Thread Kostas Tzoumas
Super! Paris and Jonas have been doing a lot of silent work (= not very visible in the mailing list) recently. Looking forward to seeing this coming in. On Fri, Dec 5, 2014 at 8:00 PM, Henry Saputra henry.sapu...@gmail.com wrote: Nice! Looking forward to it On Fri, Dec 5, 2014 at 9:34 AM,

New Flink website layout and frontage

2014-11-27 Thread Kostas Tzoumas
Hi everyone, Ufuk, Robert, and I worked on a new layout for the Flink website, and added some content to the frontpage to (hopefully) convey more clearly what Flink is all about and what are Flink's differentiating features (a point of criticism to the old website was often that it is very

Re: New Flink website layout and frontage

2014-11-27 Thread Kostas Tzoumas
can sort out aesthetic concerns even after the website is up, so I would like to focus this discussion more on the content. On Thu, Nov 27, 2014 at 7:48 PM, Kostas Tzoumas ktzou...@apache.org wrote: Hi everyone, Ufuk, Robert, and I worked on a new layout for the Flink website, and added some

[jira] [Created] (FLINK-1283) Update website layout and frontpage content

2014-11-26 Thread Kostas Tzoumas (JIRA)
Kostas Tzoumas created FLINK-1283: - Summary: Update website layout and frontpage content Key: FLINK-1283 URL: https://issues.apache.org/jira/browse/FLINK-1283 Project: Flink Issue Type: Sub

Re: Flink on Tez

2014-11-11 Thread Kostas Tzoumas
? - Henry On Fri, Nov 7, 2014 at 10:03 AM, Kostas Tzoumas ktzou...@apache.org wrote: Hello Flink and Tez, I would like to point you to a first version of Flink running on Tez. This is a Flink subproject (to be initially contributed to flink-addons) that allows you to run unmodified Flink

Re: Flink on Tez

2014-11-09 Thread Kostas Tzoumas
Just to clarify, the Flink engine is not going anywhere :-) Flink should IMO always have its own execution engine, which is currently under very active development. Tez and Java collections are two additional backends that users will be able to enable depending on their needs. On Saturday,

Re: Flink on Tez

2014-11-09 Thread Kostas Tzoumas
Flavio, see my first post in this thread. If these differences are fine print for your application/requirements, then yes, both backends will do the same thing (distribute computation). In that case, the suggestion would be to use Flink in the normal way, as it is much more mature

Flink on Tez

2014-11-07 Thread Kostas Tzoumas
Hello Flink and Tez, I would like to point you to a first version of Flink running on Tez. This is a Flink subproject (to be initially contributed to flink-addons) that allows you to run unmodified Flink programs on top of Apache Tez. You can get the code here:

Re: Coarse-grained FT implementation

2014-11-07 Thread Kostas Tzoumas
Hi Henry, Afaik this is already in the current master, see ExecutionGraph.restart(). The goal is now to make fault tolerance more fine grained by restarting from checkpointed intermediate data sets, not from the base data. Kostas On Fri, Nov 7, 2014 at 6:49 PM, Henry Saputra

Regular Flink meetup in Berlin

2014-11-04 Thread Kostas Tzoumas
Hi everyone, As some of you already know, there is a regular Flink meetup in Berlin: http://www.meetup.com/Apache-Flink-Meetup/ The next meeting is November 18: http://www.meetup.com/Apache-Flink-Meetup/events/217541712/ Feel free to share! Best, Kostas

Blog post for release 0.7.0

2014-11-04 Thread Kostas Tzoumas
I updated the blog with a blog post for the 0.7.0 release: http://flink.incubator.apache.org/news/2014/11/04/release-0.7.0.html Feel free to share! Let me know if you contributed and your name is missing.

[jira] [Created] (FLINK-1201) Graph API for Flink

2014-11-03 Thread Kostas Tzoumas (JIRA)
Kostas Tzoumas created FLINK-1201: - Summary: Graph API for Flink Key: FLINK-1201 URL: https://issues.apache.org/jira/browse/FLINK-1201 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-1200) Add count() aggregate function to Java and Scala APIs

2014-10-31 Thread Kostas Tzoumas (JIRA)
Kostas Tzoumas created FLINK-1200: - Summary: Add count() aggregate function to Java and Scala APIs Key: FLINK-1200 URL: https://issues.apache.org/jira/browse/FLINK-1200 Project: Flink Issue

Re: [VOTE] Release Apache Flink 0.7.0 (incubating) (RC2)

2014-10-21 Thread Kostas Tzoumas
+1 On Mon, Oct 20, 2014 at 1:27 PM, Fabian Hueske fhue...@apache.org wrote: +1 - Checked all signatures and hashes - Built from source archive (mvn clean install) - Ran all examples with provided data locally on previous build 2014-10-18 22:38 GMT+02:00 Robert Metzger

Re: about hdfs in flink cluster

2014-10-16 Thread Kostas Tzoumas
No, you don't need to install HDFS. You can use Flink without HDFS. On Thu, Oct 16, 2014 at 12:17 PM, Robert Metzger rmetz...@apache.org wrote: Hi, good to hear that you are using Flink. HDFS is a distributed file system for reliably storing huge amounts of data. Many users of Flink use

Re: Flink streaming benchmark and comparison numbers?

2014-10-10 Thread Kostas Tzoumas
I think this is the one Marton meant: https://www.dropbox.com/s/cjgbrrnen2mvi0f/streaming-throughput.pdf?dl=0 He can tell more about the setup. Kostas On Wed, Oct 8, 2014 at 12:45 AM, Henry Saputra henry.sapu...@gmail.com wrote: Thanks for the response, Márton! It is great news.

Re: Minor change to the versioning scheme

2014-10-08 Thread Kostas Tzoumas
+1 On Wed, Oct 8, 2014 at 2:42 PM, Stephan Ewen se...@apache.org wrote: Sounds reasonable... Am 08.10.2014 12:43 schrieb Fabian Hueske fhue...@apache.org: +1 2014-10-08 12:38 GMT+02:00 Robert Metzger rmetz...@apache.org: Hi guys, I noticed that we are doing the versioning of

Re: Keeping the reference to PACT compiler and Nephele names?

2014-09-30 Thread Kostas Tzoumas
Yes, the goal is to get rid of the Pact and Nephele references, as they do not reflect the current state in most cases. On Tue, Sep 30, 2014 at 9:31 AM, Ufuk Celebi u...@apache.org wrote: Hey Henry, On 30 Sep 2014, at 07:38, Henry Saputra henry.sapu...@gmail.com wrote: Do we want to keep

Re: [DISCUSS] Policy on keeping layer alternatives in sync

2014-09-27 Thread Kostas Tzoumas
If we allow out-of-sync APIs (and backends) until the time of a release, aren't we just postponing the syncing problem to the time of the release, which is a pretty bad time to have such a problem? On Fri, Sep 26, 2014 at 8:49 PM, Robert Metzger rmetz...@apache.org wrote: Hi, I'm also in

Re: Basic lambda prototype :)

2014-09-27 Thread Kostas Tzoumas
Wow so cool! On Sat, Sep 27, 2014 at 2:52 PM, Stephan Ewen se...@apache.org wrote: Wow, amazing :-) And so quickly done! Am 27.09.2014 11:14 schrieb Ufuk Celebi u...@apache.org: On 27 Sep 2014, at 08:00, Márton Balassi mbala...@apache.org wrote: I hope I could get you excited too :)

Re: Handling Integration of Documentation

2014-09-19 Thread Kostas Tzoumas
+1 I think a standalone docs site with a different nav bar will be more usable. On Fri, Sep 19, 2014 at 11:03 AM, Aljoscha Krettek aljos...@apache.org wrote: However, this would make the documentation even more complicated. Exactly, that's what I'm trying to avoid. If nobody has anything

Re: Handling Integration of Documentation

2014-09-19 Thread Kostas Tzoumas
/aljoscha/incubator-flink/tree/scala-rework cd docs ./build_docs.sh -p On Fri, Sep 19, 2014 at 11:50 AM, Kostas Tzoumas ktzou...@apache.org wrote: +1 I think a standalone docs site with a different nav bar will be more usable. On Fri, Sep 19, 2014 at 11:03 AM, Aljoscha

Re: [DISCUSS] Logo for Flink

2014-09-18 Thread Kostas Tzoumas
) on the website. On Thu, Sep 18, 2014 at 2:35 AM, Edward J. Yoon edwardy...@apache.org javascript:; wrote: awesome :o On Wed, Sep 17, 2014 at 2:03 AM, Kostas Tzoumas ktzou...@apache.org javascript:; wrote: Hi everyone, Linda Gavin, an amazing Berlin-based designer ( https

Re: Flink Hackathon in Stockholm (October 8th / 9th)

2014-09-18 Thread Kostas Tzoumas
- Vasia Kalavri - Martin Neumann - Stephan Ewen - Kostas Tzoumas Anyone who is interested, let us know! Greetings, Stephan

Re: [VOTE] Style of Flink squirrel logo for website and public accounts

2014-09-18 Thread Kostas Tzoumas
+1 for COLORED On Thu, Sep 18, 2014 at 12:31 PM, Ufuk Celebi u...@apache.org wrote: +1 for COLORED On Thu, Sep 18, 2014 at 12:30 PM, Gyula Fora gyf...@apache.org wrote: +COLORED On 18 Sep 2014, at 12:28, Fabian Hueske fhue...@apache.org wrote: Please vote on which style of Flink's

Re: Scala API rewrite almost complete

2014-09-14 Thread Kostas Tzoumas
) Those are unclaimed (if I'm not mistaken): - The relational Stuff - LinearRegression Cheers, Aljoscha On Wed, Sep 10, 2014 at 4:23 PM, Kostas Tzoumas ktzou...@apache.org wrote

Re: Scala API rewrite almost complete

2014-09-11 Thread Kostas Tzoumas
): - The relational Stuff - LinearRegression Cheers, Aljoscha On Wed, Sep 10, 2014 at 4:23 PM, Kostas Tzoumas ktzou...@apache.org wrote: Transitive closure here, I also added a termination criterion in the Java version: https://github.com/ktzoumas/incubator-flink

Re: Scala API rewrite almost complete

2014-09-09 Thread Kostas Tzoumas
ComputeEdgeDegrees for me! On Fri, Sep 5, 2014 at 11:44 AM, Márton Balassi balassi.mar...@gmail.com wrote: +1 BatchGradientDescent for me :) On Fri, Sep 5, 2014 at 11:15 AM, Kostas Tzoumas ktzou...@apache.org

Re: Scala API rewrite almost complete

2014-09-09 Thread Kostas Tzoumas
(Fabian) - BatchGradientDescent (Márton) - ComputeEdgeDegrees (Hermann) Those are unclaimed (if I'm not mistaken): - TransitiveClosure - The relational Stuff - LinearRegression Cheers, Aljoscha On Tue, Sep 9, 2014 at 5:21 PM, Kostas Tzoumas ktzou...@apache.org wrote: WebLog here

Re: [Annoucement] Two new committers in the Apache Flink project

2014-09-08 Thread Kostas Tzoumas
Marton, Gyula, welcome! On Sat, Sep 6, 2014 at 10:16 PM, Fabian Hueske fhue...@apache.org wrote: Wecome guys and congrats! 2014-09-06 21:51 GMT+02:00 Gyula Fóra gyula.f...@gmail.com: Thank you guys, we really appreciate it! We will do our best to keep this project awesome and to make

Re: A documentation for streaming

2014-09-05 Thread Kostas Tzoumas
Looks awesome! It would also be great to have one non-trivial piece of example code in the docs that connects to a streaming source, does some transformations, and prints the output to a file (or forwards to a streaming sink). I think this is a common use case that people have in mind, so showing

Re: Scala API rewrite almost complete

2014-09-05 Thread Kostas Tzoumas
+1 I go for WebLogAnalysis. My experience with Scala consists of going through a tutorial so this will be a good stress test both for me and the new API :-) On Thu, Sep 4, 2014 at 9:09 PM, Vasiliki Kalavri vasilikikala...@gmail.com wrote: +1 for having other people implement the examples!

Re: Replacing JobManager with Scala implementation

2014-09-05 Thread Kostas Tzoumas
Hi Daniel, +1 on the argument about attracting developers being irrelevant, the argument can work both ways and is very brittle The reasons for using Akka as a library (irrespective of the programming language) have been clearly articulated in my opinion by Stephan and Till in this thread. The

Re: Proposal: Refactor distributed coordination to use the Akka Actor Library

2014-09-05 Thread Kostas Tzoumas
+1 for refactoring using Akka, the arguments are overwhelming. On Fri, Sep 5, 2014 at 2:04 PM, Robert Metzger rmetz...@apache.org wrote: I agree with using Akka for RPC. It is ASF 2.0 licensed, seems to have a big community [1] and users [2] that depend on the system. The YARN client is

Re: Community Committing rules

2014-09-05 Thread Kostas Tzoumas
+1 for not requiring a vote thread unless someone asks for it On Fri, Sep 5, 2014 at 1:51 PM, Robert Metzger rmetz...@apache.org wrote: I agree with Stephan: If somebody wants to do a major change and is uncertain if the community is willing to accept the change, they can ask on the mailing

Re: Community Committing rules

2014-09-05 Thread Kostas Tzoumas
Henry, thank you *very much* for this input! I agree, let us not put more structure/rules than needed at this point. On Fri, Sep 5, 2014 at 6:58 PM, Henry Saputra henry.sapu...@gmail.com wrote: +1 for commits small changes directly, which is the perk of being committers of open source

Re: [VOTE] Using Scala to reimplement the JobManager and TaskManager

2014-09-04 Thread Kostas Tzoumas
+1 On Thu, Sep 4, 2014 at 10:30 AM, Aljoscha Krettek aljos...@apache.org wrote: +1 I think it's good to outsource functionality that is not our main competency. Because of the origins of Flink in research we suffered a bit from NIH in the beginning. I'm happy to see this reduced piece by

Re: Planning Flink release 0.7-incubating

2014-09-03 Thread Kostas Tzoumas
+1 On Wed, Sep 3, 2014 at 10:12 PM, Márton Balassi balassi.mar...@gmail.com wrote: +1 On Wed, Sep 3, 2014 at 9:54 PM, Till Rohrmann trohrm...@apache.org wrote: +1 Sounds good to me. On Wed, Sep 3, 2014 at 1:58 PM, Robert Metzger rmetz...@apache.org wrote: Hi, sorry,

Re: Replacing JobManager with Scala implementation

2014-09-02 Thread Kostas Tzoumas
in discovery which is greatest when they express the exact nature of a thing briefly and, as it were, picture it; then indeed the labor of thought is wonderfully diminished -- Gottfried Wilhelm Leibniz On Thu, Aug 28, 2014 at 12:57 PM, Kostas Tzoumas ktzou

Re: [stratosphere-dev] Spark comparison

2014-08-31 Thread Kostas Tzoumas
is taking a route that makes sure that the runtime is very robust, memory wise. We pay currently a few CPU cycles overhead for that, but we have an effort gong to bring that down. It would be interesting to rerun the experiments then... Greetings, Stephan On Sat, Aug 30, 2014 at 9:16 AM, Kostas

Re: [stratosphere-dev] Spark comparison

2014-08-30 Thread Kostas Tzoumas
Hi Anirvan, Yes, I am familiar with this thesis. I think that this comparison is by now quite old (1 year if I am not mistaken), and both systems have evolved substantially since then. Kostas On Fri, Aug 29, 2014 at 7:01 PM, Robert Metzger rmetz...@apache.org wrote: Forwarding the message to

Re: MRQL on Flink

2014-08-28 Thread Kostas Tzoumas
This is awesome, looking forward to trying it out! Leonidas, do you have any feedback for the Flink community? How easy was to implement the translation? Anything you struggled with? Kostas On Thu, Aug 28, 2014 at 12:06 AM, Ufuk Celebi u...@apache.org wrote: Awesome, indeed! Looking

Re: [VOTE] Release Apache Flink 0.6 (incubating) (RC2)

2014-08-08 Thread Kostas Tzoumas
+1 to stick to the names without prefix. Most projects do it this way, and it makes names smaller, which is good. On Fri, Aug 8, 2014 at 10:39 AM, Ufuk Celebi u.cel...@fu-berlin.de wrote: On 08 Aug 2014, at 09:38, Ufuk Celebi u.cel...@fu-berlin.de wrote: There is one additional issue I

Re: Adding the streaming project to the main repository

2014-08-08 Thread Kostas Tzoumas
Wow! Incredible :-) Can you share more details about the experiments you ran (cluster setup, jobs, etc)? On Fri, Aug 8, 2014 at 3:53 PM, Gyula Fóra gyula.f...@gmail.com wrote: Hey All, Quick weekely update on the streaming project: It was a good week we implemented a lot of new features

Re: RichFunctions and Streaming

2014-08-04 Thread Kostas Tzoumas
Hi Gyula, Sorry for not giving you a heads up for this. We changed the API to work on the interfaces that contain one abstract method rather than the rich functions in order to support Java 8 lambdas down the road (this is not done yet). We did this now in order to bundle as many breaking changes

Re: First Incubator Relase

2014-07-16 Thread Kostas Tzoumas
+1 Let us tackle the big things one at a time (and the first Apache release is a big thing by itself) On Wed, Jul 16, 2014 at 6:48 PM, Stephan Ewen se...@apache.org wrote: Hi everyone! We just had a hangout discussion (see previous mails for minutes and recording) where we talked about

Re: Some notes from the first Flink Hangout

2014-07-15 Thread Kostas Tzoumas
balassi.mar...@gmail.com javascript:; wrote: Thanks for the write-up, I do agree with the streaming notes. Cheers, Marton On Wed, Jul 2, 2014 at 7:10 PM, Kostas Tzoumas kostas.tzou...@tu-berlin.de javascript:; wrote: Hi everyone, I tried to record

Re: Some notes from the first Flink Hangout

2014-07-14 Thread Kostas Tzoumas
...@gmail.com wrote: Thanks for the write-up, I do agree with the streaming notes. Cheers, Marton On Wed, Jul 2, 2014 at 7:10 PM, Kostas Tzoumas kostas.tzou...@tu-berlin.de wrote: Hi everyone, I tried to record the first hangout on youtube but we had several problems

Re: Welcome Till Rohrmann as a new Committer

2014-07-10 Thread Kostas Tzoumas
Till, welcome! On Thu, Jul 10, 2014 at 1:06 PM, Márton Balassi balassi.mar...@gmail.com wrote: Congrats, Till! :) On Thu, Jul 10, 2014 at 12:24 PM, Stephan Ewen se...@apache.org wrote: Hi everyone! I would like to announce that the mentors and current committers voted to add Till

Re: Who is interested in starting a weekly or bi-weekly IRC / Hangout meeting?

2014-07-02 Thread Kostas Tzoumas
and made publicly available for later playback. So I think the recording works. On Wed, Jul 2, 2014 at 5:32 PM, Kostas Tzoumas kostas.tzou...@tu-berlin.de wrote: Hey folks, I hope this works. Joining the following hangout should have YouTube recording enabled: https

Some notes from the first Flink Hangout

2014-07-02 Thread Kostas Tzoumas
Hi everyone, I tried to record the first hangout on youtube but we had several problems with sound and video. Below are some rough notes. If you participated in the meeting, please feel free to add notes Kostas Website: - Documentation contains lots of broken links - Frontpage -

Re: July report for Flink

2014-06-26 Thread Kostas Tzoumas
+1 I have contacted the trademarks team with relevant data. On Thu, Jun 26, 2014 at 6:20 PM, Stephan Ewen se...@apache.org wrote: +1 You could add that we have a legal name search running with first responses coming back, so we should be able to make progress there. On Thu, Jun 26, 2014

Re: Some ideas for long-term Flink-related research and implementation projects

2014-06-24 Thread Kostas Tzoumas
at 9:25 AM, Kostas Tzoumas kostas.tzou...@tu-berlin.de wrote: Hi Folks, After talking with Stephan, Fabian, Robert, and Ufuk, we gathered a few project ideas that people have been throwing around. These do not immediately classify as issues as they are major extensions of Flink (some

Re: Some ideas for long-term Flink-related research and implementation projects

2014-06-24 Thread Kostas Tzoumas
Stephan, great work, thank you! I am interested Kostas On Tue, Jun 24, 2014 at 3:09 PM, Stephan Ewen se...@apache.org wrote: @everyone interested in the Tez work: I created a JIRA Issue with a brief summary of the current status and plans: https://issues.apache.org/jira/browse/FLINK-972

Re: No programming model documentation for release 0.5?

2014-06-20 Thread Kostas Tzoumas
I will work on this for the planned documentation port. On Wed, Jun 18, 2014 at 10:51 PM, Henry Saputra henry.sapu...@gmail.com wrote: Awesome, thanks Robert! On Wed, Jun 11, 2014 at 2:36 PM, Robert Metzger rmetz...@apache.org wrote: I filed a JIRA to add the page to the documentation

Some ideas for long-term Flink-related research and implementation projects

2014-06-20 Thread Kostas Tzoumas
Hi Folks, After talking with Stephan, Fabian, Robert, and Ufuk, we gathered a few project ideas that people have been throwing around. These do not immediately classify as issues as they are major extensions of Flink (some might classify as completely different projects). These would make nice

Re: iterative processing

2014-06-17 Thread Kostas Tzoumas
Hi Yingjun, What you describe actually does happen: The website ranks and the transition probabilities between websites are indeed partitioned across machines and the operators in the Stratosphere program that implements pagerank operate on partitioned data sets. The individual partitions of the

[jira] [Commented] (FLINK-926) Add shallowCopy method for tuples

2014-06-12 Thread Kostas Tzoumas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14029129#comment-14029129 ] Kostas Tzoumas commented on FLINK-926: -- Cool, can you assign it to me? Add