Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Chiwan Park
+1 :) — Chiwan Park (Sent with iPhone) > On Dec 6, 2014, at 1:32 AM, Alan Gates wrote: > > +1. > > Alan. > >> Kostas Tzoumas December 5, 2014 at 2:46 >> Hi everyone, >> >> It seems that everyone is excited about graduating, so I am calling for a >> com

Re: Streaming windowing rework

2014-12-05 Thread Henry Saputra
We actually need to bring these work come to light early so we could give feedback before getting to deep. Marton, could you encourage Paris and Jonas to publish or share their thoughts about the work they are doing? Would love to give some feedbacks. - Henry On Fri, Dec 5, 2014 at 12:38 PM, Ko

Re: New Flink website layout and frontage

2014-12-05 Thread Márton Balassi
Hey, it is nice that the new website is in place however I'm curious why the comparison with Spark got replace with Hadoop. :) On Fri, Dec 5, 2014 at 4:13 PM, Ufuk Celebi wrote: > Hey Kostas, > > I just saw a related issue: > https://issues.apache.org/jira/browse/FLINK-1089 > > You can close it

Re: [DISCUSS] Graduation of Flink from the Incubator

2014-12-05 Thread Sean Owen
As I mentioned on the other thread, yes it seems like this is a good time. +1 On Mon, Dec 1, 2014 at 2:05 PM, Henry Saputra wrote: > Thanks to Kostas for bringing the discussions to the community and I > believe Apache Flink is ready for graduation as top level project. > > There are more and gre

Re: Streaming windowing rework

2014-12-05 Thread Kostas Tzoumas
Super! Paris and Jonas have been doing a lot of "silent" work (= not very visible in the mailing list) recently. Looking forward to seeing this coming in. On Fri, Dec 5, 2014 at 8:00 PM, Henry Saputra wrote: > Nice! Looking forward to it > > On Fri, Dec 5, 2014 at 9:34 AM, Márton Balassi > wro

Re: Streaming windowing rework

2014-12-05 Thread Henry Saputra
Nice! Looking forward to it On Fri, Dec 5, 2014 at 9:34 AM, Márton Balassi wrote: > Hey, > > As you may know in some European countries Santa Claus comes on the 6th of > December, Saint Nicolas Day - from Finland. > > As Flink is not yet very active in Finland our Sweden team stepped in and > gav

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Alan Gates
+1. Alan. Kostas Tzoumas December 5, 2014 at 2:46 Hi everyone, It seems that everyone is excited about graduating, so I am calling for a community vote to graduate Apache Flink (incubating) to a top-level project (TLP). If this VOTE proceeds successfully, I will

Re: Streaming windowing rework

2014-12-05 Thread Vasiliki Kalavri
Yooohooo! Grattis Swedish team ^^ On 5 December 2014 at 18:54, Stephan Ewen wrote: > Wow, good news :-) > > Saint Nicolas had the help of his Finish elves Parisson, Gyulafred, and > Jonasson ? > > > > On Fri, Dec 5, 2014 at 6:34 PM, Márton Balassi > wrote: > > > Hey, > > > > As you may know in

[jira] [Created] (FLINK-1307) Allow input from nested directory structure

2014-12-05 Thread Vasia Kalavri (JIRA)
Vasia Kalavri created FLINK-1307: Summary: Allow input from nested directory structure Key: FLINK-1307 URL: https://issues.apache.org/jira/browse/FLINK-1307 Project: Flink Issue Type: New Fea

Re: Streaming windowing rework

2014-12-05 Thread Stephan Ewen
Wow, good news :-) Saint Nicolas had the help of his Finish elves Parisson, Gyulafred, and Jonasson ? On Fri, Dec 5, 2014 at 6:34 PM, Márton Balassi wrote: > Hey, > > As you may know in some European countries Santa Claus comes on the 6th of > December, Saint Nicolas Day - from Finland. > > A

Streaming windowing rework

2014-12-05 Thread Márton Balassi
Hey, As you may know in some European countries Santa Claus comes on the 6th of December, Saint Nicolas Day - from Finland. As Flink is not yet very active in Finland our Sweden team stepped in and gave us a big present with a huge rework on the windowing semantics - this is the implementation of

[jira] [Created] (FLINK-1306) Scala API does not support standard sets

2014-12-05 Thread Sebastian Schelter (JIRA)
Sebastian Schelter created FLINK-1306: - Summary: Scala API does not support standard sets Key: FLINK-1306 URL: https://issues.apache.org/jira/browse/FLINK-1306 Project: Flink Issue Type:

Re: Stringable Hashmap keys on POJOs

2014-12-05 Thread Aljoscha Krettek
Hmm, then what Stephan suggested might indeed be the best solution. On Fri, Dec 5, 2014 at 5:43 PM, Paris Carbone wrote: > @Alioscha It will be initially binary data (byte[]) from sensor streams > transformed into Hashmaps of numeric types and some additional metadata. > > Paris > >> On 05 Dec 2

Re: Stringable Hashmap keys on POJOs

2014-12-05 Thread Paris Carbone
@Alioscha It will be initially binary data (byte[]) from sensor streams transformed into Hashmaps of numeric types and some additional metadata. Paris > On 05 Dec 2014, at 13:14, Paris Carbone wrote: > > Great, thanks both for the recommendations! > > Paris > >> On 05 Dec 2014, at 12:56, St

[jira] [Created] (FLINK-1305) Flink's hadoop compatibility layer cannot handle NullWritables

2014-12-05 Thread Sebastian Schelter (JIRA)
Sebastian Schelter created FLINK-1305: - Summary: Flink's hadoop compatibility layer cannot handle NullWritables Key: FLINK-1305 URL: https://issues.apache.org/jira/browse/FLINK-1305 Project: Flink

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Henry Saputra
+1 (binding) On Fri, Dec 5, 2014 at 2:46 AM, Kostas Tzoumas wrote: > Hi everyone, > > It seems that everyone is excited about graduating, so I am calling for a > community vote to graduate Apache Flink (incubating) to a top-level project > (TLP). If this VOTE proceeds successfully, I will start a

[jira] [Created] (FLINK-1304) Add tests for the I/O Format wrappers

2014-12-05 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1304: - Summary: Add tests for the I/O Format wrappers Key: FLINK-1304 URL: https://issues.apache.org/jira/browse/FLINK-1304 Project: Flink Issue Type: Improvement

Re: JIRA pages don't show up in Google search results

2014-12-05 Thread Robert Metzger
It seems to depend on the issue ;) "FLINK-1074" is the first hit on google. Searching for "site:issues.apache.org/jira FLINK" will show you which issues are indexed. I can recommend searching for JIRAs with google mail ;) On Fri, Dec 5, 2014 at 4:46 PM, Kostas Tzoumas wrote: > Hey, > > I have n

Re: JIRA pages don't show up in Google search results

2014-12-05 Thread Kostas Tzoumas
Ah OK so it's just a matter of visibility. Fair enough, I'll use gmail from now on On Fri, Dec 5, 2014 at 4:53 PM, Robert Metzger wrote: > It seems to depend on the issue ;) > "FLINK-1074" is the first hit on google. > Searching for "site:issues.apache.org/jira FLINK" will show you which > issue

[jira] [Created] (FLINK-1303) HadoopInputFormat does not work with Scala API

2014-12-05 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-1303: --- Summary: HadoopInputFormat does not work with Scala API Key: FLINK-1303 URL: https://issues.apache.org/jira/browse/FLINK-1303 Project: Flink Issue Type

JIRA pages don't show up in Google search results

2014-12-05 Thread Kostas Tzoumas
Hey, I have noticed that when I search for an issue (e.g., Google search for FLINK-1281) the issues.apache.org/jira/... page does not typically show up (the mailing list archives do). For me it is actually more convenient to use Google search than the search in JIRA :-) Does anyone have any clue

Re: New Flink website layout and frontage

2014-12-05 Thread Ufuk Celebi
Hey Kostas, I just saw a related issue: https://issues.apache.org/jira/browse/FLINK-1089 You can close it after the SVN repo is working again and you pushed the website. On Wed, Dec 3, 2014 at 6:22 PM, Kostas Tzoumas wrote: > Thanks a lot for all the comments! I am integrating most of them and

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Hermann Gábor
+1 :))) On Fri, Dec 5, 2014 at 2:27 PM, Artem Tsikiridis wrote: > +1 :) > > On Fri, Dec 5, 2014 at 2:26 PM, Max Michels wrote: > > > +1 > > > > On Fri, Dec 5, 2014 at 2:05 PM, Till Rohrmann > > wrote: > > > > > +1 (binding) > > > > > > On Fri, Dec 5, 2014 at 12:21 PM, Paris Carbone wrote: > >

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Ufuk Celebi
+1 (binding) On Fri, Dec 5, 2014 at 2:27 PM, Artem Tsikiridis wrote: > +1 :) > > On Fri, Dec 5, 2014 at 2:26 PM, Max Michels wrote: > > > +1 > > > > On Fri, Dec 5, 2014 at 2:05 PM, Till Rohrmann > > wrote: > > > > > +1 (binding) > > > > > > On Fri, Dec 5, 2014 at 12:21 PM, Paris Carbone wrote

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Artem Tsikiridis
+1 :) On Fri, Dec 5, 2014 at 2:26 PM, Max Michels wrote: > +1 > > On Fri, Dec 5, 2014 at 2:05 PM, Till Rohrmann > wrote: > > > +1 (binding) > > > > On Fri, Dec 5, 2014 at 12:21 PM, Paris Carbone wrote: > > > > > +1 > > > > > > Paris > > > > > > > On 05 Dec 2014, at 12:11, Márton Balassi > > >

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Max Michels
+1 On Fri, Dec 5, 2014 at 2:05 PM, Till Rohrmann wrote: > +1 (binding) > > On Fri, Dec 5, 2014 at 12:21 PM, Paris Carbone wrote: > > > +1 > > > > Paris > > > > > On 05 Dec 2014, at 12:11, Márton Balassi > > wrote: > > > > > > +1 (binding) > > >> On Dec 5, 2014 12:08 PM, "Timo Walther" wrote:

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Till Rohrmann
+1 (binding) On Fri, Dec 5, 2014 at 12:21 PM, Paris Carbone wrote: > +1 > > Paris > > > On 05 Dec 2014, at 12:11, Márton Balassi > wrote: > > > > +1 (binding) > >> On Dec 5, 2014 12:08 PM, "Timo Walther" wrote: > >> > >> +1 > >> > >>> Am 05.12.2014 um 11:46 schrieb Kostas Tzoumas : > >>> > >>>

Re: Stringable Hashmap keys on POJOs

2014-12-05 Thread Paris Carbone
Great, thanks both for the recommendations! Paris > On 05 Dec 2014, at 12:56, Stephan Ewen wrote: > > If you use Flink's LongValue, StringValue, DoubleValue, you can also use > Flink's MapValue. If you subclass it (without adding code) it is very > efficient. It stores type information in the

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread sirinath
+1 (binding) -- View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/VOTE-Graduate-Flink-from-the-Incubator-tp2737p2758.html Sent from the Apache Flink (Incubator) Mailing List archive. mailing list archive at Nabble.com.

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Viktor Rosenfeld
+1 Kostas Tzoumas-2 wrote > Hi everyone, > > It seems that everyone is excited about graduating, so I am calling for a > community vote to graduate Apache Flink (incubating) to a top-level > project > (TLP). If this VOTE proceeds successfully, I will start a similar VOTE > thread in the Incubato

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Stephan Ewen
+1 (binding) :-) On Fri, Dec 5, 2014 at 12:41 PM, Stefano Bortoli wrote: > +1 > > 2014-12-05 12:36 GMT+01:00 Felix Neutatz : > > > +1 :) > > > > 2014-12-05 12:00 GMT+01:00 Alexander Alexandrov < > > alexander.s.alexand...@gmail.com>: > > > > > +1 ! > > > > > > 2014-12-05 11:57 GMT+01:00 Vasilik

Re: Stringable Hashmap keys on POJOs

2014-12-05 Thread Stephan Ewen
If you use Flink's LongValue, StringValue, DoubleValue, you can also use Flink's MapValue. If you subclass it (without adding code) it is very efficient. It stores type information in the subclass and that way handles key and value types. On Fri, Dec 5, 2014 at 11:33 AM, Robert Metzger wrote: >

Re: Samoa on Flink

2014-12-05 Thread Vasiliki Kalavri
FYI, we'll be working on this here: https://github.com/senorcarbone/samoa/tree/flink Feel free to provide input :)) Cheers, V. On 3 December 2014 at 11:56, Paris Carbone wrote: > Great news! Good to be aligned :) > > Paris > > > On 03 Dec 2014, at 10:24, Fabian Hueske wrote: > > > > FYI, Samoa

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Stefano Bortoli
+1 2014-12-05 12:36 GMT+01:00 Felix Neutatz : > +1 :) > > 2014-12-05 12:00 GMT+01:00 Alexander Alexandrov < > alexander.s.alexand...@gmail.com>: > > > +1 ! > > > > 2014-12-05 11:57 GMT+01:00 Vasiliki Kalavri : > > > > > +1 ^^ > > > > > > On 5 December 2014 at 11:54, Sebastian Schelter > wrote: >

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Szabó Péter
+1, yay! 2014-12-05 12:36 GMT+01:00 Felix Neutatz : > +1 :) > > 2014-12-05 12:00 GMT+01:00 Alexander Alexandrov < > alexander.s.alexand...@gmail.com>: > > > +1 ! > > > > 2014-12-05 11:57 GMT+01:00 Vasiliki Kalavri : > > > > > +1 ^^ > > > > > > On 5 December 2014 at 11:54, Sebastian Schelter > wr

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Felix Neutatz
+1 :) 2014-12-05 12:00 GMT+01:00 Alexander Alexandrov < alexander.s.alexand...@gmail.com>: > +1 ! > > 2014-12-05 11:57 GMT+01:00 Vasiliki Kalavri : > > > +1 ^^ > > > > On 5 December 2014 at 11:54, Sebastian Schelter wrote: > > > > > +1 (binding) > > > > > > On 12/05/2014 11:51 AM, Kostas Tzoumas

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Paris Carbone
+1 Paris > On 05 Dec 2014, at 12:11, Márton Balassi wrote: > > +1 (binding) >> On Dec 5, 2014 12:08 PM, "Timo Walther" wrote: >> >> +1 >> >>> Am 05.12.2014 um 11:46 schrieb Kostas Tzoumas : >>> >>> Hi everyone, >>> >>> It seems that everyone is excited about graduating, so I am calling for

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Márton Balassi
+1 (binding) On Dec 5, 2014 12:08 PM, "Timo Walther" wrote: > +1 > > > Am 05.12.2014 um 11:46 schrieb Kostas Tzoumas : > > > > Hi everyone, > > > > It seems that everyone is excited about graduating, so I am calling for a > > community vote to graduate Apache Flink (incubating) to a top-level > p

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Timo Walther
+1 > Am 05.12.2014 um 11:46 schrieb Kostas Tzoumas : > > Hi everyone, > > It seems that everyone is excited about graduating, so I am calling for a > community vote to graduate Apache Flink (incubating) to a top-level project > (TLP). If this VOTE proceeds successfully, I will start a similar VO

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Alexander Alexandrov
+1 ! 2014-12-05 11:57 GMT+01:00 Vasiliki Kalavri : > +1 ^^ > > On 5 December 2014 at 11:54, Sebastian Schelter wrote: > > > +1 (binding) > > > > On 12/05/2014 11:51 AM, Kostas Tzoumas wrote: > > > +1 (binding) > > > > > > On Fri, Dec 5, 2014 at 11:49 AM, Robert Metzger > > wrote: > > > > > >> +

[jira] [Created] (FLINK-1302) JDBCInputFormat does not implement NonParallelInput interface

2014-12-05 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1302: - Summary: JDBCInputFormat does not implement NonParallelInput interface Key: FLINK-1302 URL: https://issues.apache.org/jira/browse/FLINK-1302 Project: Flink

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Vasiliki Kalavri
+1 ^^ On 5 December 2014 at 11:54, Sebastian Schelter wrote: > +1 (binding) > > On 12/05/2014 11:51 AM, Kostas Tzoumas wrote: > > +1 (binding) > > > > On Fri, Dec 5, 2014 at 11:49 AM, Robert Metzger > wrote: > > > >> +1 (binding). > >> > >> Thank you for taking care of the graduation process. >

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Gyula Fora
+1 (binding) > On 05 Dec 2014, at 11:54, Sebastian Schelter wrote: > > +1 (binding) > > On 12/05/2014 11:51 AM, Kostas Tzoumas wrote: >> +1 (binding) >> >> On Fri, Dec 5, 2014 at 11:49 AM, Robert Metzger wrote: >> >>> +1 (binding). >>> >>> Thank you for taking care of the graduation process

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Aljoscha Krettek
+1 (binding indeed) On Fri, Dec 5, 2014 at 11:54 AM, Sebastian Schelter wrote: > +1 (binding) > > On 12/05/2014 11:51 AM, Kostas Tzoumas wrote: >> +1 (binding) >> >> On Fri, Dec 5, 2014 at 11:49 AM, Robert Metzger wrote: >> >>> +1 (binding). >>> >>> Thank you for taking care of the graduation pr

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Sebastian Schelter
+1 (binding) On 12/05/2014 11:51 AM, Kostas Tzoumas wrote: > +1 (binding) > > On Fri, Dec 5, 2014 at 11:49 AM, Robert Metzger wrote: > >> +1 (binding). >> >> Thank you for taking care of the graduation process. >> >> On Fri, Dec 5, 2014 at 11:47 AM, Flavio Pompermaier >> wrote: >> >>> So you h

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Fabian Hueske
+1 (binding) 2014-12-05 11:49 GMT+01:00 Robert Metzger : > +1 (binding). > > Thank you for taking care of the graduation process. > > On Fri, Dec 5, 2014 at 11:47 AM, Flavio Pompermaier > wrote: > > > So you have my +1 :) > > > > On Fri, Dec 5, 2014 at 11:46 AM, Kostas Tzoumas > > wrote: > > >

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Kostas Tzoumas
+1 (binding) On Fri, Dec 5, 2014 at 11:49 AM, Robert Metzger wrote: > +1 (binding). > > Thank you for taking care of the graduation process. > > On Fri, Dec 5, 2014 at 11:47 AM, Flavio Pompermaier > wrote: > > > So you have my +1 :) > > > > On Fri, Dec 5, 2014 at 11:46 AM, Kostas Tzoumas > > w

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Robert Metzger
+1 (binding). Thank you for taking care of the graduation process. On Fri, Dec 5, 2014 at 11:47 AM, Flavio Pompermaier wrote: > So you have my +1 :) > > On Fri, Dec 5, 2014 at 11:46 AM, Kostas Tzoumas > wrote: > > > Hi everyone, > > > > It seems that everyone is excited about graduating, so I

Re: [VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Flavio Pompermaier
So you have my +1 :) On Fri, Dec 5, 2014 at 11:46 AM, Kostas Tzoumas wrote: > Hi everyone, > > It seems that everyone is excited about graduating, so I am calling for a > community vote to graduate Apache Flink (incubating) to a top-level project > (TLP). If this VOTE proceeds successfully, I wi

[VOTE] Graduate Flink from the Incubator

2014-12-05 Thread Kostas Tzoumas
Hi everyone, It seems that everyone is excited about graduating, so I am calling for a community vote to graduate Apache Flink (incubating) to a top-level project (TLP). If this VOTE proceeds successfully, I will start a similar VOTE thread in the Incubator mailing list, and if that goes well, we

Re: Support for Total Order Partitioner ?

2014-12-05 Thread Fabian Hueske
Hi Johannes, right now the is no straight-forward way to write data in total order in Flink. The engine allows to locally sort data before it is given to a data sink. However, this is not exposed to the API right now but should be fairly easy to add (FLINK-1105). Given this feature, you can have

Re: Stringable Hashmap keys on POJOs

2014-12-05 Thread Robert Metzger
As possible workarounds, you could a) Implement your own serialization by implementing the "Value" interface. b) Use the Hadoop http://hadoop.apache.org/docs/r2.3.0/api/org/apache/hadoop/io/MapWritable.html MapWritable Class. You have to use hadoop's LongWritable and IntWritable for the types of th

Re: Stringable Hashmap keys on POJOs

2014-12-05 Thread Stephan Ewen
We are in the midst of replacing Avro in the serialization, so this should spoon be fixed properly. Until then, you could try to re-package the collection. Something like an array of map entries, or so. Would that feasible? Stephan Am 04.12.2014 21:42 schrieb "Aljoscha Krettek" : > I don't know