[jira] [Created] (FLINK-1770) Rename the variable 'contentAdressable' to 'contentAddressable'

2015-03-23 Thread Sibao Hong (JIRA)
Sibao Hong created FLINK-1770: - Summary: Rename the variable 'contentAdressable' to 'contentAddressable' Key: FLINK-1770 URL: https://issues.apache.org/jira/browse/FLINK-1770 Project: Flink

Re: Improve the documentation of the Flink Architecture and internals

2015-03-23 Thread Ufuk Celebi
I couldn't have a look at it earlier, because the Wiki was down. Very nice overview of the flow of things. I like the text and pictures a lot. I will add content about: 1) The way that we do the network transfers with Netty 2) A more detailed message flow for pipelined vs. blocking results.

[jira] [Created] (FLINK-1772) Chain of split/select does not work

2015-03-23 Thread JIRA
Gábor Hermann created FLINK-1772: Summary: Chain of split/select does not work Key: FLINK-1772 URL: https://issues.apache.org/jira/browse/FLINK-1772 Project: Flink Issue Type: Bug

Re: [DISCUSS] Distributed TPC-H DataGenerator for flink-contrib

2015-03-23 Thread Henry Saputra
Robert, Just curious if you did try to send email to tpc.org to ask about fair usage of example data? - Henry On Sat, Feb 28, 2015 at 12:07 PM, Robert Metzger rmetz...@apache.org wrote: I tried twice writing them but I didn't receive an answer. But given that Apache Calcite is also using

Compilation error after guava shading

2015-03-23 Thread Vasiliki Kalavri
Hi squirrels, I have a maven project that only depends on flink-gelly, but after the guava shading change I get a compilation error in one of the classes that is using the primitives library: package com.google.common does not exist. Is this to be expected? Do I need to add anything to my pom?

Re: Compilation error after guava shading

2015-03-23 Thread Robert Metzger
Hi, you have to add guava as a dependency to your project. With the shading, users won't see Flink depending on Guava anymore. This allows them (users) to use any guava version they want. On Mon, Mar 23, 2015 at 5:11 PM, Vasiliki Kalavri vasilikikala...@gmail.com wrote: Hi squirrels, I

[jira] [Created] (FLINK-1775) BarrierBuffers don't correctly handle end of stream events

2015-03-23 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-1775: - Summary: BarrierBuffers don't correctly handle end of stream events Key: FLINK-1775 URL: https://issues.apache.org/jira/browse/FLINK-1775 Project: Flink Issue

Re: Queries regarding RDFs with Flink

2015-03-23 Thread Flavio Pompermaier
Thanks Vasiliki, when I'll find the time I'll try to make a quick prototype using the pointers you suggested! Thanks for the support, Flavio On Mon, Mar 23, 2015 at 10:31 AM, Vasiliki Kalavri vasilikikala...@gmail.com wrote: Hi Flavio, I'm not familiar with JSON-LD, but as far as I

Re: Tests for the Steaming classes

2015-03-23 Thread Márton Balassi
Thanks for looking into this, Stephan. +1 for the JIRAs. On Mon, Mar 23, 2015 at 10:55 AM, Ufuk Celebi u...@apache.org wrote: On 23 Mar 2015, at 10:44, Stephan Ewen se...@apache.org wrote: Hi everyone! With the streaming stuff getting heavier exposure, I think it needs a few more

Re: Improve the documentation of the Flink Architecture and internals

2015-03-23 Thread Maximilian Michels
Very insightful post. Thank you! On Sat, Mar 21, 2015 at 5:30 PM, Till Rohrmann trohrm...@apache.org wrote: I wrote some internal documentation for Akka and the distributed communication [1]. Cheers, Till [1] https://cwiki.apache.org/confluence/display/FLINK/Akka+and+Actors On Fri, Mar

Re: Tests for the Steaming classes

2015-03-23 Thread Gyula Fóra
+1 for lots of streaming tests On Mon, Mar 23, 2015 at 11:23 AM, Márton Balassi balassi.mar...@gmail.com wrote: Thanks for looking into this, Stephan. +1 for the JIRAs. On Mon, Mar 23, 2015 at 10:55 AM, Ufuk Celebi u...@apache.org wrote: On 23 Mar 2015, at 10:44, Stephan Ewen

[jira] [Created] (FLINK-1774) Remove the redundant code in try{} block

2015-03-23 Thread Sibao Hong (JIRA)
Sibao Hong created FLINK-1774: - Summary: Remove the redundant code in try{} block Key: FLINK-1774 URL: https://issues.apache.org/jira/browse/FLINK-1774 Project: Flink Issue Type: Improvement

Re: Compilation error after guava shading

2015-03-23 Thread Vasiliki Kalavri
Awesome, thanks Robert! On Mar 23, 2015 5:15 PM, Robert Metzger rmetz...@apache.org wrote: Hi, you have to add guava as a dependency to your project. With the shading, users won't see Flink depending on Guava anymore. This allows them (users) to use any guava version they want. On Mon,

Re: Tests for the Steaming classes

2015-03-23 Thread Henry Saputra
+1 for more tests and plus more documentation both internal and javadoc. Some stuff like memory usafe and data flows are bit different from batch which have not been documented much. Looks like more will be coming to Flink to check out streaming solution in Flink as alternative to others. -

Re: [DISCUSS] Distributed TPC-H DataGenerator for flink-contrib

2015-03-23 Thread Robert Metzger
I've send a message to admin-i...@tpc.org and never got an answer. (on http://www.tpc.org/trademarks/ they list ad...@tpc.org as the right address, but sending a message to admin@ redirects to admin-info@.) My code doesn't contain any TPC data or code. Its a Java re-implementation of the C data

Re: [DISCUSS] Distributed TPC-H DataGenerator for flink-contrib

2015-03-23 Thread Robert Metzger
Great, thanks for taking some time looking at this! If nobody objects in the next 48 hours, I'll open a PR for the TPC-H data generator. On Mon, Mar 23, 2015 at 7:34 PM, Henry Saputra henry.sapu...@gmail.com wrote: Yeah, I believe it should be ok since we do not actually package any code bits

Re: [DISCUSS] Distributed TPC-H DataGenerator for flink-contrib

2015-03-23 Thread Fabian Hueske
+1 On Mar 23, 2015 7:39 PM, Robert Metzger rmetz...@apache.org wrote: Great, thanks for taking some time looking at this! If nobody objects in the next 48 hours, I'll open a PR for the TPC-H data generator. On Mon, Mar 23, 2015 at 7:34 PM, Henry Saputra henry.sapu...@gmail.com wrote:

Re: Tests for the Steaming classes

2015-03-23 Thread Stephan Ewen
I am currently travelling, I'll open the JIRAs as soon as I find a bit of time to sit down... On Mon, Mar 23, 2015 at 5:20 PM, Henry Saputra henry.sapu...@gmail.com wrote: +1 for more tests and plus more documentation both internal and javadoc. Some stuff like memory usafe and data flows are