Re: Compression of network traffic

Hi, if you really want to add compression on the data path, I would encourage you to choose something as lightweight as possible. 10 GBit Ethernet is becoming pretty much commodity these days in the server space and it is not easy to saturate such a link even without compression. Snappy is n

Re: [DISCUSS] Bump the minimum Java requirement to Java 7 for Flink

Hi, I would also be in favor of dropping Java 6 support. In my opinion, Java 7 is the standard these days. All of the three big Hadoop distributions also already consider Java 6 as deprecated for their latest releases [1,2,3]. Best regards, Daniel [1] http://www.cloudera.com/content/c

Re: Planning Flink release 0.7-incubating

Hi, I like Fabian's idea. Is there a wiki page (or something similar) where we can collect the proposed JIRAs? Best regards, Daniel Am 24.09.2014 23:03, schrieb Fabian Hueske: I agree, a hard feature stop deadline might not be the best practice. How about the following procedure: We de

Re: [VOTE] Release Apache Flink 0.6.1 (incubating) (RC0)

Hi, a minor thing: There is a typo in CONTRIBUTORS file. It should be contributors, not contributers. Moreover, the list of contributors is not consistent with the list provided in the release announcement. Bests, Daniel On 16.09.2014 15:49, Stephan Ewen wrote: > +1 > > Verified > - Sourc

Re: Replacing JobManager with Scala implementation

Stephan, I agree that the questions “akka” and “Scala” should be treated separately. Unfortunately, this is not how the discussion has been led so far. Instead, the new akka RPC service is used to motivate the necessity for Scala in the runtime core. I still don’t see that necessity. I tried

Re: [VOTE] Using Scala to reimplement the JobManager and TaskManager

Hi, sorry, but I think the way this vote is set up is already biased towards the author’s desired outcome. Two out of the three possible options effectively lead to the switch to Scala. Moreover, the -1 option requires the voter to explain his/her decision, the +1 option does not. Best regar

Re: Replacing JobManager with Scala implementation

little bit down. Bests, Till On Sun, Aug 31, 2014 at 11:35 AM, Daniel Warneke < warn...@apache.org> wrote: Hi, will akka just be used for RPC or are there any plans to expand the actor-based model to further parts of the runtime system? If so, could you please point me to the discus

Re: Replacing JobManager with Scala implementation

Hi, will akka just be used for RPC or are there any plans to expand the actor-based model to further parts of the runtime system? If so, could you please point me to the discussion thread? Spontaneously, I would say that adding a hard dependency on Scala just for the sake of having a hip RPC

[jira] [Created] (FLINK-1006) Add support for MapR file system

Daniel Warneke created FLINK-1006: - Summary: Add support for MapR file system Key: FLINK-1006 URL: https://issues.apache.org/jira/browse/FLINK-1006 Project: Flink Issue Type: Improvement

How to compile Flink against vendor-specific Hadoop libs?

Hi, I would like to compile Flink against a specific Hadoop distribution. What is the best way to do this? I saw there is already a special build profile defined for Cloudera. Would it make sense to introduce such a build profile for Hortonworks and MapR as well? Bests, Daniel

Future of the current runtime?

Hi guys, now that there are ongoing efforts to port Flink to Tez, what is the future of the current runtime? In particular, there are quite a few Jira tickets related to bugs or improvements of the current runtime. Some call for major changes and require considerable work. Does it still make sens

[jira] [Commented] (FLINK-939) Distribute required JAR files with seperate service

[ https://issues.apache.org/jira/browse/FLINK-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034416#comment-14034416 ] Daniel Warneke commented on FLINK-939: -- I think I could work on that matter

[jira] [Commented] (FLINK-937) Change the YARN Client to allocate all cluster resources, if no argument given

[ https://issues.apache.org/jira/browse/FLINK-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034389#comment-14034389 ] Daniel Warneke commented on FLINK-937: -- As far as I know, queues are rathe

[jira] [Commented] (FLINK-939) Distribute required JAR files with seperate service

[ https://issues.apache.org/jira/browse/FLINK-939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14034275#comment-14034275 ] Daniel Warneke commented on FLINK-939: -- Hi Stephan, I like your idea and will s

[jira] [Commented] (FLINK-937) Change the YARN Client to allocate all cluster resources, if no argument given

[ https://issues.apache.org/jira/browse/FLINK-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033072#comment-14033072 ] Daniel Warneke commented on FLINK-937: -- To be honest, I am not a big fa

[jira] [Commented] (FLINK-937) Change the YARN Client to allocate all cluster resources, if no argument given

[ https://issues.apache.org/jira/browse/FLINK-937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031992#comment-14031992 ] Daniel Warneke commented on FLINK-937: -- Quick question: What is the current def