Task manager memory configuration with intermediate results

2015-02-02 Thread Ufuk Celebi
Currently, the memory configuration of a task manager encompasses two things: 1) NETWORK buffers: Fixed amount of memory for the network buffer pool (default: 2048 buffers, each 32 KB => 64 MB) 2) OPERATOR buffers: A configurable fraction of the available heap memory (default 0.7) for the memor

[jira] [Created] (FLINK-1470) JobManagerITCase fails on Travis

2015-02-02 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-1470: Summary: JobManagerITCase fails on Travis Key: FLINK-1470 URL: https://issues.apache.org/jira/browse/FLINK-1470 Project: Flink Issue Type: Bug Comp

Re: YARN ITCases fail, master broken?

2015-02-02 Thread Robert Metzger
is the error reproducible ? There is certainly still an open issue with the YARN tests. I'll look into this later this week. Please let me know if this issue occurs frequently on Travis (I haven't seen it yet in my tests) On Mon, Feb 2, 2015 at 6:29 PM, Ufuk Celebi wrote: > What's the state of

Re: YARN ITCases fail, master broken?

2015-02-02 Thread Ufuk Celebi
What's the state of this? I got an error, which I didn't see before: https://s3.amazonaws.com/archive.travis-ci.org/jobs/49194479/log.txt On 27 Jan 2015, at 13:35, Fabian Hueske wrote: > Robert, thanks for fixing the MacOS build! > > Building on my Ubuntu VM is still failing though. Will send

[jira] [Created] (FLINK-1469) Initialize network environment at task manager startup

2015-02-02 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-1469: -- Summary: Initialize network environment at task manager startup Key: FLINK-1469 URL: https://issues.apache.org/jira/browse/FLINK-1469 Project: Flink Issue Type:

[jira] [Created] (FLINK-1468) Config parse failure fails task manager startup w/o an error message

2015-02-02 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-1468: -- Summary: Config parse failure fails task manager startup w/o an error message Key: FLINK-1468 URL: https://issues.apache.org/jira/browse/FLINK-1468 Project: Flink

Re: ReduceGroup fails on server

2015-02-02 Thread Aljoscha Krettek
Hi, we have some bug fixes queued up. So a 0.8.1 bug fix release should be expected in the upcoming weeks. Cheers, Aljoscha On Mon, Feb 2, 2015 at 12:48 PM, Arvid Heise wrote: > OK, patch indeed worked for my workflow. Thank you very much. > > Any idea when this patch will be in a non-snapshot?

Re: ReduceGroup fails on server

2015-02-02 Thread Arvid Heise
OK, patch indeed worked for my workflow. Thank you very much. Any idea when this patch will be in a non-snapshot? Best, Arvid On Fri, Jan 30, 2015 at 6:04 PM, Arvid Heise wrote: > Sorry building the 0.9 branch took longer than expected. I will follow > that up on Monday. > > Alternatively I w

Re: Kicking off the Machine Learning Library

2015-02-02 Thread mkaul
Ok makes sense to me! :) So we will find something else for the student to do. Would it then be possible for you to maybe very briefly describe your strategy of how you will make this work? Like slides for a design diagram maybe? It might be useful for us to see how the internals would look like a