Limitations on grouped ReduceFunction

2016-02-02 Thread Greg Hogan
If a user modifies keyed fields of a grouped reduce during a combine then the reduce will receive incorrect groupings. For example, a useless modification to word count: public WC reduce(WC in1, WC in2) { return new WC(in1.word + " " + in2.word, in1.count + in2.count); } I don't see an ef

Re: Release Flink 1.0.0

2016-02-02 Thread Robert Metzger
Hi, I think that getting the stop signal in would be very nice. I would like to postpone the feature freeze till end of this week and create the first RC on Monday. There are many open pull requests with fixes that need to go in (stop signal, rocksdb state backend, interface annotations, streamin

Re: [DISCUSS] Release 0.10.2

2016-02-02 Thread Robert Metzger
Thank you for taking care of this. +1 I'd like to include this in to the 0.10.2 release: https://github.com/apache/flink/pull/1576 On Tue, Feb 2, 2016 at 1:57 PM, Ufuk Celebi wrote: > > > On 02 Feb 2016, at 11:43, Stephan Ewen wrote: > > > > +1 > > > > @Ufuk: Would you be the release manager f

Re: Memory manager behavior in iterative jobs

2016-02-02 Thread Gábor Gévay
I've created a JIRA: https://issues.apache.org/jira/browse/FLINK-3322 Best, Gábor 2016-01-30 14:36 GMT+01:00 Fabian Hueske : > Hi Gabor and Marton, > > the taskmanager.memory.preallocate switch basically replaces Flink's > streaming mode. > The current stream runtime code does not operate on ma

[jira] [Created] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-02-02 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-3322: -- Summary: MemoryManager creates too much GC pressure with iterative jobs Key: FLINK-3322 URL: https://issues.apache.org/jira/browse/FLINK-3322 Project: Flink Iss

[jira] [Created] (FLINK-3321) TupleSerializerBase.getLength should know the length when all fields know it

2016-02-02 Thread Gabor Gevay (JIRA)
Gabor Gevay created FLINK-3321: -- Summary: TupleSerializerBase.getLength should know the length when all fields know it Key: FLINK-3321 URL: https://issues.apache.org/jira/browse/FLINK-3321 Project: Flink

[jira] [Created] (FLINK-3320) Add not operator to CEP's pattern API

2016-02-02 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-3320: Summary: Add not operator to CEP's pattern API Key: FLINK-3320 URL: https://issues.apache.org/jira/browse/FLINK-3320 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-3319) Add or operator to CEP's pattern API

2016-02-02 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-3319: Summary: Add or operator to CEP's pattern API Key: FLINK-3319 URL: https://issues.apache.org/jira/browse/FLINK-3319 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-3318) Add support for quantifiers to CEP's pattern API

2016-02-02 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-3318: Summary: Add support for quantifiers to CEP's pattern API Key: FLINK-3318 URL: https://issues.apache.org/jira/browse/FLINK-3318 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-3317) Add timeout handler to CEP operator

2016-02-02 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-3317: Summary: Add timeout handler to CEP operator Key: FLINK-3317 URL: https://issues.apache.org/jira/browse/FLINK-3317 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Release 0.10.2

2016-02-02 Thread Ufuk Celebi
> On 02 Feb 2016, at 11:43, Stephan Ewen wrote: > > +1 > > @Ufuk: Would you be the release manager for that one? Yes. Thanks for the responses so far. I will go ahead and prepare a release candidate soon. If you have any minor fixes, which you would like to have in the release, please repo

[jira] [Created] (FLINK-3316) Links to Gelly and FlinkML libraries on main site broken

2016-02-02 Thread Theodore Vasiloudis (JIRA)
Theodore Vasiloudis created FLINK-3316: -- Summary: Links to Gelly and FlinkML libraries on main site broken Key: FLINK-3316 URL: https://issues.apache.org/jira/browse/FLINK-3316 Project: Flink

[jira] [Created] (FLINK-3315) Fix Slot Sharing in Streaming API

2016-02-02 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-3315: --- Summary: Fix Slot Sharing in Streaming API Key: FLINK-3315 URL: https://issues.apache.org/jira/browse/FLINK-3315 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-3314) Early cancel calls can cause Tasks to not cancel properly

2016-02-02 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-3314: --- Summary: Early cancel calls can cause Tasks to not cancel properly Key: FLINK-3314 URL: https://issues.apache.org/jira/browse/FLINK-3314 Project: Flink Issue T

[jira] [Created] (FLINK-3313) Kafka08ITCase.testOneSourceMultiplePartitions fails with EOFException

2016-02-02 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-3313: - Summary: Kafka08ITCase.testOneSourceMultiplePartitions fails with EOFException Key: FLINK-3313 URL: https://issues.apache.org/jira/browse/FLINK-3313 Project: Flink

Re: [DISCUSS] Release 0.10.2

2016-02-02 Thread Stephan Ewen
+1 @Ufuk: Would you be the release manager for that one? On Tue, Feb 2, 2016 at 11:07 AM, Till Rohrmann wrote: > +1, since user were asking for it. > > On Tue, Feb 2, 2016 at 10:50 AM, Fabian Hueske wrote: > > > +1 > > > > 2016-02-02 10:44 GMT+01:00 Maximilian Michels : > > > > > Hi Ufuk, > >

Re: [DISCUSS] Release 0.10.2

2016-02-02 Thread Till Rohrmann
+1, since user were asking for it. On Tue, Feb 2, 2016 at 10:50 AM, Fabian Hueske wrote: > +1 > > 2016-02-02 10:44 GMT+01:00 Maximilian Michels : > > > Hi Ufuk, > > > > +1 If the fixes are straightforward such that we don't need to test > > extensively, I'm all for it! Releasing doesn't take muc

Re: [DISCUSS] Release 0.10.2

2016-02-02 Thread Fabian Hueske
+1 2016-02-02 10:44 GMT+01:00 Maximilian Michels : > Hi Ufuk, > > +1 If the fixes are straightforward such that we don't need to test > extensively, I'm all for it! Releasing doesn't take much time then. > > On Mon, Feb 1, 2016 at 9:57 PM, Nick Dimiduk wrote: > > +1 for a 0.10.2 maintenance rele

Re: [DISCUSS] Release 0.10.2

2016-02-02 Thread Maximilian Michels
Hi Ufuk, +1 If the fixes are straightforward such that we don't need to test extensively, I'm all for it! Releasing doesn't take much time then. On Mon, Feb 1, 2016 at 9:57 PM, Nick Dimiduk wrote: > +1 for a 0.10.2 maintenance release. > > On Monday, February 1, 2016, Ufuk Celebi wrote: > >> He