Re: [DISCUSS] FLIP-2 Extending Window Function Metadata

2016-07-19 Thread Aljoscha Krettek
You mean keep the Collector? I don't like that one because it has the close() method that should never be called by the user. We can keep it, though, because all the other user function interfaces also expose it to the user. On Tue, 19 Jul 2016 at 15:22 Stephan Ewen wrote: > I would actually ma

Re: DataStream.partitionCustom() - define parallelism

2016-07-19 Thread Jaromir Vanek
Aljoscha Krettek-2 wrote > Hi, > it should be possible to set the parallelism on the actual downstream > operation. The partitioning operation is just an intermediate. > > Cheers, > Aljoscha Are you sure about that? The mentioned discussion

RE: Flink Table & SQL doesn't work in very simple example

2016-07-19 Thread Radu Tudoran
Hi, I am not sure that this problem was solved. I am using the last pom to compile the table API. I was trying to run a simple program. ArrayList> input = new ArrayList>(); input.add(new Tuple3(3L,"test",1)); input.add(new Tuple3(5L,"test2",2));

Re: [DISCUSS] FLIP-2 Extending Window Function Metadata

2016-07-19 Thread Stephan Ewen
I would actually make the output a separate parameter as well. Pretty much like the old variant, only replacing the "Window" parameter by the context (which contains everything about the window). It could also be called "WindowInvocationContext" or so. The current variant looks too Hadoop to me ;-

[jira] [Created] (FLINK-4233) Simplify leader election / leader session ID assignment

2016-07-19 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4233: --- Summary: Simplify leader election / leader session ID assignment Key: FLINK-4233 URL: https://issues.apache.org/jira/browse/FLINK-4233 Project: Flink Issue Typ

Re: Apache Flink <=> Apache Ignite integration

2016-07-19 Thread Anton Vinogradov
Hi All, I'll review it in the near future. On Tue, Jul 19, 2016 at 11:53 AM, Denis Magda wrote: > Hi Saikat, > > Thanks for this contribution. > > *Anton V.*, please review the following contribution. > > — > Denis > > On Jul 16, 2016, at 11:09 PM, Saikat Maitra > wrote: > > Hi > > I have raise

Re: [DISCUSS] Allowed Lateness in Flink

2016-07-19 Thread Aljoscha Krettek
Hi, these new features should make it into the 1.2 release. We are already working on releasing 1.1 so it won't make it for that one. unfortunately. Cheers, Aljoscha On Mon, 18 Jul 2016 at 23:19 Chen Qin wrote: > BTW, do you have rough timeline in term of roll out it to production? > > Thanks,

Re: DataStream.partitionCustom() - define parallelism

2016-07-19 Thread Aljoscha Krettek
Hi, it should be possible to set the parallelism on the actual downstream operation. The partitioning operation is just an intermediate. Cheers, Aljoscha On Mon, 18 Jul 2016 at 20:20 vanekjar wrote: > Hi all, > > I've got one question considering custom partitioning in DataStream API. Is > it p

Re: [DISCUSS] Commit tagging

2016-07-19 Thread Stephan Ewen
How about we use the components that we also defined for the shepherds as tags? On Mon, Jul 18, 2016 at 3:24 PM, Till Rohrmann wrote: > Then +1 :-) > > On Fri, Jul 15, 2016 at 7:07 PM, Ufuk Celebi wrote: > > > It was intended as Till said... a list of preferred tags. > > > > On Fri, Jul 15, 201

Re: [DISCUSS] FLIP 1 - Flink Improvement Proposal

2016-07-19 Thread Maximilian Michels
Great initiative! I think mailing list discussions can be very hard to follow in retrospective. The Kafka community does a great job in summing up the discussions on individual wiki pages. We should do that as well! On Tue, Jul 12, 2016 at 9:55 PM, Aljoscha Krettek wrote: > I'll make the changes

Re: Apache Flink <=> Apache Ignite integration

2016-07-19 Thread Denis Magda
Hi Saikat, Thanks for this contribution. Anton V., please review the following contribution. — Denis > On Jul 16, 2016, at 11:09 PM, Saikat Maitra wrote: > > Hi > > I have raised a PR for the following scope. > > As a Flink source => run a continuous query against one or multiple > caches >

[jira] [Created] (FLINK-4232) Flink executable does not return correct pid

2016-07-19 Thread David Moravek (JIRA)
David Moravek created FLINK-4232: Summary: Flink executable does not return correct pid Key: FLINK-4232 URL: https://issues.apache.org/jira/browse/FLINK-4232 Project: Flink Issue Type: Bug