Re: [DISCUSS] Releasing Flink 1.3.3 with only critical fixes

2018-03-08 Thread Tzu-Li (Gordon) Tai
+1 to have a minimal 1.3.3 release with the listed issues. I can also help manage this release. It seems like we don't have any objections with Aljoscha's proposal so far. Will wait a little bit more for any other opinions, and try to open a RC by the end of the week. Cheers, Gordon

Change build-target to a specific folder

2018-03-08 Thread mingleizhang
Hi, Anyway, the line of cd build-target below confused me for a while at the first time since there is not a folder called build-target. So I would suggest change this stuff to a more reasonable representation for the beginner to flink. What do you think of that ? Like cd

Re: StreamSQL queriable state

2018-03-08 Thread Renjie Liu
Hi, Stefano: I agree with Febian that it's not a good idea to expose internal state as queryable to users for the reasons listed by Fabian. As you pointed out with current QueryableStateSink's design, duplicating internal state is inefficient. But this is limited by the api of table sink since

Using the BucketingSink with Flink 1.4.0

2018-03-08 Thread lrao
I want to use the BucketingSink in the hadoop-free Flink system (i.e. 1.4.0) but currently I am kind of blocked because of its dependency on the Hadoop file system. 1. Is this something that's going to be fixed in the next version of Flink? 2. In the meantime, to unblock myself, what is the

Re: [DISCUSS] Flink security improvements

2018-03-08 Thread Shuyi Chen
Ping :) On Wed, Feb 21, 2018 at 7:16 PM, Shuyi Chen wrote: > Hi Eron, thanks a lot for taking a look at the proposal, the comments are > very useful. I've updated the document to address your concerns. Could you > please help take another look, and suggest what the next step

Re: [DISCUSS] Releasing Flink 1.3.3 with only critical fixes

2018-03-08 Thread Fabian Hueske
+1 2018-03-08 10:20 GMT-08:00 Ted Yu : > +1 to Aljoscha's proposal. >

Re: [DISCUSS] Releasing Flink 1.5.0

2018-03-08 Thread Pavel Ciorba
Approximately when is the release of Flink 1.5 planned? Best, 2018-03-01 11:20 GMT+02:00 Till Rohrmann : > Thanks for bringing this issue up Shashank. I think Aljoscha is taking a > look at the issue. It looks like a serious bug which we should definitely > fix. What I've

Re: [DISCUSS] Releasing Flink 1.3.3 with only critical fixes

2018-03-08 Thread Ted Yu
+1 to Aljoscha's proposal.

Re: [DISCUSS] Releasing Flink 1.3.3 with only critical fixes

2018-03-08 Thread Bowen Li
+1 On Thu, Mar 8, 2018 at 7:36 AM, Aljoscha Krettek wrote: > Hi, > > We fixed a critical bug in the ZooKeeper checkpoint store but never > released a 1.3.x version of Flink with the fix. I'm proposing to release > 1.3.3 with only fixes for this issue so that users can

Re: StreamSQL queriable state

2018-03-08 Thread Fabian Hueske
I don't think it is a good idea to expose the internal state of a query as queryable state for the following reasons: 1. plan generation: the streaming programs and operators are created based on the optimized plan. A user cannot know which operators a query will run on. Naming the queryable

[jira] [Created] (FLINK-8902) Re-scaling job sporadically fails with KeeperException

2018-03-08 Thread Gary Yao (JIRA)
Gary Yao created FLINK-8902: --- Summary: Re-scaling job sporadically fails with KeeperException Key: FLINK-8902 URL: https://issues.apache.org/jira/browse/FLINK-8902 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8901) YARN application name for Flink (per-job) submissions claims it is using only 1 TaskManager

2018-03-08 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-8901: -- Summary: YARN application name for Flink (per-job) submissions claims it is using only 1 TaskManager Key: FLINK-8901 URL: https://issues.apache.org/jira/browse/FLINK-8901

[jira] [Created] (FLINK-8900) YARN FinalStatus always shows as KILLED with Flip-6

2018-03-08 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-8900: -- Summary: YARN FinalStatus always shows as KILLED with Flip-6 Key: FLINK-8900 URL: https://issues.apache.org/jira/browse/FLINK-8900 Project: Flink Issue Type:

[jira] [Created] (FLINK-8899) Submitting YARN job with FLIP-6 may lead to ApplicationAttemptNotFoundException

2018-03-08 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-8899: -- Summary: Submitting YARN job with FLIP-6 may lead to ApplicationAttemptNotFoundException Key: FLINK-8899 URL: https://issues.apache.org/jira/browse/FLINK-8899 Project:

[jira] [Created] (FLINK-8898) Materialize time indicators in conditions of LogicalFilter

2018-03-08 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-8898: -- Summary: Materialize time indicators in conditions of LogicalFilter Key: FLINK-8898 URL: https://issues.apache.org/jira/browse/FLINK-8898 Project: Flink Issue

[jira] [Created] (FLINK-8897) Rowtime materialization causes "mismatched type" AssertionError

2018-03-08 Thread Xingcan Cui (JIRA)
Xingcan Cui created FLINK-8897: -- Summary: Rowtime materialization causes "mismatched type" AssertionError Key: FLINK-8897 URL: https://issues.apache.org/jira/browse/FLINK-8897 Project: Flink

[DISCUSS] Releasing Flink 1.3.3 with only critical fixes

2018-03-08 Thread Aljoscha Krettek
Hi, We fixed a critical bug in the ZooKeeper checkpoint store but never released a 1.3.x version of Flink with the fix. I'm proposing to release 1.3.3 with only fixes for this issue so that users can benefit from the fix and we have the least amount of overhead in release verification as

RE: StreamSQL queriable state

2018-03-08 Thread Stefano Bortoli
Hi Timo, Renjie, Well, the idea is that stream processing could become a complex pipeline of multiple queries and sinking data on a separate sink for monitoring does not seem efficient. In fact, pulling state value on demand would allow to monitor the values of different parts of the stream

[jira] [Created] (FLINK-8896) Kafka08Fetcher trying to look up topic "n/a" on partiton "-1"

2018-03-08 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-8896: -- Summary: Kafka08Fetcher trying to look up topic "n/a" on partiton "-1" Key: FLINK-8896 URL: https://issues.apache.org/jira/browse/FLINK-8896 Project: Flink

Re: [VOTE] Release 1.4.2, release candidate #2

2018-03-08 Thread Stephan Ewen
@Thomas: The test failure on MacOS seems to be related to an update to high sierra that introduced AFS for system partitions. For some reason AFS seems is not strictly POSIX compliant when it comes to error codes (possible a bug/mixup in the error codes). A "file not found" situation returns a

Re:Re: Incorrect Rest URL

2018-03-08 Thread mingleizhang
I can get the value with /joboverview under the 1.3.2. Thanks ~ At 2018-03-08 16:29:34, "Gary Yao" wrote: >Hi Minglei, > >What Flink version are you using? The path was only recently changed to >/jobs/overview [1], and you linked to the documentation of the

Re:Re: Incorrect Rest URL

2018-03-08 Thread mingleizhang
Hello, Gary. Sorry, I forget tell you the flink version i used. The version i have been using is 1.3.2. I didnt watch the url that under 1.3.2. By the way, I will take a look on the new bug. Best Minglei At 2018-03-08 16:29:34, "Gary Yao" wrote: >Hi

Re: Incorrect Rest URL

2018-03-08 Thread Gary Yao
Hi Minglei, What Flink version are you using? The path was only recently changed to /jobs/overview [1], and you linked to the documentation of the snapshot version. While I tested the feature, I discovered another bug in 1.5, though [2]. Best, Gary [1]

[jira] [Created] (FLINK-8895) Job failed when one kafka broker shutdown

2018-03-08 Thread godfrey johnson (JIRA)
godfrey johnson created FLINK-8895: -- Summary: Job failed when one kafka broker shutdown Key: FLINK-8895 URL: https://issues.apache.org/jira/browse/FLINK-8895 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8894) CurrentJobIdsHandler fails to serialize response

2018-03-08 Thread Gary Yao (JIRA)
Gary Yao created FLINK-8894: --- Summary: CurrentJobIdsHandler fails to serialize response Key: FLINK-8894 URL: https://issues.apache.org/jira/browse/FLINK-8894 Project: Flink Issue Type: Bug