[jira] [Created] (FLINK-11971) The classpath is missing the `flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar` JAR during the end-to-end test.

2019-03-19 Thread sunjincheng (JIRA)
sunjincheng created FLINK-11971: --- Summary: The classpath is missing the `flink-shaded-hadoop2-uber-2.8.3-1.8.0.jar` JAR during the end-to-end test. Key: FLINK-11971 URL:

[jira] [Created] (FLINK-11970) TableEnvironment#registerFunction should overwrite if the same name function existed.

2019-03-19 Thread Jeff Zhang (JIRA)
Jeff Zhang created FLINK-11970: -- Summary: TableEnvironment#registerFunction should overwrite if the same name function existed. Key: FLINK-11970 URL: https://issues.apache.org/jira/browse/FLINK-11970

Re: [PROGRESS UPDATE] [DISCUSS] Flink-Hive Integration and Catalogs

2019-03-19 Thread Shaoxuan Wang
Hi Bowen, Thanks for driving this. I am CCing this email/survey to user-zh@ flink.apache.org as well. I heard there are lots of interests on Flink-Hive from the field. One of the biggest requests the hive users are raised is "the support of out-of-date hive version". A large amount of users are

Re: [DISCUSS] Create a Flink ecosystem website

2019-03-19 Thread Becket Qin
I agree. We can start with english-only and see how it goes. The comments and descriptions can always be multi-lingual but that is up to the package owners. On Tue, Mar 19, 2019 at 6:07 PM Robert Metzger wrote: > Thanks. > > Do we actually want this page to be multi-language? > > I propose to

[jira] [Created] (FLINK-11969) Add end2end stream sql test for unbounded operators

2019-03-19 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-11969: --- Summary: Add end2end stream sql test for unbounded operators Key: FLINK-11969 URL: https://issues.apache.org/jira/browse/FLINK-11969 Project: Flink Issue

[jira] [Created] (FLINK-11968) Fix runtime SingleElementIterator.iterator and remove table.SingleElementIterator

2019-03-19 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-11968: Summary: Fix runtime SingleElementIterator.iterator and remove table.SingleElementIterator Key: FLINK-11968 URL: https://issues.apache.org/jira/browse/FLINK-11968

Re: Backoff strategies for async IO functions?

2019-03-19 Thread Rong Rong
Thanks for the feedback @Till. Yes I agree as well that opening up or changing the AsyncWaitOperator doesn't seem to be a necessity here. I think making "AsyncFunctionBase", making the current AsyncFunction as a extension of it with a some of the default behaviors like Shuyi suggested seems to be

Re: [DISCUSS] Introduction of a Table API Java Expression DSL

2019-03-19 Thread Rong Rong
Thanks for sharing the initiative of improving Java side Table expression DSL. I agree as in the doc stated that Java DSL was always a "3rd class citizen" and we've run into many hand holding scenarios with our Flink developers trying to get the Stringify syntax working. Overall I am a +1 on

[PROGRESS UPDATE] [DISCUSS] Flink-Hive Integration and Catalogs

2019-03-19 Thread Bowen Li
Hi Flink users and devs, We want to get your feedbacks on integrating Flink with Hive. Background: In Flink Forward in Beijing last December, the community announced to initiate efforts on integrating Flink and Hive. On Feb 21 Seattle Flink Meetup

Re: [REMINDER] Please add entries for newly added dependencies to NOTICE file

2019-03-19 Thread Ufuk Celebi
There are definitely license checking tools around that can generate NOTICE files etc. I don't have the details, but Robert should have some input here. I don't know whether they would fit our setup and how we would integrate them or whether INFRA can get them for is. Note that simple things can

Re: [REMINDER] Please add entries for newly added dependencies to NOTICE file

2019-03-19 Thread Chesnay Schepler
Realistically you can't automatically infer from changes to any pom /whether /and /what /we have to change in the notice files. Doing this on the XML level requires a view over the entire project to detect dependency changes in parent modules / dependency management and packaging changes in

Re: Backoff strategies for async IO functions?

2019-03-19 Thread Till Rohrmann
Sorry for joining the discussion so late. I agree that we could add some more syntactic sugar for handling failure cases. Looking at the existing interfaces, I think it should be fairly easy to create an abstract class AsyncFunctionWithRetry which extends AsyncFunction and encapsulates the retry

Re: [DISCUSS] Add column operations in Table API

2019-03-19 Thread jincheng sun
Thanks for your feedback and comments! @Hequn Cheng I had open the JIRA FLINK-11967 , And welcome left any suggestions in JIRA. Best, Jincheng Hequn Cheng 于2019年3月16日周六 下午4:03写道: > Hi Jincheng, > > Thanks a lot for the discussion. > The

[jira] [Created] (FLINK-11967) Add Column Operators/Operations

2019-03-19 Thread sunjincheng (JIRA)
sunjincheng created FLINK-11967: --- Summary: Add Column Operators/Operations Key: FLINK-11967 URL: https://issues.apache.org/jira/browse/FLINK-11967 Project: Flink Issue Type: Sub-task

[VOTE] Release 1.8.0, release candidate #3

2019-03-19 Thread Aljoscha Krettek
Hi everyone, Please review and vote on the release candidate 3 for Flink 1.8.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], * the

[CANCEL][VOTE] Release 1.8.0, release candidate #2

2019-03-19 Thread Aljoscha Krettek
Hi, I’m hereby canceling the vote for RC2 of Flink 1.8.0 because of various issues mentioned in the vote thread. Best, Aljoscha > On 19. Mar 2019, at 11:48, Stephan Ewen wrote: > > @Gordon The tupleByKey and benchmarkCount are most likely not caused by > serializers, more probably by a

Re: [VOTE] Release 1.8.0, release candidate #2

2019-03-19 Thread Stephan Ewen
@Gordon The tupleByKey and benchmarkCount are most likely not caused by serializers, more probably by a network stack change. I would look at the AvroSerializer issue independent of those benchmarks. On Tue, Mar 19, 2019 at 8:23 AM Piotr Nowojski wrote: > Hi all, > > Regarding the regression

Re: [DISCUSS] Create a Flink ecosystem website

2019-03-19 Thread Robert Metzger
Thanks. Do we actually want this page to be multi-language? I propose to make the website english-only, but maybe consider allowing comments in different languages. If we would make it multi-language, then we might have problems with people submitting packages in non-english languages. On

[jira] [Created] (FLINK-11966) Add support for generating optimized logical plan for simple query(project, filter, values and union all)

2019-03-19 Thread godfrey he (JIRA)
godfrey he created FLINK-11966: -- Summary: Add support for generating optimized logical plan for simple query(project, filter, values and union all) Key: FLINK-11966 URL:

[jira] [Created] (FLINK-11965) Provide a REST API for flink to submit plain SQL flink jobs.

2019-03-19 Thread chenminghua (JIRA)
chenminghua created FLINK-11965: --- Summary: Provide a REST API for flink to submit plain SQL flink jobs. Key: FLINK-11965 URL: https://issues.apache.org/jira/browse/FLINK-11965 Project: Flink

[jira] [Created] (FLINK-11964) Avoid hash collision of partition and bucket in HybridHashTable

2019-03-19 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-11964: Summary: Avoid hash collision of partition and bucket in HybridHashTable Key: FLINK-11964 URL: https://issues.apache.org/jira/browse/FLINK-11964 Project: Flink

Re: [REMINDER] Please add entries for newly added dependencies to NOTICE file

2019-03-19 Thread Aljoscha Krettek
That sounds good! Are there any tools for this, though? > On 19. Mar 2019, at 07:15, Ufuk Celebi wrote: > > Hey Aljoscha, > > thanks for bringing this up. I think that we should either integrate > checks for this into our CI/CD environment (using existing tools) or > add a conditional check

[jira] [Created] (FLINK-11963) Add time-based cleanup mechanism in history server

2019-03-19 Thread xymaqingxiang (JIRA)
xymaqingxiang created FLINK-11963: - Summary: Add time-based cleanup mechanism in history server Key: FLINK-11963 URL: https://issues.apache.org/jira/browse/FLINK-11963 Project: Flink Issue

Re: [VOTE] Release 1.8.0, release candidate #2

2019-03-19 Thread Piotr Nowojski
Hi all, Regarding the regression from mid February looks like happened in this commit range 3d39cb0..a9eb6d7 I'm investigating the regression from January 29th. It happened in the commit range 35fa2b7..81acd0a (I think I managed to reproduce the results locally for it) Piotrek wt., 19 mar 2019

[jira] [Created] (FLINK-11962) Huge Flink Checkpoint Size When Using "Group By" Clause With Table SQL

2019-03-19 Thread Ruoyu Dai (JIRA)
Ruoyu Dai created FLINK-11962: - Summary: Huge Flink Checkpoint Size When Using "Group By" Clause With Table SQL Key: FLINK-11962 URL: https://issues.apache.org/jira/browse/FLINK-11962 Project: Flink

Re: [VOTE] Release 1.8.0, release candidate #2

2019-03-19 Thread jincheng sun
Hi Chesnay, thanks for sharing your long term plan about `flink-shaded-hadoop`! Got your points. I also think we need the JIRA for that, at the follows right time. Best Regards, Jincheng Chesnay Schepler 于2019年3月18日周一 下午8:13写道: > Long term plan _is_ to move flink-shaded-hadoop to flink-shaded,

Re: [VOTE] Release 1.8.0, release candidate #2

2019-03-19 Thread jincheng sun
Hi Alijoscha, I have merged the following issues found in RC1 and RC2 into the release-1.8 branch. - Add `frocksdbjni` dependency in NOTICE - FLINK-11950 - Improve end-to-end test - FLINK-11892 - Deprecated Window API - FLINK-11918 Currently, I am performing functional testing of YARN cluster

Re: [REMINDER] Please add entries for newly added dependencies to NOTICE file

2019-03-19 Thread Ufuk Celebi
Hey Aljoscha, thanks for bringing this up. I think that we should either integrate checks for this into our CI/CD environment (using existing tools) or add a conditional check for this into flink-bot in case a pom.xml was modified. Otherwise it will be easy to forget in the future. – Ufuk On

[jira] [Created] (FLINK-11961) Clear up and refactor the code generation of scalar functions and operators

2019-03-19 Thread Jark Wu (JIRA)
Jark Wu created FLINK-11961: --- Summary: Clear up and refactor the code generation of scalar functions and operators Key: FLINK-11961 URL: https://issues.apache.org/jira/browse/FLINK-11961 Project: Flink