Re: [DISCUSS] Using Guava in Flink "core" packages

2019-03-25 Thread Thomas Weise
Hi, Thanks for the follow-up. @Aljoscha Krettek if there is consensus, can we also backport FLINK-11501 for 1.8.1? (The Guava dependency was the reason we didn't.) Thanks, Thomas On Mon, Mar 25, 2019 at 8:07 AM Stephan Ewen wrote: > I would be fine with that as well. > > Let's keep the atti

Re: [VOTE] Release 1.8.0, release candidate #4

2019-03-25 Thread jincheng sun
Hi Aljoscha, I think you are right, increase the timeout config will fix this issue. this depends on the resource of Travis. I would like share some phenomenon during my test (not the flink problem) as follows: :-) During my testing, `mvn clean verify` and `nightly end-to-end test ` both consume

be a contributor

2019-03-25 Thread 君浩
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is AlanLau. email: wayi...@gmail.com. Thanks a lot.

Re: [VOTE] Release 1.8.0, release candidate #4

2019-03-25 Thread Shaoxuan Wang
+1 (non-binding) I tested RC4 with the following items: - Maven Central Repository contains all artifacts - Built the source with Maven (ensured all source files have Apache headers), and executed built-in tests via "mvn clean verify" - Manually executed the tests in IntelliJ IDE - Verify that the

write buffer low water mark and high water mark setup

2019-03-25 Thread meijies
Hi, Community whether newLowWaterMark is greater than defaultHighWaterMark or not, the water mark settings are same.  what do you think? // Low and high water marks for flow control // hack around the impossibility (in the current netty version) to set both watermarks at // the same time: fi

Re: write buffer low water mark and high water mark setup

2019-03-25 Thread meijies
sorry ,update the format whether newLowWaterMark is greater than defaultHighWaterMark or not, the water mark settings are same.  what do you think? // Low and high water marks for flow control // hack around the impossibility (in the current netty version) to set both watermarks at // the sa

Re: be a contributor

2019-03-25 Thread Thomas Weise
Added as contributor in JIRA. Welcome! On Mon, Mar 25, 2019 at 7:44 PM 君浩 wrote: > Hi, > > I want to contribute to Apache Flink. > Would you please give me the contributor permission? > My JIRA ID is AlanLau. email: wayi...@gmail.com. > > > Thanks a lot. >

Applying for membership in development mailing list

2019-03-25 Thread 张同学
Dear, I want to be a Flink's developer, apply to join the development mailing list, please approve, thank you!

Re: Applying for membership in development mailing list

2019-03-25 Thread Zili Chen
Hi zhang, Send an e-mail to dev-subscr...@flink.apache.org, following as the reply and you would subscribe develop mailing list. If you mean applying for a contributor role in JIRA, please correct me. Best, tison. 张同学 于2019年3月26日周二 下午12:21写道: > Dear, > I want to be a Flink's developer,

[jira] [Created] (FLINK-12013) Support calc and correlate in blink

2019-03-25 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-12013: Summary: Support calc and correlate in blink Key: FLINK-12013 URL: https://issues.apache.org/jira/browse/FLINK-12013 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-12014) Flink CEP Doc missing "SkipToNextStrategy"

2019-03-25 Thread Tom Goong (JIRA)
Tom Goong created FLINK-12014: - Summary: Flink CEP Doc missing "SkipToNextStrategy" Key: FLINK-12014 URL: https://issues.apache.org/jira/browse/FLINK-12014 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-12015) TaskManagerRunnerTest is unstable

2019-03-25 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-12015: Summary: TaskManagerRunnerTest is unstable Key: FLINK-12015 URL: https://issues.apache.org/jira/browse/FLINK-12015 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-12016) Change package name in blink modules to avoid class conflict

2019-03-25 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-12016: --- Summary: Change package name in blink modules to avoid class conflict Key: FLINK-12016 URL: https://issues.apache.org/jira/browse/FLINK-12016 Project: Flink I

Re: [VOTE] Release 1.8.0, release candidate #4

2019-03-25 Thread Kurt Young
+1 (non-binding) Checked items: - checked checksums and GPG files - verified that the source archives do not contains any binaries - checked that all POM files point to the same version - build from source successfully Best, Kurt On Tue, Mar 26, 2019 at 10:57 AM Shaoxuan Wang wrote: > +1 (non

[jira] [Created] (FLINK-12001) Test AvroExternalJarProgramITCase, get `JAR file does not exist` Error.

2019-03-25 Thread sunjincheng (JIRA)
sunjincheng created FLINK-12001: --- Summary: Test AvroExternalJarProgramITCase, get `JAR file does not exist` Error. Key: FLINK-12001 URL: https://issues.apache.org/jira/browse/FLINK-12001 Project: Flink

Re: [VOTE] Release 1.8.0, release candidate #4

2019-03-25 Thread Piotr Nowojski
+1 from my side. Previously spotted performance regression seems to be gone, or mostly gone. Piotrek > On 21 Mar 2019, at 17:52, Aljoscha Krettek wrote: > > Hi everyone, > Please review and vote on the release candidate 4 for Flink 1.8.0, as follows: > [ ] +1, Approve the release > [ ] -1, Do

[jira] [Created] (FLINK-12002) Adaptive Parallelism of Job Vertex Execution

2019-03-25 Thread ryantaocer (JIRA)
ryantaocer created FLINK-12002: -- Summary: Adaptive Parallelism of Job Vertex Execution Key: FLINK-12002 URL: https://issues.apache.org/jira/browse/FLINK-12002 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-12003) Revert the config option about mapreduce.output.basename in HadoopOutputFormatBase

2019-03-25 Thread vinoyang (JIRA)
vinoyang created FLINK-12003: Summary: Revert the config option about mapreduce.output.basename in HadoopOutputFormatBase Key: FLINK-12003 URL: https://issues.apache.org/jira/browse/FLINK-12003 Project: F

Re: [DISCUSS] Using Guava in Flink "core" packages

2019-03-25 Thread Aljoscha Krettek
Hi, By now, I think it’s fine to have Guava (our shaded guava) as a dependency in flink-core. It’s a very useful library and I don’t see problems with version clashes because it’s relocated to our namespace. If no-one objects, I would just leave the dependency in as-is and conclude this discus

Contributor permission apply

2019-03-25 Thread huang?0?3
Hi Guys, I want to contribute to Apache Flink. Would you please give me the permission as a contributor? My JIRA ID is hyl thanks

[jira] [Created] (FLINK-12004) Consider about POJO using method chaining when extract TypeInformation

2019-03-25 Thread jiawei chen (JIRA)
jiawei chen created FLINK-12004: --- Summary: Consider about POJO using method chaining when extract TypeInformation Key: FLINK-12004 URL: https://issues.apache.org/jira/browse/FLINK-12004 Project: Flink

[jira] [Created] (FLINK-12006) ZooKeeperHaServicesTest is unstable

2019-03-25 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-12006: Summary: ZooKeeperHaServicesTest is unstable Key: FLINK-12006 URL: https://issues.apache.org/jira/browse/FLINK-12006 Project: Flink Issue Type: Bug

Re: [DISCUSS] Improve the flinkbot

2019-03-25 Thread shengjk1
+1 Best, Shengjk1 On 03/23/2019 12:08,vino yang wrote: +1 Best, Vino Bowen Li 于2019年3月23日周六 上午12:28写道: +1, sounds good, Jark. On Fri, Mar 22, 2019 at 1:55 AM Fabian Hueske wrote: Hi Jark, Thanks for driving the effort to integrate the Chinese website! We have the policy that new feat

[jira] [Created] (FLINK-12007) Cannot build for Scala 2.12 on Windows

2019-03-25 Thread Lodovico Giaretta (JIRA)
Lodovico Giaretta created FLINK-12007: - Summary: Cannot build for Scala 2.12 on Windows Key: FLINK-12007 URL: https://issues.apache.org/jira/browse/FLINK-12007 Project: Flink Issue Type:

[jira] [Created] (FLINK-12005) [State TTL] Event time support

2019-03-25 Thread Andrey Zagrebin (JIRA)
Andrey Zagrebin created FLINK-12005: --- Summary: [State TTL] Event time support Key: FLINK-12005 URL: https://issues.apache.org/jira/browse/FLINK-12005 Project: Flink Issue Type: New Feature

Re: Expose per partition Kafka lag metric in Flink Kafka connector

2019-03-25 Thread Becket Qin
Hi Shuyi, Thanks for bringing this issue up. Per partition lag is definitely something that should be exposed. I replied to the JIRA with some of my concerns. Do you mind keeping the discussion in the JIRA ticket so it is easier for future readers to follow the issue? Thanks, Jiangjie (Becket) Q

Re: [VOTE] Release 1.8.0, release candidate #4

2019-03-25 Thread jincheng sun
Great thanks for preparing the RC4 of Flink 1.8.0, Aljoscha! +1 (non-binding) I checked the functional things as follows(Without performance verification): 1. Checking Artifacts: 1). Download the release source code - SUCCESS 2). Check Source release flink-1.8.0-src.tgz.sha512 - SUCCES

[jira] [Created] (FLINK-12008) Support read a whole directory or multiple input data files for read apis of HadoopInputs

2019-03-25 Thread vinoyang (JIRA)
vinoyang created FLINK-12008: Summary: Support read a whole directory or multiple input data files for read apis of HadoopInputs Key: FLINK-12008 URL: https://issues.apache.org/jira/browse/FLINK-12008 Pro

Re: [jira] [Created] (FLINK-12002) Adaptive Parallelism of Job Vertex Execution

2019-03-25 Thread dachuan . qu
On 2019/03/25 08:30:00, "ryantaocer (JIRA)" wrote: > ryantaocer created FLINK-12002: > -- > > Summary: Adaptive Parallelism of Job Vertex Execution > Key: FLINK-12002 > URL: https://issues.apache.org/jira/browse/FL

[jira] [Created] (FLINK-12009) The heartbeat timeout should be larger or equal than the heartbeat timeout

2019-03-25 Thread Bruno Aranda (JIRA)
Bruno Aranda created FLINK-12009: Summary: The heartbeat timeout should be larger or equal than the heartbeat timeout Key: FLINK-12009 URL: https://issues.apache.org/jira/browse/FLINK-12009 Project: F

[jira] [Created] (FLINK-12010) Kinesis Producer problems on Alpine Linux image

2019-03-25 Thread Mario Georgiev (JIRA)
Mario Georgiev created FLINK-12010: --- Summary: Kinesis Producer problems on Alpine Linux image Key: FLINK-12010 URL: https://issues.apache.org/jira/browse/FLINK-12010 Project: Flink Issue T

[jira] [Created] (FLINK-12011) Add Dockerfile with Debian image in Flink distribution

2019-03-25 Thread Mario Georgiev (JIRA)
Mario Georgiev created FLINK-12011: --- Summary: Add Dockerfile with Debian image in Flink distribution Key: FLINK-12011 URL: https://issues.apache.org/jira/browse/FLINK-12011 Project: Flink

Re: [DISCUSS] Using Guava in Flink "core" packages

2019-03-25 Thread Stephan Ewen
I would be fine with that as well. Let's keep the attitude to maintain a slim dependency footprint, but Guava could be part of that small footprint. As long as we ensure it is our vendored (pre-shaded) version and all modules use the same version (managed version in the root pom). Best, Stephan

Re: Contributor permission apply

2019-03-25 Thread Robert Metzger
Hey, I gave you contributor permissions. On Mon, Mar 25, 2019 at 10:36 AM huang🙃 <2440239...@qq.com> wrote: > Hi Guys, > > I want to contribute to Apache Flink. > Would you please give me the permission as a contributor? > My JIRA ID is hyl > > > thanks

Re: Expose per partition Kafka lag metric in Flink Kafka connector

2019-03-25 Thread Shuyi Chen
Thanks a lot, Becket. I am sorry that I was out of the loop for the last few days due to sickness. Let’s keep the discussion continue on the JIRA. Shuyi On Mon, Mar 25, 2019 at 4:46 AM Becket Qin wrote: > Hi Shuyi, > > Thanks for bringing this issue up. Per partition lag is definitely > somethi

Re: [VOTE] Release 1.8.0, release candidate #4

2019-03-25 Thread Aljoscha Krettek
Thanks for the testing done so far! There has been quite some flakiness on Travis lately, see here: https://travis-ci.org/apache/flink/branches . I’m a bit hesitant to release in this state. Looking at the tests you can see that all of the end-to-end

[jira] [Created] (FLINK-12012) BroadcastStateITCase does not use Test Environments

2019-03-25 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-12012: Summary: BroadcastStateITCase does not use Test Environments Key: FLINK-12012 URL: https://issues.apache.org/jira/browse/FLINK-12012 Project: Flink Issue Typ

Re: BroadcastStateITCase failure caused by insufficient number of network buffers

2019-03-25 Thread Stephan Ewen
Thanks for reporting this. Here is the issue and the fix for it: https://issues.apache.org/jira/browse/FLINK-12012 On Fri, Mar 15, 2019 at 1:36 PM Yu Li wrote: > Hi All, > > As titled, I found this case failed stably in one of my testing environment > when verifying 1.8.0 release. I'm starting

[DISCUSS] Remove forceAvro() and forceKryo() from the ExecutionConfig

2019-03-25 Thread Stephan Ewen
Hi all! The ExecutionConfig has some very old settings: forceAvro() and forceKryo(), which are actually misleadingly named. They cause POJOs to use Avro or Kryo rather than the POJO serializer. I think we do not have a good case any more to use Avro for POJOs. POJOs that are also Avro types go th

Re: [REMINDER] Please add entries for newly added dependencies to NOTICE file

2019-03-25 Thread Stephan Ewen
+1 to an enhancement to the Flink bot as a simple first step. The first step could be as simple as adding a red warning message as a comment to the PR whenever a PR touches a POM file. That needs special attention for various reasons, including (but not only) license checks and file updates. On M