[jira] [Created] (FLINK-14223) Kafka010ProducerITCase>KafkaProducerTestBase.testCustomPartitioning fails on Travis

2019-09-26 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-14223: - Summary: Kafka010ProducerITCase>KafkaProducerTestBase.testCustomPartitioning fails on Travis Key: FLINK-14223 URL: https://issues.apache.org/jira/browse/FLINK-14223

[jira] [Created] (FLINK-14224) Kafka010ProducerITCase>KafkaProducerTestBase.testOneToOneAtLeastOnceCustomOperator fails on Travis

2019-09-26 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-14224: - Summary: Kafka010ProducerITCase>KafkaProducerTestBase.testOneToOneAtLeastOnceCustomOperator fails on Travis Key: FLINK-14224 URL: https://issues.apache.org/jira/browse/FLINK-14

Re: [DISCUSS] Flink Python UDF Environment and Dependency Management

2019-09-26 Thread Dian Fu
Hi Wei, Thanks a lot for bringing up this discussion. Python dependency management is very important for Python users. I have left a few comments on the design doc. Thanks, Dian > 在 2019年9月26日,下午12:23,jincheng sun 写道: > > Thanks for bring up the discussion, Wei. > Overall the design doc looks

[jira] [Created] (FLINK-14225) Travis is unable to parse of the secure environment variables

2019-09-26 Thread Gary Yao (Jira)
Gary Yao created FLINK-14225: Summary: Travis is unable to parse of the secure environment variables Key: FLINK-14225 URL: https://issues.apache.org/jira/browse/FLINK-14225 Project: Flink Issue

[jira] [Created] (FLINK-14226) Subset of nightly tests fail due to No output has been received in the last 10m0s

2019-09-26 Thread Gary Yao (Jira)
Gary Yao created FLINK-14226: Summary: Subset of nightly tests fail due to No output has been received in the last 10m0s Key: FLINK-14226 URL: https://issues.apache.org/jira/browse/FLINK-14226 Project: Fl

Re: [DISCUSS] Releasing Flink 1.9.1

2019-09-26 Thread jincheng sun
Good Job Jark, Looking forward the first RC of 1.9.1. And I would like to give you a hand at the last stage when the RC is finished.(If you need) Best, Jincheng Jark Wu 于2019年9月25日周三 下午8:04写道: > Hi all, > > I am here to update the progress of the issue that needs to be tracked: > > - FLINK-14010

[jira] [Created] (FLINK-14227) Add Razorpay to Chinese Powered By page

2019-09-26 Thread Fabian Hueske (Jira)
Fabian Hueske created FLINK-14227: - Summary: Add Razorpay to Chinese Powered By page Key: FLINK-14227 URL: https://issues.apache.org/jira/browse/FLINK-14227 Project: Flink Issue Type: Task

Re: [DISCUSS] Releasing Flink 1.9.1

2019-09-26 Thread Jark Wu
Thanks a lot for the kindly help @jincheng. That will be really helpful. Could you help to create 1.9.2 release version in JIRA when you are free? Best, Jark On Thu, 26 Sep 2019 at 17:59, jincheng sun wrote: > Good Job Jark, Looking forward the first RC of 1.9.1. And I would like to > give you

A little help on (FLINK-1725) New Partitioner for better load balancing for skewed data

2019-09-26 Thread Felipe Gutierrez
Hi, I am trying to implement a variation of the issue FLINK-1725 [1]. Basically, I want to have the frequency of the keys, and if there is skewness I will split this key into different key-groups. My first tests (word count) are working. I introduced this new operator (keyByPartial) [2][3], then

[jira] [Created] (FLINK-14228) The runtime support for Bounded[One|Multi]Input#endInput does not properly implement their semantics

2019-09-26 Thread Haibo Sun (Jira)
Haibo Sun created FLINK-14228: - Summary: The runtime support for Bounded[One|Multi]Input#endInput does not properly implement their semantics Key: FLINK-14228 URL: https://issues.apache.org/jira/browse/FLINK-14228

[jira] [Created] (FLINK-14229) Change the endinput call of the downstream operator to after the upstream operator closes

2019-09-26 Thread Haibo Sun (Jira)
Haibo Sun created FLINK-14229: - Summary: Change the endinput call of the downstream operator to after the upstream operator closes Key: FLINK-14229 URL: https://issues.apache.org/jira/browse/FLINK-14229

[jira] [Created] (FLINK-14230) Change the endinput call of the downstream operator to after the upstream operator closes

2019-09-26 Thread Haibo Sun (Jira)
Haibo Sun created FLINK-14230: - Summary: Change the endinput call of the downstream operator to after the upstream operator closes Key: FLINK-14230 URL: https://issues.apache.org/jira/browse/FLINK-14230

[jira] [Created] (FLINK-14231) Support the timers of the upstream operator with endInput properly

2019-09-26 Thread Haibo Sun (Jira)
Haibo Sun created FLINK-14231: - Summary: Support the timers of the upstream operator with endInput properly Key: FLINK-14231 URL: https://issues.apache.org/jira/browse/FLINK-14231 Project: Flink

[jira] [Created] (FLINK-14232) Support full restarts for DefaultScheduler (SchedulerNG)

2019-09-26 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-14232: --- Summary: Support full restarts for DefaultScheduler (SchedulerNG) Key: FLINK-14232 URL: https://issues.apache.org/jira/browse/FLINK-14232 Project: Flink Issue Type: Su

Re: [VOTE] FLIP-66: Support Time Attribute in SQL DDL (#2)

2019-09-26 Thread Kurt Young
+1 Best, Kurt On Thu, Sep 26, 2019 at 11:52 AM Jark Wu wrote: > Hi all, > > I would like to start the vote for FLIP-66 [1], which is discussed and > reached a consensus in the discussion thread[2]. > > The vote will be open for at least 72 hours. I'll try to close it after > Oct. 01 08:00 UTC,

[jira] [Created] (FLINK-14233) All task state changes should be notified to SchedulingStrategy (SchedulerNG)

2019-09-26 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-14233: --- Summary: All task state changes should be notified to SchedulingStrategy (SchedulerNG) Key: FLINK-14233 URL: https://issues.apache.org/jira/browse/FLINK-14233 Project: Flink

[jira] [Created] (FLINK-14234) All partition consumable events should be notified to SchedulingStrategy (SchedulerNG)

2019-09-26 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-14234: --- Summary: All partition consumable events should be notified to SchedulingStrategy (SchedulerNG) Key: FLINK-14234 URL: https://issues.apache.org/jira/browse/FLINK-14234 Project:

Re: REST API / JarRunHandler: More flexibility for launching jobs

2019-09-26 Thread Aljoscha Krettek
Hi, Regarding the original proposal: I don’t think spawning another process inside the JarHandler.runJar() is the way to go here. Looking at the bigger picture, the proposal would get us to roughly this situation: 1. Spawn Kubernetes containers (JobManager and TaskManagers) 2. User does a REST

[jira] [Created] (FLINK-14235) Kafka010ProducerITCase>KafkaProducerTestBase.testOneToOneAtLeastOnceCustomOperator fails on travis

2019-09-26 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-14235: -- Summary: Kafka010ProducerITCase>KafkaProducerTestBase.testOneToOneAtLeastOnceCustomOperator fails on travis Key: FLINK-14235 URL: https://issues.apache.org/jira/browse/FLINK-

[jira] [Created] (FLINK-14236) Make LazyFromSourcesSchedulingStrategy do lazy scheduling only based on partition state

2019-09-26 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-14236: --- Summary: Make LazyFromSourcesSchedulingStrategy do lazy scheduling only based on partition state Key: FLINK-14236 URL: https://issues.apache.org/jira/browse/FLINK-14236 Project

[jira] [Created] (FLINK-14237) No need to rename shipped Flink jar

2019-09-26 Thread Zili Chen (Jira)
Zili Chen created FLINK-14237: - Summary: No need to rename shipped Flink jar Key: FLINK-14237 URL: https://issues.apache.org/jira/browse/FLINK-14237 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-14238) ParquetPojoInputFormat logging bug

2019-09-26 Thread John Lonergan (Jira)
John Lonergan created FLINK-14238: - Summary: ParquetPojoInputFormat logging bug Key: FLINK-14238 URL: https://issues.apache.org/jira/browse/FLINK-14238 Project: Flink Issue Type: Improvement

Re: REST API / JarRunHandler: More flexibility for launching jobs

2019-09-26 Thread Thomas Weise
Hi Aljoscha, Thanks for taking a look! Multiple options to approach the submission part for the Beam use case are discussed in [1]. I'm actually now working on a different approach that creates a Flink jar at build time. To the point of whether UserProgram.main() should be called in JobManager

[DISCUSS] Remove uncompleted YARNHighAvailabilityService

2019-09-26 Thread Zili Chen
Hi devs, Noticed that there are several stale & uncompleted high-availability services implementations, I start this thread in order to see whether or not we can remove them for a clean codebase work on the ongoing high-availability refactor effort[1]. Below are all of classes I noticed. - YarnH

[DISCUSS] FLIP-75: Flink Web UI Improvement Proposal

2019-09-26 Thread Yadong Xie
Hi all Flink Web UI is the main platform for most users to monitor their jobs and clusters. We have reconstructed Flink web in 1.9.0 version, but there are still some shortcomings. This discussion thread aims to provide a better experience for Flink UI users. Here is the design doc I drafted: h

Re: [VOTE] FLIP-66: Support Time Attribute in SQL DDL (#2)

2019-09-26 Thread Danny Chan
+1, thanks for the effort, Jack ! Best, Danny Chan 在 2019年9月26日 +0800 AM11:52,Jark Wu ,写道: > Hi all, > > I would like to start the vote for FLIP-66 [1], which is discussed and > reached a consensus in the discussion thread[2]. > > The vote will be open for at least 72 hours. I'll try to close it a

[jira] [Created] (FLINK-14239) Emitting the max watermark in StreamSource#run may cause it to arrive the downstream early

2019-09-26 Thread Haibo Sun (Jira)
Haibo Sun created FLINK-14239: - Summary: Emitting the max watermark in StreamSource#run may cause it to arrive the downstream early Key: FLINK-14239 URL: https://issues.apache.org/jira/browse/FLINK-14239

Re: [VOTE] FLIP-66: Support Time Attribute in SQL DDL (#2)

2019-09-26 Thread JingsongLee
+1 non-binding (nit: Add a road map?) Best, Jingsong Lee -- From:Kurt Young Send Time:2019年9月26日(星期四) 20:44 To:dev Subject:Re: [VOTE] FLIP-66: Support Time Attribute in SQL DDL (#2) +1 Best, Kurt On Thu, Sep 26, 2019 at 11:52

[jira] [Created] (FLINK-14240) The configuration added via TableConfig#configuration should be added to GlobalJobParameters for the legacy planner

2019-09-26 Thread Dian Fu (Jira)
Dian Fu created FLINK-14240: --- Summary: The configuration added via TableConfig#configuration should be added to GlobalJobParameters for the legacy planner Key: FLINK-14240 URL: https://issues.apache.org/jira/browse/FLIN

Re: [DISCUSS] FLIP-75: Flink Web UI Improvement Proposal

2019-09-26 Thread Paul Lam
Hi Yadong, Thanks a lot for summing up the Web UI efforts. I have a minor suggestion: can we provide a collapse button for the task names in job graph visualization? For some complex jobs, especially SQL jobs, the task names are quite long which makes the job graph hard to read. Best, Paul L

Re: [VOTE] FLIP-57: Rework FunctionCatalog

2019-09-26 Thread Rui Li
I'm not sure how much benefit #1 can bring us. If users just want to try out temporary functions, they can create temporary system functions which don't require a catalog/DB. IIUC, the main reason why we allow temporary catalog function is to let users override permanent catalog functions. Therefor

[jira] [Created] (FLINK-14241) Add ARM installation step for flink e2e container test

2019-09-26 Thread wangxiyuan (Jira)
wangxiyuan created FLINK-14241: -- Summary: Add ARM installation step for flink e2e container test Key: FLINK-14241 URL: https://issues.apache.org/jira/browse/FLINK-14241 Project: Flink Issue Type

Re: 订阅邮件

2019-09-26 Thread Dian Fu
To subscribe to the mailing list, you need send email to the following address dev-subscr...@flink.apache.org , user-subscr...@flink.apache.org and user-zh-subscr...@flink.apache.org

Re: [DISCUSS] Expose multiple level clients

2019-09-26 Thread Zili Chen
Thanks for your reply Kostas! Sorry for replying late. The most unclear point about multi-layered client is about where Executor is. I will also separate the corresponding reply into FLIP-73 and FLIP-74 dedicated thread. Best, tison. Kostas Kloudas 于2019年9月25日周三 下午9:31写道: > Hi Tison, > > I sh

Re: [DISCUSS] FLIP-74: Flink JobClient API

2019-09-26 Thread Zili Chen
Thanks for your replies Kostas & Aljoscha! Below are replies point by point. 1. For DETACHED mode, what I said there is about the DETACHED mode in client side. There are two configurations overload the item DETACHED[1]. In client side, it means whether or not client.submitJob is blocking to job

Re: [DISCUSS] FLIP-75: Flink Web UI Improvement Proposal

2019-09-26 Thread Yadong Xie
Hi Paul Thanks for your suggestion. I think it is easy to implement, could you create a JIRA for me? Paul Lam 于2019年9月27日周五 上午11:11写道: > Hi Yadong, > > Thanks a lot for summing up the Web UI efforts. > > I have a minor suggestion: can we provide a collapse button for the task > names in job grap