[DISCUSS] Update UpsertStreamTableSink and RetractStreamTableSink to new type system

2020-02-02 Thread Zhenghua Gao
Hi all, FLINK-12254[1] [2] updated TableSink and related interfaces to new type system which allows connectors use the new type system based on DataTypes. But FLINK-12911 port UpsertStreamTableSink and RetractStreamTableSink to flink-api-java-bridge and returns TypeInformation of the requested

Re: connection timeout during shuffle initialization

2020-02-02 Thread Zhijiang
Sorry for touching this issue late, just come back from Chinese Spring Festival. Actually we have not encountered this problem in production before. The problem of connection timeout was mainly caused by netty server starting delay on upstream side (big jar loading might cause as Piotr

[jira] [Created] (FLINK-15858) Unable to use HiveCatalog and kafka together

2020-02-02 Thread Jeff Zhang (Jira)
Jeff Zhang created FLINK-15858: -- Summary: Unable to use HiveCatalog and kafka together Key: FLINK-15858 URL: https://issues.apache.org/jira/browse/FLINK-15858 Project: Flink Issue Type: Bug

[DISCUSS] Support User-Defined Table Function in PyFlink

2020-02-02 Thread Xingbo Huang
Hi all, The scalar Python UDF has already been supported in coming release of 1.10, we’d like to introduce Python UDTF now. FLIP-58[1] has already introduced some content about Python UDTF. However, the implementation details are still not touched. I have drafted a design doc[2]. It includes the

Re: [DISCUSS] Include flink-ml-api and flink-ml-lib in opt

2020-02-02 Thread Hequn Cheng
Hi everyone, Thanks for the feedback. As there are no objections, I've opened a JIRA issue(FLINK-15847[1]) to address this issue. The implementation details can be discussed in the issue or in the following PR. Best, Hequn [1] https://issues.apache.org/jira/browse/FLINK-15847 On Wed, Jan 8,

[jira] [Created] (FLINK-15857) Support --help for the kubernetes-session script

2020-02-02 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-15857: Summary: Support --help for the kubernetes-session script Key: FLINK-15857 URL: https://issues.apache.org/jira/browse/FLINK-15857 Project: Flink Issue Type:

Re: [VOTE] Release 1.10.0, release candidate #1

2020-02-02 Thread Thomas Weise
The above issue was resolved by adding RemoteEnvironmentConfigUtils.setJarURLsToConfig(new String[] {JAR_PATH}, config); It might be helpful to provide migration instructions to users as part of this release. On Fri, Jan 31, 2020 at 9:20 PM Thomas Weise wrote: > As part of testing the RC, I

Re: REST Monitoring Savepoint failed

2020-02-02 Thread Ramya Ramamurthy
Thanks Till Rohrmann for the update. So even if we upgrade to the newer version of Flink, we have to manually rescale. Is that correct? that is to stop the job and start again with the desired parallelism. Thanks. On Fri, Jan 31, 2020 at 6:42 PM Till Rohrmann wrote: > Thanks for providing us

[jira] [Created] (FLINK-15856) Various Kubernetes command client improvements

2020-02-02 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-15856: Summary: Various Kubernetes command client improvements Key: FLINK-15856 URL: https://issues.apache.org/jira/browse/FLINK-15856 Project: Flink Issue Type:

[jira] [Created] (FLINK-15854) Use the new type inference for hive udtf

2020-02-02 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-15854: Summary: Use the new type inference for hive udtf Key: FLINK-15854 URL: https://issues.apache.org/jira/browse/FLINK-15854 Project: Flink Issue Type:

[jira] [Created] (FLINK-15855) Use the new type inference for hive udaf

2020-02-02 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-15855: Summary: Use the new type inference for hive udaf Key: FLINK-15855 URL: https://issues.apache.org/jira/browse/FLINK-15855 Project: Flink Issue Type:

[jira] [Created] (FLINK-15853) Use the new type inference for hive udf

2020-02-02 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-15853: Summary: Use the new type inference for hive udf Key: FLINK-15853 URL: https://issues.apache.org/jira/browse/FLINK-15853 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-15852) Job is submitted to the wrong session cluster

2020-02-02 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-15852: Summary: Job is submitted to the wrong session cluster Key: FLINK-15852 URL: https://issues.apache.org/jira/browse/FLINK-15852 Project: Flink Issue Type:

[jira] [Created] (FLINK-15851) JDK 8 and 11 CI build pipeline for Stateful Functions with Azure Pipelines

2020-02-02 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-15851: --- Summary: JDK 8 and 11 CI build pipeline for Stateful Functions with Azure Pipelines Key: FLINK-15851 URL: https://issues.apache.org/jira/browse/FLINK-15851

[jira] [Created] (FLINK-15850) Setup CI for Stateful Functions with Azure Pipelines

2020-02-02 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-15850: --- Summary: Setup CI for Stateful Functions with Azure Pipelines Key: FLINK-15850 URL: https://issues.apache.org/jira/browse/FLINK-15850 Project: Flink

[jira] [Created] (FLINK-15849) Update SQL-CLIENT document from type to data-type

2020-02-02 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-15849: Summary: Update SQL-CLIENT document from type to data-type Key: FLINK-15849 URL: https://issues.apache.org/jira/browse/FLINK-15849 Project: Flink Issue

Re: [ANNOUNCE] Yu Li became a Flink committer

2020-02-02 Thread Zhu Zhu
Congratulations Yu! Thanks, Zhu Zhu Zhijiang 于2020年2月3日周一 上午10:28写道: > Congratulations Yu! > > Best, > Zhijiang > > > -- > From:lining jing > Send Time:2020 Feb. 3 (Mon.) 09:52 > To:dev > Subject:Re: [ANNOUNCE] Yu Li became a

[jira] [Created] (FLINK-15848) Support both fixed allocator and dynamic allocator in flink

2020-02-02 Thread liupengcheng (Jira)
liupengcheng created FLINK-15848: Summary: Support both fixed allocator and dynamic allocator in flink Key: FLINK-15848 URL: https://issues.apache.org/jira/browse/FLINK-15848 Project: Flink

Re: [ANNOUNCE] Yu Li became a Flink committer

2020-02-02 Thread Zhijiang
Congratulations Yu! Best, Zhijiang -- From:lining jing Send Time:2020 Feb. 3 (Mon.) 09:52 To:dev Subject:Re: [ANNOUNCE] Yu Li became a Flink committer Congratulations Yu, well deserved. Jared Li 于2020年2月1日周六 下午12:10写道: > nice

Re: [ANNOUNCE] Yu Li became a Flink committer

2020-02-02 Thread lining jing
Congratulations Yu, well deserved. Jared Li 于2020年2月1日周六 下午12:10写道: > nice job > > Congxian Qiu 于2020年2月1日周六 上午11:28写道: > > > Congratulations Yu, well deserved. > > Best, > > Congxian > > > > > > Yun Gao 于2020年1月31日周五 下午4:15写道: > > > > >Congratulations Yu! > > > > > > Best, > >

[jira] [Created] (FLINK-15847) Include flink-ml-api and flink-ml-lib in opt

2020-02-02 Thread Hequn Cheng (Jira)
Hequn Cheng created FLINK-15847: --- Summary: Include flink-ml-api and flink-ml-lib in opt Key: FLINK-15847 URL: https://issues.apache.org/jira/browse/FLINK-15847 Project: Flink Issue Type:

Re: [VOTE] Release 1.10.0, release candidate #1

2020-02-02 Thread Xintong Song
Hi Steven, I think the changes you proposed in FLINK-15846 might cause problem. Commented on JIRA ticket and -1 for including this in the new RC. Thank you~ Xintong Song On Mon, Feb 3, 2020 at 6:17 AM Steven Wu wrote: > I filed a small issue regarding readability for memory configurations.

Re: [VOTE] Release 1.10.0, release candidate #1

2020-02-02 Thread Steven Wu
I filed a small issue regarding readability for memory configurations. It is not a blocking issue. I already attached a PR. https://issues.apache.org/jira/browse/FLINK-15846 On Fri, Jan 31, 2020 at 9:20 PM Thomas Weise wrote: > As part of testing the RC, I run into the following issue with a

[jira] [Created] (FLINK-15846) TaskExecutorResourceUtils should return config strs with mb as unit for better readability

2020-02-02 Thread Steven Zhen Wu (Jira)
Steven Zhen Wu created FLINK-15846: -- Summary: TaskExecutorResourceUtils should return config strs with mb as unit for better readability Key: FLINK-15846 URL: https://issues.apache.org/jira/browse/FLINK-15846

[jira] [Created] (FLINK-15845) Add java-based StreamingFileSink test using s3

2020-02-02 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-15845: --- Summary: Add java-based StreamingFileSink test using s3 Key: FLINK-15845 URL: https://issues.apache.org/jira/browse/FLINK-15845 Project: Flink Issue Type:

[jira] [Created] (FLINK-15844) Removal of JobWithJars.buildUserCodeClassLoader method without Configuration breaks backwards compatibility

2020-02-02 Thread Jira
Ismaël Mejía created FLINK-15844: Summary: Removal of JobWithJars.buildUserCodeClassLoader method without Configuration breaks backwards compatibility Key: FLINK-15844 URL:

[ANNOUNCE] Weekly Community Update 2020/05

2020-02-02 Thread Konstantin Knauf
Dear community, comparably quiet times on the dev@ mailing list, so I will keep it brief and mostly share release related updates today. Flink Development == * [releases] Apache Flink 1.9.2 was released on Thursday. Check out the release blog post [1] for details. [2] * [releases]

[jira] [Created] (FLINK-15843) Do not violently kill TaskManagers

2020-02-02 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-15843: Summary: Do not violently kill TaskManagers Key: FLINK-15843 URL: https://issues.apache.org/jira/browse/FLINK-15843 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-15842) Building Stateful Functions with JDK 11 fails due to outdated Spotbugs version

2020-02-02 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-15842: --- Summary: Building Stateful Functions with JDK 11 fails due to outdated Spotbugs version Key: FLINK-15842 URL: https://issues.apache.org/jira/browse/FLINK-15842