[jira] [Created] (FLINK-17335) JDBCUpsertTableSink Upsert mysql exception No value specified for parameter 1

2020-04-22 Thread yutao (Jira)
yutao created FLINK-17335: - Summary: JDBCUpsertTableSink Upsert mysql exception No value specified for parameter 1 Key: FLINK-17335 URL: https://issues.apache.org/jira/browse/FLINK-17335 Project: Flink

[jira] [Created] (FLINK-17334) Flink does not support UDFs with primitive return types

2020-04-22 Thread xin.ruan (Jira)
xin.ruan created FLINK-17334: Summary: Flink does not support UDFs with primitive return types Key: FLINK-17334 URL: https://issues.apache.org/jira/browse/FLINK-17334 Project: Flink Issue Type:

[jira] [Created] (FLINK-17333) add doc for "create ddl"

2020-04-22 Thread Bowen Li (Jira)
Bowen Li created FLINK-17333: Summary: add doc for "create ddl" Key: FLINK-17333 URL: https://issues.apache.org/jira/browse/FLINK-17333 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-17332) Fix restart policy not equals to Never for native task manager pods

2020-04-22 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-17332: Summary: Fix restart policy not equals to Never for native task manager pods Key: FLINK-17332 URL: https://issues.apache.org/jira/browse/FLINK-17332 Project: Flink

[jira] [Created] (FLINK-17331) Add NettyMessageContent interface for all the class which could be write to NettyMessage

2020-04-22 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-17331: -- Summary: Add NettyMessageContent interface for all the class which could be write to NettyMessage Key: FLINK-17331 URL: https://issues.apache.org/jira/browse/FLINK-17331

[jira] [Created] (FLINK-17330) Avoid scheduling deadlocks caused by intra-logical-region ALL-to-ALL blocking edges

2020-04-22 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-17330: --- Summary: Avoid scheduling deadlocks caused by intra-logical-region ALL-to-ALL blocking edges Key: FLINK-17330 URL: https://issues.apache.org/jira/browse/FLINK-17330 Project:

[jira] [Created] (FLINK-17329) Quickstarts Scala nightly e2e test failed on travis

2020-04-22 Thread Yu Li (Jira)
Yu Li created FLINK-17329: - Summary: Quickstarts Scala nightly e2e test failed on travis Key: FLINK-17329 URL: https://issues.apache.org/jira/browse/FLINK-17329 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-17328) Expose network metric for job vertex in rest api

2020-04-22 Thread lining (Jira)
lining created FLINK-17328: -- Summary: Expose network metric for job vertex in rest api Key: FLINK-17328 URL: https://issues.apache.org/jira/browse/FLINK-17328 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-22 Thread Xintong Song
+1 for supporting Hadoop 3. I'm not familiar with the shading efforts, thus no comment on dropping the flink-shaded-hadoop. Correct me if I'm wrong. Despite currently the default Hadoop version for compiling is 2.4.1 in Flink, I think this does not mean Flink should support only Hadoop 2.4+. So

Re: [DISCUSS] Releasing Flink 1.10.1

2020-04-22 Thread Yu Li
FLINK-16662 has been fixed just now (thanks @LionelZ and @Klou for the efforts!) and I will prepare the first RC soon, JFYI. Best Regards, Yu On Thu, 16 Apr 2020 at 23:29, Yu Li wrote: > Thanks for the efforts and feedbacks all. > > Now the only left blocker is the below one (newly escalated

[jira] [Created] (FLINK-17327) Kafka unavailability could cause Flink TM shutdown

2020-04-22 Thread Jun Qin (Jira)
Jun Qin created FLINK-17327: --- Summary: Kafka unavailability could cause Flink TM shutdown Key: FLINK-17327 URL: https://issues.apache.org/jira/browse/FLINK-17327 Project: Flink Issue Type: Bug

Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-22 Thread Chesnay Schepler
We can create additional releases independent of Flink, but they will have to go through a formal release process in any case. On 22/04/2020 14:55, Ismaël Mejía wrote: Hello, I wanted to discuss about a subject that was shortly mentioned during the docker unification thread (and in some other

Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-22 Thread Leonard Xu
+1 (non-binding) - checked/verified signatures and hashes - checked the release note - checked that there are no missing artifacts in staging area - built from source sing scala 2.11 and using Scala 2.12 succeeded - ran a couple of end-to-end tests locally and succeeded - went through all commits

Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-22 Thread Tang Jinxin
maybe could try someway like foreachpartition in foreachrdd,which will not together to driver take too extra consumption. xiaoxingstack 邮箱:xiaoxingst...@gmail.com 签名由 网易邮箱大师 定制 On 04/22/2020 20:55, Ismaël Mejía wrote: Hello, I wanted to discuss about a subject that was shortly mentioned during

Re: [DISCUSS] Intermediary releases of the flink-docker images

2020-04-22 Thread Tang Jinxin
I am confused why docker upstream can influence inner process seriously,may be the jvm thread?In my opinion,docker is just a child space of os. xiaoxingstack 邮箱:xiaoxingst...@gmail.com 签名由 网易邮箱大师 定制 On 04/22/2020 20:55, Ismaël Mejía wrote: Hello, I wanted to discuss about a subject that was

[DISCUSS] Intermediary releases of the flink-docker images

2020-04-22 Thread Ismaël Mejía
Hello, I wanted to discuss about a subject that was shortly mentioned during the docker unification thread (and in some other PR) that is the release of docker images independent of major Flink releases. In the past when the docker images were maintained outside of the Apache repository we

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-22 Thread Chesnay Schepler
1) Likely not, as this again introduces a hard-dependency on flink-shaded-hadoop. 2) Indeed; this will be something the user/cloud providers have to deal with now. 3) Yes. As a small note, we can still keep the hadoop-2 version of flink-shaded around for existing users. What I suggested was

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-22 Thread Yang Wang
Thanks Robert for starting this significant discussion. Since hadoop3 has been released for long time and many companies have already put it in production. No matter you are using flink-shaded-hadoop2 or not, currently Flink could already run in yarn3(not sure about HDFS). Since the yarn api is

[jira] [Created] (FLINK-17326) flink sql gateway should support persist meta information such as SessionContext in order to recover

2020-04-22 Thread jackylau (Jira)
jackylau created FLINK-17326: Summary: flink sql gateway should support persist meta information such as SessionContext in order to recover Key: FLINK-17326 URL: https://issues.apache.org/jira/browse/FLINK-17326

[jira] [Created] (FLINK-17325) Integrate orc to file system connector

2020-04-22 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17325: Summary: Integrate orc to file system connector Key: FLINK-17325 URL: https://issues.apache.org/jira/browse/FLINK-17325 Project: Flink Issue Type: Sub-task

Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-22 Thread Dian Fu
+1 (non-binding) - verified the checksum and signature - checked the release note - checked that there are no new dependencies introduced since 1.9.2 which may affect the license (only bump kafka from 0.10.2.1 to 0.10.2.2 which doesn't affect the license) - checked that there are no missing

[jira] [Created] (FLINK-17324) Move the image we use to generate the flink-docker image into flink-docker

2020-04-22 Thread Jira
Ismaël Mejía created FLINK-17324: Summary: Move the image we use to generate the flink-docker image into flink-docker Key: FLINK-17324 URL: https://issues.apache.org/jira/browse/FLINK-17324 Project:

[jira] [Created] (FLINK-17323) ChannelStateReader rejects requests about unkown channels (Unaligned checkpoints)

2020-04-22 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-17323: - Summary: ChannelStateReader rejects requests about unkown channels (Unaligned checkpoints) Key: FLINK-17323 URL: https://issues.apache.org/jira/browse/FLINK-17323

[jira] [Created] (FLINK-17322) Enable latency tracker would corrupt the broadcast state

2020-04-22 Thread Yun Tang (Jira)
Yun Tang created FLINK-17322: Summary: Enable latency tracker would corrupt the broadcast state Key: FLINK-17322 URL: https://issues.apache.org/jira/browse/FLINK-17322 Project: Flink Issue Type:

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-22 Thread Sivaprasanna
I agree with Aljoscha. Otherwise I can see a lot of tickets getting created saying the application is not running on YARN. Cheers, Sivaprasanna On Wed, Apr 22, 2020 at 1:00 PM Aljoscha Krettek wrote: > +1 to getting rid of flink-shaded-hadoop. But we need to document how > people can now get a

[DISCUSS] FLIP-36 - Support Interactive Programming in Flink Table API

2020-04-22 Thread Xuannan Su
Hi folks, I'd like to start the discussion about FLIP-36 Support Interactive Programming in Flink Table API https://cwiki.apache.org/confluence/display/FLINK/FLIP-36%3A+Support+Interactive+Programming+in+Flink The FLIP proposes to add support for interactive programming in Flink Table API.

[jira] [Created] (FLINK-17321) Support for casting collection types.

2020-04-22 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17321: Summary: Support for casting collection types. Key: FLINK-17321 URL: https://issues.apache.org/jira/browse/FLINK-17321 Project: Flink Issue Type:

[jira] [Created] (FLINK-17320) Java8 lambda expression cannot be serialized.

2020-04-22 Thread Jiayi Liao (Jira)
Jiayi Liao created FLINK-17320: -- Summary: Java8 lambda expression cannot be serialized. Key: FLINK-17320 URL: https://issues.apache.org/jira/browse/FLINK-17320 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-17319) Fix broken link to walkthrough guide

2020-04-22 Thread Patrick Wiener (Jira)
Patrick Wiener created FLINK-17319: -- Summary: Fix broken link to walkthrough guide Key: FLINK-17319 URL: https://issues.apache.org/jira/browse/FLINK-17319 Project: Flink Issue Type: Bug

Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-22 Thread Fabian Paul
+1 (non-binding) - Verified signature - Built from source (Java8) - Run custom jobs on Kubernetes Regards, Fabian > On 18. Apr 2020, at 04:37, Dian Fu wrote: > > Hi everyone, > > Please review and vote on the release candidate #1 for the version 1.9.3, > as follows: > [ ] +1, Approve the

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-22 Thread Aljoscha Krettek
+1 to getting rid of flink-shaded-hadoop. But we need to document how people can now get a Flink dist that works with Hadoop. Currently, when you download the single shaded jar you immediately get support for submitting to YARN via bin/flink run. Aljoscha On 22.04.20 09:08, Till Rohrmann

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-22 Thread Till Rohrmann
Hi Robert, I think it would be a helpful simplification of Flink's build setup if we can get rid of flink-shaded-hadoop. Moreover relying only on the vanilla Hadoop dependencies for the modules which interact with Hadoop/Yarn sounds like a good idea to me. Adding support for Hadoop 3 would also

Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-22 Thread Zhu Zhu
+1 (non-binding) - checked release notes - checked signatures - built from source - submitted an example job on yarn cluster - WebUI and logs look good Thanks, Zhu Zhu Yu Li 于2020年4月22日周三 下午2:55写道: > +1 (non-binding) > > - Checked release notes: OK > - Checked sums and signatures: OK > -

[jira] [Created] (FLINK-17318) The comment is not right in `org.apache.flink.table.planner.delegation.PlannerBase`

2020-04-22 Thread Hequn Cheng (Jira)
Hequn Cheng created FLINK-17318: --- Summary: The comment is not right in `org.apache.flink.table.planner.delegation.PlannerBase` Key: FLINK-17318 URL: https://issues.apache.org/jira/browse/FLINK-17318

Re: [VOTE] Release 1.9.3, release candidate #1

2020-04-22 Thread Yu Li
+1 (non-binding) - Checked release notes: OK - Checked sums and signatures: OK - Source release - contains no binaries: OK - contains no 1.9-SNAPSHOT references: OK - build from source: OK (8u101) - mvn clean verify: OK (8u101) - Binary release - no examples appear to be

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

2020-04-22 Thread LINZ, Arnaud
Hello, I think that's a good idea. I suppose that most corporate users use a vendor version and already compile their flink version with vendor repos anyway. Arnaud PS - FYI, for CDH6 (based on hadoop3), I've managed to build a 1.10 version by modifying pom.xml files and using "hidden" Cloudera

[jira] [Created] (FLINK-17317) Schema.rowtime() method not working correctly, throws 'Window aggregate can only be defined over a time attribute column' exception

2020-04-22 Thread bianhaihua (Jira)
bianhaihua created FLINK-17317: -- Summary: Schema.rowtime() method not working correctly, throws 'Window aggregate can only be defined over a time attribute column' exception Key: FLINK-17317 URL:

[jira] [Created] (FLINK-17316) Have HourlyTips solutions use TumblingEventTimeWindows.of

2020-04-22 Thread David Anderson (Jira)
David Anderson created FLINK-17316: -- Summary: Have HourlyTips solutions use TumblingEventTimeWindows.of Key: FLINK-17316 URL: https://issues.apache.org/jira/browse/FLINK-17316 Project: Flink