[jira] [Created] (FLINK-17203) Add metrics for ClickHouse sink

2020-04-16 Thread jinhai (Jira)
jinhai created FLINK-17203: -- Summary: Add metrics for ClickHouse sink Key: FLINK-17203 URL: https://issues.apache.org/jira/browse/FLINK-17203 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-17202) Add SQL for ClickHouse connector

2020-04-16 Thread jinhai (Jira)
jinhai created FLINK-17202: -- Summary: Add SQL for ClickHouse connector Key: FLINK-17202 URL: https://issues.apache.org/jira/browse/FLINK-17202 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-17201) Implement Streaming ClickHouseSink

2020-04-16 Thread jinhai (Jira)
jinhai created FLINK-17201: -- Summary: Implement Streaming ClickHouseSink Key: FLINK-17201 URL: https://issues.apache.org/jira/browse/FLINK-17201 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-17200) Add connectors to ClickHouse

2020-04-16 Thread jinhai (Jira)
jinhai created FLINK-17200: -- Summary: Add connectors to ClickHouse Key: FLINK-17200 URL: https://issues.apache.org/jira/browse/FLINK-17200 Project: Flink Issue Type: New Feature

Re: [VOTE] FLIP-118: Improve Flink’s ID system

2020-04-16 Thread Zhu Zhu
Thanks for proposing this improvement, Yangze. +1 (binding) Thanks, Zhu Zhu Zhijiang 于2020年4月17日周五 下午12:36写道: > Thanks for this FLIP, Yangze. > > Sorry for not involving in the previous discussion. In general I like the > proposed direction to make related IDs have more rich information for >

[jira] [Created] (FLINK-17199) Use NeverReturnExpired strategy for states in blink streaming join.

2020-04-16 Thread Benchao Li (Jira)
Benchao Li created FLINK-17199: -- Summary: Use NeverReturnExpired strategy for states in blink streaming join. Key: FLINK-17199 URL: https://issues.apache.org/jira/browse/FLINK-17199 Project: Flink

Re: [DISCUSS] FLIP-118: Improve Flink’s ID system

2020-04-16 Thread Yangze Guo
To keep the VOTE thread clean, I just forward @Zhijiang 's reminder here: > Sorry for not involving in the previous discussion. In general I like the > proposed direction to make related IDs have more rich information for > debugging and correlation. > But I have a bit reminder for the

Re: [DISCUSS] [FLINK-16824] Creating Temporal Table Function via DDL

2020-04-16 Thread Jark Wu
Hi Konstantin, Thanks for bringing this discussion. I think temporal join is a very important feature and should be exposed to pure SQL users. And I already received many requirements like this. However, my concern is that how to properly support this feature in SQL. Introducing a DDL syntax for

Re: [VOTE] FLIP-118: Improve Flink’s ID system

2020-04-16 Thread Zhijiang
Thanks for this FLIP, Yangze. Sorry for not involving in the previous discussion. In general I like the proposed direction to make related IDs have more rich information for debugging and correlation. But I have a bit reminder for the changes. After failover restarting, every related IDs

[jira] [Created] (FLINK-17198) DDL and DML compatibility for Hive connector

2020-04-16 Thread Rui Li (Jira)
Rui Li created FLINK-17198: -- Summary: DDL and DML compatibility for Hive connector Key: FLINK-17198 URL: https://issues.apache.org/jira/browse/FLINK-17198 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-17197) ContinuousFileReaderOperator might shade the real exception when processing records

2020-04-16 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-17197: --- Summary: ContinuousFileReaderOperator might shade the real exception when processing records Key: FLINK-17197 URL: https://issues.apache.org/jira/browse/FLINK-17197

Re: [DISCUSS] Releasing "fat" and "slim" Flink distributions

2020-04-16 Thread Jark Wu
Hi, I like the idea of web tool to assemble fat distribution. And the https://code.quarkus.io/ looks very nice. All the users need to do is just select what he/she need (I think this step can't be omitted anyway). We can also provide a default fat distribution on the web which default selects

[jira] [Created] (FLINK-17196) Rework the implementation of Fabric8FlinkKubeClient#getRestEndpoint

2020-04-16 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-17196: Summary: Rework the implementation of Fabric8FlinkKubeClient#getRestEndpoint Key: FLINK-17196 URL: https://issues.apache.org/jira/browse/FLINK-17196 Project: Flink

[jira] [Created] (FLINK-17195) Worker threads for source function have wrong ClassLoader

2020-04-16 Thread Teng Fei Liao (Jira)
Teng Fei Liao created FLINK-17195: - Summary: Worker threads for source function have wrong ClassLoader Key: FLINK-17195 URL: https://issues.apache.org/jira/browse/FLINK-17195 Project: Flink

Re: [DISCUSS] Releasing Flink 1.9.3

2020-04-16 Thread Dian Fu
Hi all, All the blocker issues for 1.9.3 have been resolved and I'm preparing the first RC now. Thanks, Dian > 在 2020年4月15日,下午10:27,Dian Fu 写道: > > Thanks you all for the positive feedback and thanks a lot Congxian and Yu for > working on FLINK-16576. > > I'll create the first RC after

[jira] [Created] (FLINK-17194) TPC-DS end-to-end test fails due to missing execution attempt

2020-04-16 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-17194: Summary: TPC-DS end-to-end test fails due to missing execution attempt Key: FLINK-17194 URL: https://issues.apache.org/jira/browse/FLINK-17194 Project: Flink

[jira] [Created] (FLINK-17193) k8s-python-example build-example.sh improvements

2020-04-16 Thread Rafi Aroch (Jira)
Rafi Aroch created FLINK-17193: -- Summary: k8s-python-example build-example.sh improvements Key: FLINK-17193 URL: https://issues.apache.org/jira/browse/FLINK-17193 Project: Flink Issue Type:

Re: [DISCUSS] Releasing "fat" and "slim" Flink distributions

2020-04-16 Thread Rafi Aroch
As a reference for a nice first-experience I had, take a look at https://code.quarkus.io/ You reach this page after you click "Start Coding" at the project homepage. Rafi On Thu, Apr 16, 2020 at 6:53 PM Kurt Young wrote: > I'm not saying pre-bundle some jars will make this problem go away,

Re: [DISCUSS] Releasing "fat" and "slim" Flink distributions

2020-04-16 Thread Kurt Young
I'm not saying pre-bundle some jars will make this problem go away, and you're right that only hides the problem for some users. But what if this solution can hide the problem for 90% users? Would't that be good enough for us to try? Regarding to would users following instructions really be such

Re: [DISCUSS] Releasing Flink 1.10.1

2020-04-16 Thread Yu Li
Thanks for the efforts and feedbacks all. Now the only left blocker is the below one (newly escalated with a solid reason), will create RC1 right after it's resolved. FLINK-16662 Blink Planner failed to generate JobGraph for POJO DataStream converting to Table (Cannot determine simple type name)

Re: [DISCUSS] Releasing "fat" and "slim" Flink distributions

2020-04-16 Thread Chesnay Schepler
The problem with having a distribution with "popular" stuff is that it doesn't really /solve/ a problem, it just hides it for users who fall into these particular use-cases. Move out of it and you once again run into exact same problems out-lined. This is exactly why I like the tooling

Re: [DISCUSS] [FLINK-16824] Creating Temporal Table Function via DDL

2020-04-16 Thread Benchao Li
Hi Konstantin, Thanks for bringing up this discussion. +1 for the idea. We have met this in our company too, and I planned to support it recently in our internal branch. regarding to your questions, 1) I think it might be more a table/view than function, just like Temporal Table (which is also

Re: [DISCUSS] Releasing "fat" and "slim" Flink distributions

2020-04-16 Thread Kurt Young
I'm not so sure about the web tool solution though. The concern I have for this approach is the final generated distribution is kind of non-deterministic. We might generate too many different combinations when user trying to package different types of connector, format, and even maybe hadoop

Re: [DISCUSS] Generating java code?

2020-04-16 Thread Niels Basjes
Hi, Apparently the IDEs (like IntelliJ) are imperfect at supporting the DEVs in these kinds of use cases. The solutions you see are like you have in IntelliJ: a "generate-sources" button. It is a way of working I see in almost all projects I'm involved with: Almost all either use a parser

Re: [VOTE] FLIP-118: Improve Flink’s ID system

2020-04-16 Thread Till Rohrmann
Thanks for creating this FLIP, Yangze. +1 (binding). Cheers, Till On Thu, Apr 16, 2020 at 10:51 AM Yangze Guo wrote: > Hi everyone, > > I'd like to start the vote of FLIP-118 [1], which improves the log > readability by adding more information to Flink’s IDs. This FLIP is > discussed in the

Re: [VOTE] FLIP-123: DDL and DML compatibility for Hive connector

2020-04-16 Thread Rui Li
Hi all, The voting for FLIP-123 has been over 72h and there're 3 binding +1 votes from: - Kurt, - Jingsong Li, - Rong Rong There's no disapproval vote. Therefore the vote is closed and FLIP-123 has been accepted. Thanks everyone for the help with review and vote for this FLIP. On Wed, Apr 15,

Re: [DISCUSS] Releasing "fat" and "slim" Flink distributions

2020-04-16 Thread Till Rohrmann
I think what Chesnay and Dawid proposed would be the ideal solution. Ideally, we would also have a nice web tool for the website which generates the corresponding distribution for download. To get things started we could start with only supporting to download/creating the "fat" version with the

[jira] [Created] (FLINK-17191) CREATE TABLE does not support interval types

2020-04-16 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17191: Summary: CREATE TABLE does not support interval types Key: FLINK-17191 URL: https://issues.apache.org/jira/browse/FLINK-17191 Project: Flink Issue

Re: [VOTE] FLIP-124: Add open/close and Collector to (De)SerializationSchema

2020-04-16 Thread Timo Walther
+1 (binding) Thanks, Timo On 16.04.20 11:32, Benchao Li wrote: +1 (non-binding) Aljoscha Krettek 于2020年4月16日周四 下午5:10写道: +1 (binding) Aljoscha

[jira] [Created] (FLINK-17190) SQL client does not support views that reference a table from DDL

2020-04-16 Thread Timo Walther (Jira)
Timo Walther created FLINK-17190: Summary: SQL client does not support views that reference a table from DDL Key: FLINK-17190 URL: https://issues.apache.org/jira/browse/FLINK-17190 Project: Flink

[jira] [Created] (FLINK-17188) Failed to download conda when running python tests

2020-04-16 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17188: Summary: Failed to download conda when running python tests Key: FLINK-17188 URL: https://issues.apache.org/jira/browse/FLINK-17188 Project: Flink

Re: [DISCUSS] Releasing Flink 1.10.1

2020-04-16 Thread Congxian Qiu
Thanks a lot for driving this, Yu! Looking forward to the first RC of 1.10.1 FLINK-16576 has been merged into release-1.10 already. Best, Congxian Dian Fu 于2020年4月16日周四 上午10:35写道: > Thanks a lot for driving this, Yu! Looking forward for the first RC of > 1.10.1. > > > 在

[DISCUSS] [FLINK-16824] Creating Temporal Table Function via DDL

2020-04-16 Thread Konstantin Knauf
Hi everyone, it would be very useful if temporal tables could be created via DDL. Currently, users either need to do this in the Table API or in the environment file of the Flink CLI, which both require the user to switch the context of the SQL CLI/Editor. I recently created a ticket for this

[jira] [Created] (FLINK-17187) Streamline setting of config options

2020-04-16 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-17187: Summary: Streamline setting of config options Key: FLINK-17187 URL: https://issues.apache.org/jira/browse/FLINK-17187 Project: Flink Issue Type:

[jira] [Created] (FLINK-17186) set eventtime from source with timestampsFromField funcation at flink 1.10 error

2020-04-16 Thread jiefeng zheng (Jira)
jiefeng zheng created FLINK-17186: - Summary: set eventtime from source with timestampsFromField funcation at flink 1.10 error Key: FLINK-17186 URL: https://issues.apache.org/jira/browse/FLINK-17186

[jira] [Created] (FLINK-17185) blink执行计划,自定义函数解析 array,参数为空元素

2020-04-16 Thread zck (Jira)
zck created FLINK-17185: --- Summary: blink执行计划,自定义函数解析 array,参数为空元素 Key: FLINK-17185 URL: https://issues.apache.org/jira/browse/FLINK-17185 Project: Flink Issue Type: Bug Components: Table SQL

[jira] [Created] (FLINK-17184) sink_ddl source_ddl query_sql webui没有指标数据

2020-04-16 Thread zck (Jira)
zck created FLINK-17184: --- Summary: sink_ddl source_ddl query_sql webui没有指标数据 Key: FLINK-17184 URL: https://issues.apache.org/jira/browse/FLINK-17184 Project: Flink Issue Type: Bug

Re: [DISCUSS] Releasing "fat" and "slim" Flink distributions

2020-04-16 Thread Dawid Wysakowicz
Hi all, Few points from my side: 1. I like the idea of simplifying the experience for first time users. As for production use cases I share Jark's opinion that in this case I would expect users to combine their distribution manually. I think in such scenarios it is important to understand

Re: [VOTE] FLIP-124: Add open/close and Collector to (De)SerializationSchema

2020-04-16 Thread Benchao Li
+1 (non-binding) Aljoscha Krettek 于2020年4月16日周四 下午5:10写道: > +1 (binding) > > Aljoscha > -- Benchao Li School of Electronics Engineering and Computer Science, Peking University Tel:+86-15650713730 Email: libenc...@gmail.com; libenc...@pku.edu.cn

[jira] [Created] (FLINK-17183) the 'create table [if not exists]' syntax is not supported

2020-04-16 Thread muzimusi (Jira)
muzimusi created FLINK-17183: Summary: the 'create table [if not exists]' syntax is not supported Key: FLINK-17183 URL: https://issues.apache.org/jira/browse/FLINK-17183 Project: Flink Issue

Re: [VOTE] FLIP-124: Add open/close and Collector to (De)SerializationSchema

2020-04-16 Thread Aljoscha Krettek
+1 (binding) Aljoscha

Re: [DISCUSS] Releasing Flink 1.10.1

2020-04-16 Thread godfrey he
Thanks a lot for driving this, Yu! Some users are already asking "where to download release-1.10.1?" Looking forward to the rc. Best, Godfrey Hequn Cheng 于2020年4月16日周四 下午12:45写道: > Thanks a lot for your great work Yu! Looking forward to the RC. > > Best, Hequn > > On Thu, Apr 16, 2020 at 10:35

Re: [DISCUSS] Releasing "fat" and "slim" Flink distributions

2020-04-16 Thread Aljoscha Krettek
I want to reinforce my opinion from earlier: This is about improving the situation both for first-time users and for experienced users that want to use a Flink dist in production. The current Flink dist is too "thin" for first-time SQL users and it is too "fat" for production users, that is

Re: [DISCUSS] Integration of training materials into Apache Flink

2020-04-16 Thread Aljoscha Krettek
I'd be very happy if someone took over that part of the documentation! There are open issues for the TODOs in the concepts section here: https://issues.apache.org/jira/browse/FLINK-12639. But feel free to comment there/close/re-arrange as you see fit. Maybe we use this thread and Jira to

Re: [DISCUSS] Integration of training materials into Apache Flink

2020-04-16 Thread David Anderson
> I am happy to get the repo created for you. Thank you, @seth. I think we are also going to want a new flink-training component in Jira. Maybe you can help there too? > If we go with the documentation (vs flink.apache.org) do you think we > should remove any of the existing content? There is

[VOTE] FLIP-118: Improve Flink’s ID system

2020-04-16 Thread Yangze Guo
Hi everyone, I'd like to start the vote of FLIP-118 [1], which improves the log readability by adding more information to Flink’s IDs. This FLIP is discussed in the thread[2]. The vote will be open for at least 72 hours. Unless there is an objection, I will try to close it by April 21, 2020

Re: [VOTE] FLIP-124: Add open/close and Collector to (De)SerializationSchema

2020-04-16 Thread Jark Wu
+1 (binding) Thanks Dawid for driving this. Best, Jark On Thu, 16 Apr 2020 at 15:54, Dawid Wysakowicz wrote: > Hi all, > > I would like to start the vote for FLIP-124 [1], which is discussed and > reached a consensus in the discussion thread [2]. > > The vote will be open until April 20th,

[VOTE] FLIP-124: Add open/close and Collector to (De)SerializationSchema

2020-04-16 Thread Dawid Wysakowicz
Hi all, I would like to start the vote for FLIP-124 [1], which is discussed and reached a consensus in the discussion thread [2]. The vote will be open until April 20th, unless there is an objection or not enough votes. Best, Dawid [1]

[jira] [Created] (FLINK-17182) RemoteInputChannelTest.testConcurrentOnSenderBacklogAndRecycle fail on azure

2020-04-16 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17182: Summary: RemoteInputChannelTest.testConcurrentOnSenderBacklogAndRecycle fail on azure Key: FLINK-17182 URL: https://issues.apache.org/jira/browse/FLINK-17182

[jira] [Created] (FLINK-17181) Simplify generic Types in Topology Interface

2020-04-16 Thread Gary Yao (Jira)
Gary Yao created FLINK-17181: Summary: Simplify generic Types in Topology Interface Key: FLINK-17181 URL: https://issues.apache.org/jira/browse/FLINK-17181 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17180) Implement PipelinedRegion interface for SchedulingTopology

2020-04-16 Thread Gary Yao (Jira)
Gary Yao created FLINK-17180: Summary: Implement PipelinedRegion interface for SchedulingTopology Key: FLINK-17180 URL: https://issues.apache.org/jira/browse/FLINK-17180 Project: Flink Issue

[jira] [Created] (FLINK-17179) Set row time attribute not working in connector descriptor

2020-04-16 Thread Yiwen Tu (Jira)
Yiwen Tu created FLINK-17179: Summary: Set row time attribute not working in connector descriptor Key: FLINK-17179 URL: https://issues.apache.org/jira/browse/FLINK-17179 Project: Flink Issue

[jira] [Created] (FLINK-17178) Provide "ALL" cache strategy in LookupFunction

2020-04-16 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-17178: -- Summary: Provide "ALL" cache strategy in LookupFunction Key: FLINK-17178 URL: https://issues.apache.org/jira/browse/FLINK-17178 Project: Flink Issue Type: New

[jira] [Created] (FLINK-17177) Handle Pod ERROR event correctly in KubernetesResourceManager#onError

2020-04-16 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-17177: Summary: Handle Pod ERROR event correctly in KubernetesResourceManager#onError Key: FLINK-17177 URL: https://issues.apache.org/jira/browse/FLINK-17177 Project: Flink

[jira] [Created] (FLINK-17176) Slow down Pod recreation in KubernetesResourceManager#PodCallbackHandler

2020-04-16 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-17176: Summary: Slow down Pod recreation in KubernetesResourceManager#PodCallbackHandler Key: FLINK-17176 URL: https://issues.apache.org/jira/browse/FLINK-17176 Project: