Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-23 Thread Jark Wu
>From my point of view, I also prefer "sql-client.dml-sync", because the behavior of this configuration is very clear. Even if we introduce a new config in the future, e.g. `table.dml-sync`, we can also deprecate the sql-client one. Introducing a "table." configuration without any implementation

Re: [Parquet support]

2021-02-23 Thread Etienne Chauchot
Hi, Thanks guys for the comments ! I did not know it was legacy. I will give the new sources a try. Jingsong, when you say "migrate ParquetInputFormat to the new BulkFormat interface", do you mean that the new ParquetColumnarRowInputFormat is not fully functional yet? In the meantime, if

[jira] [Created] (FLINK-21476) How to appoint jobname

2021-02-23 Thread ranqiqiang (Jira)
ranqiqiang created FLINK-21476: -- Summary: How to appoint jobname Key: FLINK-21476 URL: https://issues.apache.org/jira/browse/FLINK-21476 Project: Flink Issue Type: Improvement

Re: Re: [ANNOUNCE] New Apache Flink Committers - Wei Zhong and Xingbo Huang

2021-02-23 Thread Wei Zhong
Thank you all for your congratulations! It's really an honor for me. Best, Wei Xingbo Huang 于2021年2月24日周三 上午9:54写道: > Thank you everyone! I really don't know what to say. I'm truly honoured. > > Best, > Xingbo > > Guowei Ma 于2021年2月24日周三 上午9:29写道: > > > Congratulations Wei and Xingbo! > > >

[jira] [Created] (FLINK-21475) StateWithExecutionGraph.suspend fails with IllegalStateException

2021-02-23 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-21475: -- Summary: StateWithExecutionGraph.suspend fails with IllegalStateException Key: FLINK-21475 URL: https://issues.apache.org/jira/browse/FLINK-21475 Project: Flink

[jira] [Created] (FLINK-21474) Migrate FileSystemTableSource to DynamicTable Source Interface

2021-02-23 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-21474: - Summary: Migrate FileSystemTableSource to DynamicTable Source Interface Key: FLINK-21474 URL: https://issues.apache.org/jira/browse/FLINK-21474 Project: Flink

[jira] [Created] (FLINK-21473) Migrate ParquetInputFormat to BulkFormat interface

2021-02-23 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-21473: - Summary: Migrate ParquetInputFormat to BulkFormat interface Key: FLINK-21473 URL: https://issues.apache.org/jira/browse/FLINK-21473 Project: Flink Issue

Re: [Parquet support]

2021-02-23 Thread Peter Huang
Hi Jingsong, Thanks for pointing this out. Actually, I planned to work on changing interfaces ParquetTableSource and ParquetInputFormat. After refactoring the code, I may also help to fix the issue in https://issues.apache.org/jira/browse/FLINK-21468. Best Regards Peter Huang On Tue, Feb 23,

Re: [Parquet support]

2021-02-23 Thread Jingsong Li
Hi Etienne, Thanks for your reporting. There are indeed many problems. There is no doubt that we need to improve our current format implementation. But ParquetTableSource and ParquetInputFormat are legacy implementations with legacy interfaces. We have introduced new interfaces for execution

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-23 Thread Kurt Young
If we all agree the option should only be handled by sql client, then why don't we just call it `sql-client.dml-sync`? As you said, calling it `table.dml-sync` but has no affection in `TableEnv.executeSql("INSERT INTO")` will also cause a big confusion for users. The only concern I saw is if we

[jira] [Created] (FLINK-21472) encingTokenException: Fencing token mismatch

2021-02-23 Thread hayden zhou (Jira)
hayden zhou created FLINK-21472: --- Summary: encingTokenException: Fencing token mismatch Key: FLINK-21472 URL: https://issues.apache.org/jira/browse/FLINK-21472 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-21471) jobmanger, taskmanager, and job hang abnormally, and the blobstore directory is not deleted

2021-02-23 Thread kangTwang (Jira)
kangTwang created FLINK-21471: - Summary: jobmanger, taskmanager, and job hang abnormally, and the blobstore directory is not deleted Key: FLINK-21471 URL: https://issues.apache.org/jira/browse/FLINK-21471

Re: Re: [ANNOUNCE] New Apache Flink Committers - Wei Zhong and Xingbo Huang

2021-02-23 Thread Xingbo Huang
Thank you everyone! I really don't know what to say. I'm truly honoured. Best, Xingbo Guowei Ma 于2021年2月24日周三 上午9:29写道: > Congratulations Wei and Xingbo! > > Best, > Guowei > > > On Wed, Feb 24, 2021 at 9:21 AM Zhu Zhu wrote: > > > Congratulations Wei and Xingbo! > > > > Thanks, > > Zhu > > >

Re: Re: [ANNOUNCE] New Apache Flink Committers - Wei Zhong and Xingbo Huang

2021-02-23 Thread Guowei Ma
Congratulations Wei and Xingbo! Best, Guowei On Wed, Feb 24, 2021 at 9:21 AM Zhu Zhu wrote: > Congratulations Wei and Xingbo! > > Thanks, > Zhu > > Zhijiang 于2021年2月23日周二 上午10:59写道: > > > Congratulations Wei and Xingbo! > > > > > > Best, > > Zhijiang > > > > > >

Re: Re: [ANNOUNCE] New Apache Flink Committers - Wei Zhong and Xingbo Huang

2021-02-23 Thread Zhu Zhu
Congratulations Wei and Xingbo! Thanks, Zhu Zhijiang 于2021年2月23日周二 上午10:59写道: > Congratulations Wei and Xingbo! > > > Best, > Zhijiang > > > -- > From:Yun Tang > Send Time:2021年2月23日(星期二) 10:58 > To:Roman Khachatryan ; dev >

[jira] [Created] (FLINK-21470) testSafetyNetClose fail

2021-02-23 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-21470: - Summary: testSafetyNetClose fail Key: FLINK-21470 URL: https://issues.apache.org/jira/browse/FLINK-21470 Project: Flink Issue Type: Bug Components: API

Re: [VOTE] Release 1.12.2, release candidate #1

2021-02-23 Thread Roman Khachatryan
The artifacts removed. Thanks everybody for taking part in the verification. Regards, Roman On Tue, Feb 23, 2021 at 12:21 PM Roman Khachatryan wrote: > Thanks Piotr, > > The RC-1 is therefore cancelled. > I'll remove the artifacts and create a new RC once the issue is resolved. > > Regards, >

[jira] [Created] (FLINK-21469) stop-with-savepoint --drain doesn't advance watermark for sources chained to MultipleInputStreamTask

2021-02-23 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-21469: -- Summary: stop-with-savepoint --drain doesn't advance watermark for sources chained to MultipleInputStreamTask Key: FLINK-21469 URL:

[Parquet support]

2021-02-23 Thread Etienne Chauchot
Hi all, I've been playing with Parquet with SQL and Avro lately. I've found some bugs: 1. https://issues.apache.org/jira/browse/FLINK-21388 : I already submitted a PR on this one (https://github.com/apache/flink/pull/14961) 2. https://issues.apache.org/jira/browse/FLINK-21389 3.

[jira] [Created] (FLINK-21468) ParquetTableSource: where clause on integer does not work

2021-02-23 Thread Etienne Chauchot (Jira)
Etienne Chauchot created FLINK-21468: Summary: ParquetTableSource: where clause on integer does not work Key: FLINK-21468 URL: https://issues.apache.org/jira/browse/FLINK-21468 Project: Flink

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-23 Thread Timo Walther
Hi Kurt, we can also shorten it to `table.dml-sync` if that would help. Then it would confuse users that do a regular `.executeSql("INSERT INTO")` in a notebook session. In any case users will need to learn the semantics of this option. `table.multi-dml-sync` should be described as "If a

[jira] [Created] (FLINK-21467) Document possible recommended usage of Bounded{One/Multi}Input.endInput and emphasize that they could be called multiple times

2021-02-23 Thread Kezhu Wang (Jira)
Kezhu Wang created FLINK-21467: -- Summary: Document possible recommended usage of Bounded{One/Multi}Input.endInput and emphasize that they could be called multiple times Key: FLINK-21467 URL:

Re: [VOTE] Release 1.12.2, release candidate #1

2021-02-23 Thread Roman Khachatryan
Thanks Piotr, The RC-1 is therefore cancelled. I'll remove the artifacts and create a new RC once the issue is resolved. Regards, Roman On Tue, Feb 23, 2021 at 11:57 AM Piotr Nowojski wrote: > Ops, sorry I've linked the wrong issue in the previous email. This is the > correct one: >

Re: [VOTE] Release 1.12.2, release candidate #1

2021-02-23 Thread Piotr Nowojski
Ops, sorry I've linked the wrong issue in the previous email. This is the correct one: https://issues.apache.org/jira/browse/FLINK-21453 Piotrek wt., 23 lut 2021 o 11:56 Piotr Nowojski napisał(a): > -1 > > I need to unfortunately change my vote to -1 because of the bug that was > introduced in

Re: [VOTE] Release 1.12.2, release candidate #1

2021-02-23 Thread Piotr Nowojski
-1 I need to unfortunately change my vote to -1 because of the bug that was introduced in 1.12.2: https://issues.apache.org/jira/browse/FLINK-19462 Luckily this seems to be an easy fix. Piotrek sob., 20 lut 2021 o 15:42 Yang Wang napisał(a): > +1 (non-binding) > > * build from source > *

[jira] [Created] (FLINK-21466) Simplify the command to start the sql client

2021-02-23 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-21466: - Summary: Simplify the command to start the sql client Key: FLINK-21466 URL: https://issues.apache.org/jira/browse/FLINK-21466 Project: Flink Issue Type:

[jira] [Created] (FLINK-21465) Extend explain syntax

2021-02-23 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-21465: - Summary: Extend explain syntax Key: FLINK-21465 URL: https://issues.apache.org/jira/browse/FLINK-21465 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-21464) Support ADD JAR command in sql client

2021-02-23 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-21464: - Summary: Support ADD JAR command in sql client Key: FLINK-21464 URL: https://issues.apache.org/jira/browse/FLINK-21464 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-21463) Refactor client parser

2021-02-23 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-21463: - Summary: Refactor client parser Key: FLINK-21463 URL: https://issues.apache.org/jira/browse/FLINK-21463 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-21462) Use `table.planner`, `execution.runtime-mode` to create TableEnvironment in sql client

2021-02-23 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-21462: - Summary: Use `table.planner`, `execution.runtime-mode` to create TableEnvironment in sql client Key: FLINK-21462 URL: https://issues.apache.org/jira/browse/FLINK-21462

[jira] [Created] (FLINK-21461) FileNotFoundException when sink to hive

2021-02-23 Thread zhuxiaoshang (Jira)
zhuxiaoshang created FLINK-21461: Summary: FileNotFoundException when sink to hive Key: FLINK-21461 URL: https://issues.apache.org/jira/browse/FLINK-21461 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-21460) Introduce option `table.planner`, `execution.runtime-mode`

2021-02-23 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-21460: - Summary: Introduce option `table.planner`, `execution.runtime-mode` Key: FLINK-21460 URL: https://issues.apache.org/jira/browse/FLINK-21460 Project: Flink

[jira] [Created] (FLINK-21459) Implement remote Java SDK for Stateful Functions

2021-02-23 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-21459: --- Summary: Implement remote Java SDK for Stateful Functions Key: FLINK-21459 URL: https://issues.apache.org/jira/browse/FLINK-21459 Project: Flink

[jira] [Created] (FLINK-21458) Add numRestarts metric

2021-02-23 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-21458: Summary: Add numRestarts metric Key: FLINK-21458 URL: https://issues.apache.org/jira/browse/FLINK-21458 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-21457) Add support to differentiate a zero length value bytes and non existing value.

2021-02-23 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-21457: Summary: Add support to differentiate a zero length value bytes and non existing value. Key: FLINK-21457 URL: https://issues.apache.org/jira/browse/FLINK-21457

[jira] [Created] (FLINK-21456) TableResult#print() should correctly stringify values of TIMESTAMP type in SQL format

2021-02-23 Thread Jark Wu (Jira)
Jark Wu created FLINK-21456: --- Summary: TableResult#print() should correctly stringify values of TIMESTAMP type in SQL format Key: FLINK-21456 URL: https://issues.apache.org/jira/browse/FLINK-21456 Project:

[jira] [Created] (FLINK-21455) Deploy history server on kubernetes

2021-02-23 Thread Yi Tang (Jira)
Yi Tang created FLINK-21455: --- Summary: Deploy history server on kubernetes Key: FLINK-21455 URL: https://issues.apache.org/jira/browse/FLINK-21455 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-21454) FLIP-163: SQL Client Improvements

2021-02-23 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-21454: - Summary: FLIP-163: SQL Client Improvements Key: FLINK-21454 URL: https://issues.apache.org/jira/browse/FLINK-21454 Project: Flink Issue Type: New Feature

Re: [DISCUSS] FLIP-147: Support Checkpoints After Tasks Finished

2021-02-23 Thread Till Rohrmann
Thanks for the explanation Yun and Guowei. I have to admit that I do not fully understand why this is strictly required but I think that we are touching two very important aspects which might have far fetching consequences for how Flink works: 1) Do we want to allow that multiple checkpoints are

[jira] [Created] (FLINK-21453) BoundedOneInput.endInput is NOT called when doing stop with savepoint WITH drain

2021-02-23 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-21453: -- Summary: BoundedOneInput.endInput is NOT called when doing stop with savepoint WITH drain Key: FLINK-21453 URL: https://issues.apache.org/jira/browse/FLINK-21453

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-23 Thread Kurt Young
Sorry for the late reply, but I'm confused by `table.multi-dml-sync`. IIUC this config will take effect with 2 use cases: 1. SQL client, either interactive mode or executing multiple statements via -f. In most cases, there will be only one INSERT INTO statement but we are controlling the

[jira] [Created] (FLINK-21452) FLIP-27 sources cannot reliably downscale

2021-02-23 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-21452: --- Summary: FLIP-27 sources cannot reliably downscale Key: FLINK-21452 URL: https://issues.apache.org/jira/browse/FLINK-21452 Project: Flink Issue Type:

[jira] [Created] (FLINK-21451) Remove TaskExecutionState#jobID

2021-02-23 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-21451: Summary: Remove TaskExecutionState#jobID Key: FLINK-21451 URL: https://issues.apache.org/jira/browse/FLINK-21451 Project: Flink Issue Type: