Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-13 Thread Jing Zhang
eems to be similar with materialized view. Will we do something like materialized view rewriting during the optimization? Best, Jing Zhang Timo Walther 于2024年3月13日周三 01:24写道: > Hi Lincoln & Ron, > > thanks for proposing this FLIP. I think a design similar to what you > propose h

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

2023-03-28 Thread Jing Zhang
Congratulations! Best, Jing Zhang Rui Fan <1996fan...@gmail.com> 于2023年3月28日周二 22:25写道: > Congratulations! > > Best, > Rui Fan > > On Tue, Mar 28, 2023 at 15:37 Guowei Ma wrote: > > > Congratulations! > > > > Best, > > Guowei > > &g

Re: [VOTE] Release 1.16.1, release candidate #1

2023-01-29 Thread Jing Zhang
Client, query result is expected - run some batch jobs, query results are almost as expected except the issue FLINK-30567[1]. It’s not a blocker issue, so it would be OK to cherry pick the bugfix to 1.16.2 version later as well. [1] https://issues.apache.org/jira/browse/FLINK-30567 Best, Jing Zhang

Re: [VOTE] FLIP-281: Sink Supports Speculative Execution For Batch Job

2023-01-12 Thread Jing Zhang
+1 (binding) Best, Jing Zhang Lijie Wang 于2023年1月12日周四 16:39写道: > +1 (binding) > > Best, > Lijie > > Martijn Visser 于2023年1月12日周四 15:56写道: > > > +0 (binding) > > > > Op di 10 jan. 2023 om 13:11 schreef yuxia : > > > > > +

Re: [DISCUSS] FLIP-281 Sink Supports Speculative Execution For Batch Job

2023-01-03 Thread Jing Zhang
Hi Biao, Thanks for explanation. +1 for the proposal. Best, Jing Zhang Lijie Wang 于2023年1月4日周三 12:11写道: > Hi Biao, > > Thanks for the explanation of how SinkV2 knows the right subtask > attempt. I have no more questions, +1 for the proposal. > > Best, > Lijie > >

Re: [DISCUSS] FLIP-281 Sink Supports Speculative Execution For Batch Job

2022-12-27 Thread Jing Zhang
for specified operators. However the requirement is not supported currently. I think there should be some place to describe how to support it. Best, Jing Zhang Lijie Wang 于2022年12月27日周二 18:51写道: > Hi Biao, > > Thanks for driving this FLIP. > In this FLIP, it introduces "int getFi

[jira] [Created] (FLINK-28741) Unexpected result if insert 'false' to boolean column

2022-07-29 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-28741: -- Summary: Unexpected result if insert 'false' to boolean column Key: FLINK-28741 URL: https://issues.apache.org/jira/browse/FLINK-28741 Project: Flink Issue Type

Re: [VOTE] FLIP-248: Introduce dynamic partition pruning

2022-07-27 Thread Jing Zhang
+1 (binding) Best, Jing Zhang Jingsong Li 于2022年7月27日周三 16:52写道: > +1 > > On Wed, Jul 27, 2022 at 3:30 PM Jark Wu wrote: > > > > +1 (binding) > > > > Best, > > Jark > > > > On Wed, 27 Jul 2022 at 13:34, Yun Gao > wrote: > >

Re: [DISCUSS] FLIP-248: Introduce dynamic partition pruning

2022-07-26 Thread Jing Zhang
Hi, Godfrey Thanks for updating the FLIP. It looks good to me now. Best, Jing Zhang godfrey he 于2022年7月26日周二 12:33写道: > Thanks for all the inputs, I have updated the document and POC code. > > > Best, > Godfrey > > Yun Gao 于2022年7月26日周二 11:11写道: > > > &g

Re: [DISCUSS] FLIP-248: Introduce dynamic partition pruning

2022-07-13 Thread Jing Zhang
his point into consideration. Best, Jing Zhang [1] FLIP-248: https://cwiki.apache.org/confluence/display/FLINK/FLIP-248%3A+Introduce+dynamic+partition+pruning [2] FLIP-245: https://cwiki.apache.org/confluence/display/FLINK/FLIP-245%3A+Source+Supports+Speculative+Execution+For+Batch+Job Jark Wu 于2022年7月12日

Re: [VOTE] FLIP-249: Flink Web UI Enhancement for Speculative Execution

2022-07-13 Thread Jing Zhang
+1 (binding) Best, Jing Zhang Gen Luo 于2022年7月13日周三 14:49写道: > Hi Jing, > > I have replied in the discussion thread about the questions. Hope that > would be helpful. > > Best, > Gen > > On Tue, Jul 12, 2022 at 8:43 PM Jing Zhang wrote: > > > Hi, Gen Luo,

Re: [DISCUSS] FLIP-249: Flink Web UI Enhancement for Speculative Execution

2022-07-13 Thread Jing Zhang
way to know whether the job contains speculative executions even after the job finished. Maybe the point could be took into consideration in the next version. Best, Jing Zhang Gen Luo 于2022年7月13日周三 14:47写道: > Hi Jing, > > Thanks for joining the discussion. It's a very good point t

Re: [VOTE] FLIP-249: Flink Web UI Enhancement for Speculative Execution

2022-07-12 Thread Jing Zhang
Hi, Gen Luo, I left two minor questions in the DISCUSS thread. Sorry for jumping into the discussion so late. Best, Jing Zhang Lijie Wang 于2022年7月12日周二 19:29写道: > +1 (non-binding) > > Best, > Lijie > > Zhu Zhu 于2022年7月12日周二 17:38写道: > > > +1 (binding) > > &g

Re: [DISCUSS] FLIP-249: Flink Web UI Enhancement for Speculative Execution

2022-07-12 Thread Jing Zhang
of all vertex one by one? Best, Jing Zhang Gen Luo 于2022年7月11日周一 22:31写道: > Hi, everyone. > > Thanks for your feedback. > If there are no more concerns or comments, I will start the vote tomorrow. > > Gen Luo 于 2022年7月11日周一 11:12写道: > > > Hi Lijie and Zhu, > >

Re: [VOTE] Creating benchmark channel in Apache Flink slack

2022-07-11 Thread Jing Zhang
+ 1 (binding), Thanks for driving this. Best, Jing Zhang Yun Tang 于2022年7月12日周二 11:19写道: > + 1 (binding, I think this voting acts as voting a FLIP). > > > > Best, > Yun Tang > > From: Alexander Fedulov > Sent: Tuesday, July 12, 202

[RESULT][VOTE] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-07-08 Thread Jing Zhang
Hi everyone, I’m happy to announce that FLIP-245[1] has been accepted, with 5 approving votes, 3 of which are binding[2]: - Mang Zhang - Jiangang Liu - Guowei Ma (binding) - Zhu Zhu (binding) - Jing Zhang (binding) There is no disapproving vote. [1] https://cwiki.apache.org/confluence/display

Re: [VOTE] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-07-07 Thread Jing Zhang
+1 (binding) Best, Jing Zhang Zhu Zhu 于2022年7月6日周三 10:45写道: > +1 (binding) > > Thanks, > Zhu > > Guowei Ma 于2022年7月5日周二 17:38写道: > > > > +1 (binding) > > Best, > > Guowei > > > > > > On Tue, Jul 5, 2022 at 12:38 PM Jiangang Liu >

Re: Re: Re: [VOTE] FLIP-218: Support SELECT clause in CREATE TABLE(CTAS)

2022-07-07 Thread Jing Zhang
+1 (binding) Best, Jing Zhang Mang Zhang 于2022年7月7日周四 14:39写道: > Hi Godfrey, > Thank you very much for this vote! > > > Since the titles of the two vote emails are the same, making it easy to > confuse the emails, I will count the response results of these two emails >

[jira] [Created] (FLINK-28397) Source Supports Speculative Execution For Batch Job

2022-07-05 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-28397: -- Summary: Source Supports Speculative Execution For Batch Job Key: FLINK-28397 URL: https://issues.apache.org/jira/browse/FLINK-28397 Project: Flink Issue Type

[VOTE] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-07-04 Thread Jing Zhang
Hi all, I'd like to start a vote for FLIP-245: Source Supports Speculative Execution For Batch Job[1] on the discussion thread [2]. The vote will last for at least 72 hours unless there is an objection or insufficient votes. Best, Jing Zhang [1] https://cwiki.apache.org/confluence/display

Re: [DISCUSS] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-07-04 Thread Jing Zhang
Hi everyone, Thanks a lot for all the feedback! I will open a vote for it since there is no more concern. Best, Jing Zhang Jing Zhang 于2022年7月5日周二 11:31写道: > Hi ZhuZhu, Jiangjie, > > Thanks a lot for your feedback. > > I agree that it's better to support most existing events. &

Re: [DISCUSS] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-07-04 Thread Jing Zhang
. Watermark alignment is a new feature, and still evolving. Moreover, most users will not use this feature in batch cases. So I agree not to support it in speculative execution. Best, Jing Zhang Becket Qin 于2022年7月5日周二 08:38写道: > Yes, that sounds reasonable to me. That said, supporting custom eve

Re: [DISCUSS] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-07-01 Thread Jing Zhang
and enumerator. 3. How to handle ReportedWatermarkEvent/ReaderRegistrationEvent messages. Please review the FLIP-245[1] again, looking forward to your feedback. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-245%3A+Source+Supports+Speculative+Execution+For+Batch+Job Jing Zhang 于2022年

Re: [DISCUSS] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-07-01 Thread Jing Zhang
e it's useful for some user-defined sources which have a custom event protocol between reader and enumerator. Best, Jing Zhang [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-245%3A+Source+Supports+Speculative+Execution+For+Batch+Job Guowei Ma 于2022年6月29日周三 18:06写道: > Hi, Jing > &g

[DISCUSS] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-06-24 Thread Jing Zhang
execution of sources as one of follow up of FLIP-168. You could find more details in FLIP-245[2]. Looking forward to your feedback. Best, Jing Zhang [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-168%3A+Speculative+Execution+for+Batch+Job#FLIP168:SpeculativeExecutionforBatchJob

Re: [DISCUSS] Maintain a Calcite repository for Flink to accelerate the development for Flink SQL features

2022-06-22 Thread Jing Zhang
eed on these 3 points. About keeping up with the Calcite updates, I would like to take this issue. Is it too late to schedule the 1.16 version? How about scheduling this work on version 1.17? Best, Jing Zhang Martijn Visser 于2022年6月23日周四 02:01写道: > Hi everyone, > > I've recently

Re: [VOTE] FLIP-168: Speculative Execution for Batch Job

2022-06-20 Thread Jing Zhang
+1 (binding) Best, Jing Zhang Yun Gao 于2022年6月20日周一 14:25写道: > +1 (binding) > > Thanks for driving the FLIP! > > Best, > Yun Gao > > > -- > From:Guowei Ma > Send Time:2022 May 27 (Fri.) 11:16 &g

Re: [ANNOUNCE] New Apache Flink PMC Member - Jingsong Lee

2022-06-13 Thread Jing Zhang
Congratulations, Jingsong! Best, Jing Zhang Leonard Xu 于2022年6月14日周二 10:54写道: > Congratulations, Jingsong! > > > Best, > Leonard > > > 2022年6月13日 下午6:52,刘首维 写道: > > > > Congratulations and well deserved, Jingsong! > > > > > >

[jira] [Created] (FLINK-28003) 'pos ' field would be updated to 'POSITION' when use SqlClient

2022-06-10 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-28003: -- Summary: 'pos ' field would be updated to 'POSITION' when use SqlClient Key: FLINK-28003 URL: https://issues.apache.org/jira/browse/FLINK-28003 Project: Flink

Re: [VOTE] FLIP-231: Introduce SupportStatisticReport to support reporting statistics from source connectors

2022-06-09 Thread Jing Zhang
+1 (binding) Best, Jing Zhang Martijn Visser 于2022年6月9日周四 14:58写道: > +1 (binding) > > Op do 9 jun. 2022 om 04:31 schreef Jingsong Li : > > > +1 (binding) > > > > Best, > > Jingsong > > > > On Tue, Jun 7, 2022 at 5:20 PM Jark Wu wrote: >

Re: [VOTE] FLIP-226: Introduce Schema Evolution on Table Store

2022-05-15 Thread Jing Zhang
+1 Thanks @ Jingsong for driving this topic. Best, Jing Zhang Jingsong Li 于2022年5月12日周四 17:06写道: > Hi, everyone > > Thanks all for your attention to FLIP-226: Introduce Schema Evolution on > Table Store [1] and participation in the discussion in the mail thread [2]. > >

Re: Re: [VOTE] FLIP-216: Introduce pluggable dialect and plan for migrating Hive dialect

2022-04-28 Thread Jing Zhang
+1 (binding) Best, Jing Zhang Martijn Visser 于2022年4月28日周四 20:11写道: > +1 (Binding) > > On Thu, 28 Apr 2022 at 13:40, ron wrote: > > > +1 > > > > Best, > > Ron > > > > > > > -原始邮件- > > > 发件人: "Jark Wu" > &g

Re: [DISCUSS] Maintain a Calcite repository for Flink to accelerate the development for Flink SQL features

2022-04-23 Thread Jing Zhang
and uncontrolled results, often causing some unexpected problems. Thank @Godfrey for driving this discussion in a big scope. I think it's a good chance to review these problems and find a solution. Best, Jing Zhang godfrey he 于2022年4月22日周五 21:40写道: > Hi Chesnay, > > There is no bug fi

Re: [VOTE] FLIP-214: Support Advanced Function DDL

2022-04-21 Thread Jing Zhang
Ron, +1 (binding) Thanks for driving this FLIP. Best, Jing Zhang Jark Wu 于2022年4月21日周四 11:31写道: > Thanks for driving this work @Ron, > > +1 (binding) > > Best, > Jark > > On Thu, 21 Apr 2022 at 10:42, Man

Re: [VOTE] Release 1.15.0, release candidate #1

2022-04-12 Thread Jing Zhang
Hi, Yun Gao There is a new bug [1] introduced in release-1.15. It's better to be fixed in 1.15.0 version. I'm terribly sorry to merge the pull request too late. [1] https://issues.apache.org/jira/browse/FLINK-26681 Best, Jing Zhang Johannes Moser 于2022年4月12日周二 14:53写道: > Here is the miss

[jira] [Created] (FLINK-27086) Add a QA about how to handle exception when use hive parser in hive dialect document

2022-04-06 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-27086: -- Summary: Add a QA about how to handle exception when use hive parser in hive dialect document Key: FLINK-27086 URL: https://issues.apache.org/jira/browse/FLINK-27086

[jira] [Created] (FLINK-27020) use hive dialect in SqlClient would thrown an error based on 1.15 version

2022-04-02 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-27020: -- Summary: use hive dialect in SqlClient would thrown an error based on 1.15 version Key: FLINK-27020 URL: https://issues.apache.org/jira/browse/FLINK-27020 Project: Flink

[jira] [Created] (FLINK-27019) use hive dialect in SqlClient would thrown an error based on 1.15 version

2022-04-02 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-27019: -- Summary: use hive dialect in SqlClient would thrown an error based on 1.15 version Key: FLINK-27019 URL: https://issues.apache.org/jira/browse/FLINK-27019 Project: Flink

Re: [ANNOUNCE] New PMC member: Yuan Mei

2022-03-14 Thread Jing Zhang
Congratulations, Yuan! Best, Jing Zhang Jing Ge 于2022年3月14日周一 18:15写道: > Congrats! Very well deserved! > > Best, > Jing > > On Mon, Mar 14, 2022 at 10:34 AM Piotr Nowojski > wrote: > > > Congratulations :) > > > > pon., 14 mar 2022 o 09:59 Yun Tang n

Re: [ANNOUNCE] New Apache Flink Committer - Martijn Visser

2022-03-08 Thread Jing Zhang
Congratulations, Martin! Best, Jing Zhang Zhilong Hong 于2022年3月5日周六 01:17写道: > Congratulations, Martin! Well deserved! > > Best, > Zhilong > > On Sat, Mar 5, 2022 at 1:09 AM Piotr Nowojski > wrote: > > > Congratulations! > > > > Piotrek >

Re: [ANNOUNCE] New Apache Flink Committer - David Morávek

2022-03-07 Thread Jing Zhang
Congratulations David! Ryan Skraba 于2022年3月7日周一 22:18写道: > Congratulations David! > > On Mon, Mar 7, 2022 at 9:54 AM Jan Lukavský wrote: > > > Congratulations David! > > > > Jan > > > > On 3/7/22 09:44, Etienne Chauchot wrote: > > > Congrats David ! > > > > > > Well deserved ! > > > > > >

Re: [DISCUSS] Flink's supported APIs and Hive query syntax

2022-03-07 Thread Jing Zhang
to this migration work. Best, Jing Zhang Martijn Visser 于2022年3月7日周一 19:23写道: > Hi everyone, > > Flink currently has 4 APIs with multiple language support which can be used > to develop applications: > > * DataStream API, both Java and Scala > * Table API, both Java and Scala > *

Re: Re: [ANNOUNCE] New Apache Flink Committers: Feng Wang, Zhipeng Zhang

2022-02-18 Thread Jing Zhang
Congratulations! Best, Jing Zhang Benchao Li 于2022年2月18日周五 20:15写道: > Congratulations! > > Jing Ge 于2022年2月18日周五 17:03写道: > > > Congrats! Very well deserved! > > > > Best regards, > > Jing > > > > On Fri, Feb 18, 2022 at 9:16 AM Yu Li wr

Re: [ANNOUNCE] New Flink PMC members: Igal Shilman, Konstantin Knauf and Yun Gao

2022-02-18 Thread Jing Zhang
Congratulations! Best, Jing Zhang Benchao Li 于2022年2月18日周五 20:22写道: > Congratulations! > > Yu Li 于2022年2月18日周五 19:34写道: > > > Congratulations! > > > > Best Regards, > > Yu > > > > > > On Fri, 18 Feb 2022 at 14:19, godfrey he wrote: >

Re: [VOTE] Deprecate Per-Job Mode in Flink 1.15

2022-01-28 Thread Jing Zhang
+1 (binding) Thanks Konstantin for driving this. Best, Jing Zhang Chenya Zhang 于2022年1月29日周六 07:04写道: > +1 (non-binding) > > On Fri, Jan 28, 2022 at 12:46 PM Thomas Weise wrote: > > > +1 (binding) > > > > On Fri, Jan 28, 2022 at 9:27 AM David Morávek wr

Re: [DISCUSS] Releasing Flink 1.13.6

2022-01-25 Thread Jing Zhang
+1 for releasing Flink 1.13.6 Thanks Martijn and Konstantin for driving this. Best, Jing Zhang David Morávek 于2022年1月25日周二 19:13写道: > Thanks for driving this Martijn, +1 for the release > > Also big thanks to Konstantin for volunteering > > Best, > D. > > On Mon, Jan

Re: PR Review Request

2022-01-25 Thread Jing Zhang
Please ignore me. I originally wanted to send it to calcite's dev mail list, but I sent it to the wrong mail list. I'm terribly sorry. Jing Zhang 于2022年1月26日周三 14:55写道: > Hi community, > My apologies for interrupting. > Anyone could help to review the pr > https://github.com/ap

PR Review Request

2022-01-25 Thread Jing Zhang
which represents set semantics table. PR: https://github.com/apache/calcite/pull/2606 JIRA: https://issues.apache.org/jira/browse/CALCITE-4865 Parent JARA: https://issues.apache.org/jira/browse/CALCITE-4864 Best, Jing Zhang

[RESULT][VOTE] FLIP-204: Introduce Hash Lookup Join

2022-01-24 Thread Jing Zhang
(binding) - Jing Zhang(binding) - Zhang Mang (non-binding) There are no disapproving votes. Thanks everyone for feedback! Best, Jing Zhang [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-204%3A+Introduce+Hash+Lookup+Join [2] https://lists.apache.org/thread

Re: Re: [VOTE] FLIP-204: Introduce Hash Lookup Join

2022-01-24 Thread Jing Zhang
+1 (binding)

Re: Re: [DISCUSS] Introduce Hash Lookup Join

2022-01-20 Thread Jing Zhang
It means require shuffle on lookup join which contain dimension table with name as 'right_1' or 'right_2' or 'right_3'. WDYT? Best, Jing Zhang Jingsong Li 于2022年1月20日周四 14:33写道: > Hi Jing, > > Sorry for the late reply! > > Is there a conclusion about naming here? (Maybe I missed so

Re: Re: [DISCUSS] Introduce Hash Lookup Join

2022-01-20 Thread Jing Zhang
ide. WDYT? Best, Jing Zhang Jingsong Li 于2022年1月20日周四 15:09写道: > Hi Jing, > > About `SHUFFLE_HASH(left_table, right_table)`, one case can be shared: > > SELECT * FROM left_t > JOIN right_1 ON ... > JOIN right_2 ON ... > JOIN right_3 ON ... > > What if we want

[VOTE] FLIP-204: Introduce Hash Lookup Join

2022-01-19 Thread Jing Zhang
+Introduce+Hash+Lookup+Join [2] https://lists.apache.org/thread/swsg22lshh0ts41w4h9z4b0cgtfyfgxd Best, Jing Zhang

Re: Re: [DISCUSS] Introduce Hash Lookup Join

2022-01-15 Thread Jing Zhang
Hi all, Thanks for all the feedback so far. If there is no more suggestions, I would like to drive a vote in Tuesday next week (18 Jan). Best, Jing Zhang Jing Zhang 于2022年1月5日周三 11:33写道: > Hi Francesco, > Thanks a lot for the feedback. > > > does it makes sense for a lookup j

[jira] [Created] (FLINK-25645) UnsupportedOperationException would thrown out when hash shuffle by a field with array type

2022-01-13 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-25645: -- Summary: UnsupportedOperationException would thrown out when hash shuffle by a field with array type Key: FLINK-25645 URL: https://issues.apache.org/jira/browse/FLINK-25645

[jira] [Created] (FLINK-25641) Unexpected aggregate plan after load hive module

2022-01-13 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-25641: -- Summary: Unexpected aggregate plan after load hive module Key: FLINK-25641 URL: https://issues.apache.org/jira/browse/FLINK-25641 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-25605) Batch get statistics of multiple partitions instead of get one by one

2022-01-11 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-25605: -- Summary: Batch get statistics of multiple partitions instead of get one by one Key: FLINK-25605 URL: https://issues.apache.org/jira/browse/FLINK-25605 Project: Flink

[jira] [Created] (FLINK-25604) Remove useless aggregate function

2022-01-10 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-25604: -- Summary: Remove useless aggregate function Key: FLINK-25604 URL: https://issues.apache.org/jira/browse/FLINK-25604 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-25596) Specify hash/sortmerge join in SQL hint

2022-01-10 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-25596: -- Summary: Specify hash/sortmerge join in SQL hint Key: FLINK-25596 URL: https://issues.apache.org/jira/browse/FLINK-25596 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-25595) Specify hash/sort aggregate strategy in SQL hint

2022-01-10 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-25595: -- Summary: Specify hash/sort aggregate strategy in SQL hint Key: FLINK-25595 URL: https://issues.apache.org/jira/browse/FLINK-25595 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-25594) Take parquet metadata into consideration when source is parquet files

2022-01-10 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-25594: -- Summary: Take parquet metadata into consideration when source is parquet files Key: FLINK-25594 URL: https://issues.apache.org/jira/browse/FLINK-25594 Project: Flink

[jira] [Created] (FLINK-25593) A redundant scan could be skipped if it is an input of join and the other input is empty after partition prune

2022-01-10 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-25593: -- Summary: A redundant scan could be skipped if it is an input of join and the other input is empty after partition prune Key: FLINK-25593 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-25592) Improvement of parser, optimizer and execution for Flink Batch SQL

2022-01-10 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-25592: -- Summary: Improvement of parser, optimizer and execution for Flink Batch SQL Key: FLINK-25592 URL: https://issues.apache.org/jira/browse/FLINK-25592 Project: Flink

Re: Re: [DISCUSS] Introduce Hash Lookup Join

2022-01-04 Thread Jing Zhang
ould not be lost in the sql conversion phase and sql optimization phase. So here we only support table names. Best, Jing Zhang Francesco Guardiani 于2022年1月3日周一 18:38写道: > Hi Jing, > > Thanks for the FLIP. I'm not very knowledgeable about the topic, but going > through both the FLI

Re: Re: [DISCUSS] Introduce Hash Lookup Join

2021-12-31 Thread Jing Zhang
' hint tells the optimizer the skew metadata about the table 'Orders'. Best, Jing Zhang [1] https://calcite.apache.org/docs/reference.html#sql-hints Jing Zhang 于2021年12月31日周五 16:39写道: > Hi Martijn, > Thanks for the feedback. > > Glad to hear that we reached a consensus on the firs

Re: Re: [DISCUSS] Introduce Hash Lookup Join

2021-12-31 Thread Jing Zhang
on input, there exists a little difference between them. About this point, Lincoln and WenLong both prefer the term 'SHUFFLE_HASH', WDYT? Best, Jing Zhang Lincoln Lee 于2021年12月30日周四 11:21写道: > Hi Jing, > Thanks for your explanation! > > 1. For the hint name, +1 for WenLong's propo

Re: Re: [DISCUSS] Introduce Hash Lookup Join

2021-12-29 Thread Jing Zhang
WDYT? Best, Jing Zhang [1] https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/jdbc/#connector-options [2] https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/hbase/#connector-options Jing Zhang 于2021年12月29日周三 20:37写道: > Hi Wenlong, > Thank

Re: Re: [DISCUSS] Introduce Hash Lookup Join

2021-12-29 Thread Jing Zhang
' [2]. SQL Server uses keyword 'HASH' instead of query hint [3]. Note, the purposes of hash shuffle in [1][2][3] are a little different from the purpose of FLIP-204, we just discuss syntax here. I've added this part to FLIP waiting for further discussion. Best, Jing Zhang [1] https

Re: [DISCUSS] Introduce Hash Lookup Join

2021-12-28 Thread Jing Zhang
on this part? Best, Jing Zhang [1] https://docs.databricks.com/delta/join-performance/skew-join.html [2] https://help.aliyun.com/apsara/enterprise/v_3_13_0_20201215/odps/enterprise-ascm-user-guide/hotspot-tilt.html?spm=a2c4g.14484438.10001.669 Jing Zhang 于2021年12月29日周三 14:40写道: > Hi Yuan and Li

Re: [DISCUSS] Introduce Hash Lookup Join

2021-12-28 Thread Jing Zhang
this FLIP right now. If this is a strong requirement, we need drive another discussion on this topic individually because this point involves many extension on API. Best, Jing Zhang Lincoln Lee 于2021年12月29日周三 10:01写道: > Hi Jing, > Thanks for bringing up this discussion! Agree that

Re: [DISCUSS] Introduce Hash Lookup Join

2021-12-28 Thread Jing Zhang
che.org/docs/reference.html#sql-hints Best, Jing Zhang Martijn Visser 于2021年12月28日周二 22:02写道: > Hi Jing, > > Thanks a lot for the explanation and the FLIP. I definitely learned > something when reading more about `use_hash`. My interpretation would be > that the primary benefit

[DISCUSS] Introduce Hash Lookup Join

2021-12-27 Thread Jing Zhang
fference between the two solution is only about the internal implementation and has no impact on the user. For more detail on the proposal: https://cwiki.apache.org/confluence/display/FLINK/FLIP-204%3A+Introduce+Hash+Lookup+Join Looking forward to your feedback, thanks. Best, Jing Zhang [1] http

Re: [VOTE] FLIP-190: Support Version Upgrades for Table API & SQL Programs

2021-12-14 Thread Jing Zhang
+1 Thanks for driving this, Timo. Best, Jing Zhang wenlong.lwl 于2021年12月15日周三 13:31写道: > +1 (non-binding). Thanks for driving this Timo > > > Best, > Wenlong > > On Wed, 15 Dec 2021 at 03:21, Martijn Visser > wrote: > > > +1 (non-binding). Thanks for drivi

Re: [DISCUSS] Immediate dedicated Flink releases for log4j vulnerability

2021-12-13 Thread Jing Zhang
+1 for the quick release. Till Rohrmann 于2021年12月13日周一 17:54写道: > +1 > > Cheers, > Till > > On Mon, Dec 13, 2021 at 10:42 AM Jing Ge wrote: > > > +1 > > > > As I suggested to publish the blog post last week asap, users have been > > keen to have such urgent releases. Many thanks for it. > > >

Re: [DISCUSS] FLIP-190: Support Version Upgrades for Table API & SQL Programs

2021-12-13 Thread Jing Zhang
Hi Timo, +1 for the improvement too. Please count me in when assign subtasks. Best, Jing Zhang Timo Walther 于2021年12月13日周一 17:00写道: > Hi everyone, > > *last call for feedback* on this FLIP. Otherwise I would start a VOTE by > tomorrow. > > @Wenlong: Thanks for offeri

[jira] [Created] (FLINK-25258) Update log4j2 version to avoid

2021-12-10 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-25258: -- Summary: Update log4j2 version to avoid Key: FLINK-25258 URL: https://issues.apache.org/jira/browse/FLINK-25258 Project: Flink Issue Type: Bug Affects

Re: [DISCUSS] FLIP-190: Support Version Upgrades for Table API & SQL Programs

2021-12-08 Thread Jing Zhang
est version. This might also appears in other company too. Could we guarantee FLIP-190 work if we skip minor versions less than specified threshold? Then we could know which version is good for us when prepare upgrading. Best, Jing Zhang godfrey he 于2021年12月8日周三 22:16写道: > Hi Timo, >

Re: [ANNOUNCE] New Apache Flink Committer - Ingo Bürk

2021-12-02 Thread Jing Zhang
Congratulations, Ingo! 刘建刚 于2021年12月3日周五 11:52写道: > Congratulations! > > Best, > Liu Jiangang > > Till Rohrmann 于2021年12月2日周四 下午11:24写道: > > > Hi everyone, > > > > On behalf of the PMC, I'm very happy to announce Ingo Bürk as a new Flink > > committer. > > > > Ingo has started contributing to

Re: [ANNOUNCE] New Apache Flink Committer - Matthias Pohl

2021-12-02 Thread Jing Zhang
Congratulations, Matthias! 刘建刚 于2021年12月3日周五 11:51写道: > Congratulations! > > Best, > Liu Jiangang > > Till Rohrmann 于2021年12月2日周四 下午11:28写道: > > > Hi everyone, > > > > On behalf of the PMC, I'm very happy to announce Matthias Pohl as a new > > Flink committer. > > > > Matthias has worked on

Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

2021-11-30 Thread Jing Zhang
Amazing! Remote shuffle service is an important improvement for batch data processing experience on Flink. It is also a strong requirement in our internal batch business, we would try it soon and give you feedback. Best, Jing Zhang Martijn Visser 于2021年12月1日周三 上午3:25写道: > Hi Ying

Re: [VOTE][FLIP-195] Improve the name and structure of vertex and operator name for job

2021-11-23 Thread Jing Zhang
+1 (non-binding) Best, Jing Zhang Martijn Visser 于2021年11月23日周二 下午7:42写道: > +1 (non-binding) > > On Tue, 23 Nov 2021 at 12:13, Aitozi wrote: > > > +1 (non-binding) > > > > Best, > > Aitozi > > > > wenlong.lwl 于2021年11月23日周二 下午4:00写道: > >

Re: [ANNOUNCE] New Apache Flink Committer - Yingjie Cao

2021-11-17 Thread Jing Zhang
Congratulations! Best, Jing Zhang Dian Fu 于2021年11月17日周三 下午8:07写道: > Congratulations! > > Regards, > Dian > > On Wed, Nov 17, 2021 at 5:14 PM Yang Wang wrote: > > > Congratulations, Yiingjie! > > > > Best, > > Yang > > > > Zakell

Re: [ANNOUNCE] New Apache Flink Committer - Jing Zhang

2021-11-16 Thread Jing Zhang
Thanks to everyone. It's my honor to work in community with you all. Best, Jing Zhang Zakelly Lan 于2021年11月17日周三 上午12:06写道: > Congratulations, Jing! > > Best, > Zakelly > > On Tue, Nov 16, 2021 at 11:03 PM Yang Wang wrote: > >> Congratulations, Jing! >> >

Re: [ANNOUNCE] New Apache Flink Committer - Fabian Paul

2021-11-15 Thread Jing Zhang
Congratulations Fabian! Best, Jing Zhang Yuepeng Pan 于2021年11月16日周二 上午10:16写道: > Congratulations Fabian! > > Best, > Yuepeng Pan > > At 2021-11-15 21:17:13, "Arvid Heise" wrote: > >Hi everyone, > > > >On behalf of the PMC, I'm very happy to anno

Re: [ANNOUNCE] New Apache Flink Committer - Yangze Guo

2021-11-11 Thread JING ZHANG
Congrats! Best, Jing Zhang Lijie Wang 于2021年11月12日周五 下午1:25写道: > Congrats Yangze! > > Best, > Lijie > > Yuan Mei 于2021年11月12日周五 下午1:10写道: > > > Congrats Yangze! > > > > Best > > Yuan > > > > On Fri, Nov 12, 2021 at 11:57 AM Leon

Re: [ANNOUNCE] New Apache Flink Committer - Leonard Xu

2021-11-11 Thread JING ZHANG
Congrat! Best, Jing Zhang Lijie Wang 于2021年11月12日周五 下午1:26写道: > Congrats Leonard! > > Best, > Lijie > > Yuan Mei 于2021年11月12日周五 下午1:11写道: > > > Congrats Leonard! > > > > Best > > Yuan > > > > > > On Fri, Nov 12, 2021

Re: [VOTE] FLIP-188 Introduce Built-in Dynamic Table Storage

2021-11-11 Thread JING ZHANG
queues*, data copying may be avoided. So the built-in dynamic table storage may be promoted faster in the streaming data warehouse business. Best regards, Jing Zhang Yufei Zhang 于2021年11月11日周四 上午9:34写道: > Hi, > > +1 (non-binding) > > Very interesting design. I saw a lot of discussion

Re: [DISCUSS] Improve the name and structure of job vertex and operator name for job

2021-11-11 Thread JING ZHANG
Big +1. This is a problem frequently encountered in our production platform, look forward to this improvement. Best, Jing Zhang Martijn Visser 于2021年11月11日周四 下午6:26写道: > +1. Looks much better now > > On Thu, 11 Nov 2021 at 11:07, godfrey he wrote: > > >

Re: [VOTE] FLIP-189: SQL Client Usability Improvements

2021-11-08 Thread JING ZHANG
+1 (non-binding) Best, JING ZHANG Leonard Xu 于2021年11月9日周二 上午10:56写道: > +1 (non-binding) > > Thanks for the Improvements. > > Best, > Leonard > > 在 2021年11月9日,10:08,Yuepeng Pan 写道: > > > > +1 (non-binding)Best, > > Roc > > > > At 2

Re: I want to contribute to Apache Flink

2021-11-05 Thread JING ZHANG
] https://flink.apache.org/contributing/how-to-contribute.html Best, JING ZHANG shiyuquan 于2021年11月5日周五 下午7:22写道: > Hi Guys, > > > I want to contribute to Apache Flink. > Would you please give me the permission as a contributor? My JIRA ID is > shiyuquan. > > > Thanks! > >

[jira] [Created] (FLINK-24772) Update user document for individual window table-valued function

2021-11-04 Thread JING ZHANG (Jira)
JING ZHANG created FLINK-24772: -- Summary: Update user document for individual window table-valued function Key: FLINK-24772 URL: https://issues.apache.org/jira/browse/FLINK-24772 Project: Flink

[jira] [Created] (FLINK-24760) Update user document for batch window tvf

2021-11-04 Thread JING ZHANG (Jira)
JING ZHANG created FLINK-24760: -- Summary: Update user document for batch window tvf Key: FLINK-24760 URL: https://issues.apache.org/jira/browse/FLINK-24760 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] FLIP-189: SQL Client Usability Improvements

2021-11-01 Thread JING ZHANG
Amazing improvements and impressive video. Big +1. Best, JING ZHANG Kurt Young 于2021年11月2日周二 上午9:37写道: > Really cool improvements @Sergey. Can't wait to see it happen. > > Best, > Kurt > > > On Tue, Nov 2, 2021 at 1:56 AM Martijn Visser > wrote: > > > Hi Se

[jira] [Created] (FLINK-24708) `ConvertToNotInOrInRule` has a bug which leads to wrong result

2021-10-29 Thread JING ZHANG (Jira)
JING ZHANG created FLINK-24708: -- Summary: `ConvertToNotInOrInRule` has a bug which leads to wrong result Key: FLINK-24708 URL: https://issues.apache.org/jira/browse/FLINK-24708 Project: Flink

Re: [NOTICE] CiBot improvements

2021-10-29 Thread JING ZHANG
king just fine. You need to rebase your branch because on your > > branch flink-python is simply broken. > > > > On 29/10/2021 08:57, JING ZHANG wrote: > >> Hi Chesnay, > >> I meet with something weird. > >> I submit a pull request https://gi

Re: Re: [NOTICE] CiBot improvements

2021-10-29 Thread JING ZHANG
' for two times, nothing happened which is different from the behavior in the past. I ask some other guys, they said they also meet with this problem. Please help me check whether it is expected, thanks a lot. [image: image.png] Best, JING ZHANG Yuepeng Pan 于2021年10月12日周二 下午8:08写道: > Thank

[jira] [Created] (FLINK-24656) Add user document for Window Deduplication

2021-10-26 Thread JING ZHANG (Jira)
JING ZHANG created FLINK-24656: -- Summary: Add user document for Window Deduplication Key: FLINK-24656 URL: https://issues.apache.org/jira/browse/FLINK-24656 Project: Flink Issue Type: Sub-task

Re: [ANNOUNCE] Apache Flink 1.13.3 released

2021-10-21 Thread JING ZHANG
Thank Chesnay, Martijn and every contributor for making this happen! Thomas Weise 于2021年10月22日周五 上午12:15写道: > Thanks for making the release happen! > > On Thu, Oct 21, 2021 at 5:54 AM Leonard Xu wrote: > > > > Thanks to Chesnay & Martijn and everyone who made this release happen. > > > > > >

Re: Multiple View Creation support

2021-10-19 Thread JING ZHANG
Hi, I'm not sure I understand your question. Are you looking for a way to define multiple view in SQL? Please try define multiple view by define multiple create view query, you could find create view syntax in document [1] Please let me know if I misunderstand your requirement. [1]

Re: [VOTE] Release 1.13.3, release candidate #1

2021-10-18 Thread JING ZHANG
flink-1.13.3-bin-scala_2.12.tgz <https://dist.apache.org/repos/dist/dev/flink/flink-1.13.3-rc1/flink-1.13.3-bin-scala_2.12.tgz> Best, JING ZHANG Matthias Pohl 于2021年10月15日周五 下午10:07写道: > Thanks Chesnay for driving this. > > +1 (non-binding) > > - verified the checksums

  1   2   >