Re: [ANNOUNCE] New Apache Flink PMC Member - Fan Rui

2024-06-06 Thread Xia Sun
Congratulations, Rui! Best, Xia Paul Lam 于2024年6月6日周四 11:59写道: > Congrats, Rui! > > Best, > Paul Lam > > > 2024年6月6日 11:02,Junrui Lee 写道: > > > > Congratulations, Rui. > > > > Best, > > Junrui > > > > Hang Ruan 于2024年6月6日周四 10

[RESULT][VOTE] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-05-05 Thread Xia Sun
) - Zhu Zhu (binding) - Lijie Wang (binding) - yuxia (binding) Thanks to all involved. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-445%3A+Support+dynamic+parallelism+inference+for+HiveSource [2] https://lists.apache.org/thread/lktnb162l2z3042m76to6xfbsdndy4r7 Best, Xia

[VOTE] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-25 Thread Xia Sun
/FLINK/FLIP-445%3A+Support+dynamic+parallelism+inference+for+HiveSource [2] https://lists.apache.org/thread/4k1qx6lodhbkknkhjyl0lq9bx8fcpjvn Best, Xia

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-25 Thread Xia Sun
. Best, Xia Venkatakrishnan Sowrirajan 于2024年4月25日周四 11:52写道: > Hi Xia, > > +1 on introducing dynamic parallelism inference for HiveSource. > > Orthogonal to this discussion, curious, how commonly HiveSource is used > these days in the industry given the popularity of table form

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-24 Thread Xia Sun
Hi everyone, Thanks for all the feedback! If there are no more comments, I would like to start the vote thread, thanks again! Best, Xia Ahmed Hamdy 于2024年4月18日周四 21:31写道: > Hi Xia, > I have read through the FLIP and discussion and the new version of the FLIP > looks bet

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-18 Thread Xia Sun
Hi Ron, Yes, presenting it in a table might be more intuitive. I have already added the table in the "Public Interfaces | New Config Option" chapter of FLIP. PTAL~ Ron Liu 于2024年4月18日周四 18:10写道: > Hi, Xia > > Thanks for your reply. > > > That m

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-18 Thread Xia Sun
`InferMode.NONE` option. Currently, 'adding InferMode.NONE' seems to be the prevailing opinion. I will add InferMode.NONE as one of the Enum options in InferMode class. Best, Xia Lijie Wang 于2024年4月18日周四 13:50写道: > Thanks for driving the discussion. > > +1 for the proposal and +1 for the `In

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-16 Thread Xia Sun
ld eliminate the need for introducing a new configuration option. I haven't identified any potential compatibility issues as yet. If there are no further ideas from others, I'll go ahead and update the FLIP to introducing InferMode.NONE. Best, Xia Muhammet Orazov 于2024年4月17日周三 10:31写道: &g

[DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-16 Thread Xia Sun
-445%3A+Support+dynamic+parallelism+inference+for+HiveSource [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-379%3A+Dynamic+source+parallelism+inference+for+batch+jobs Best regards, Xia

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-15 Thread Xia Sun
Congratulations Zakelly! Best, Xia Leonard Xu 于2024年4月15日周一 16:16写道: > Congratulations Zakelly! > > > Best, > Leonard > > 2024年4月15日 下午3:56,Samrat Deb 写道: > > > > Congratulations Zakelly! > >

Re: Question around Flink's AdaptiveBatchScheduler

2024-04-15 Thread Xia Sun
bal max parallelism. Best, Xia Venkatakrishnan Sowrirajan 于2024年4月14日周日 10:31写道: > Let me state why I think "*jobmanager.adaptive-batch-sche* > *duler.default-source-parallelism*" should not be bound by the " > *jobmanager.adaptive-batch-sche**duler.max-parallelism*&qu

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

2024-04-14 Thread Xia Sun
Congratulations, Jing! Best, Xia Ferenc Csaky 于2024年4月13日周六 00:50写道: > Congratulations, Jing! > > Best, > Ferenc > > > > On Friday, April 12th, 2024 at 13:54, Ron liu wrote: > > > > > > > Congratulations, Jing! > > > > Best, > > R

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

2024-04-14 Thread Xia Sun
Congratulations Lincoln ! Best, Xia Ferenc Csaky 于2024年4月13日周六 00:50写道: > Congratulations, Lincoln! > > Best, > Ferenc > > > > > On Friday, April 12th, 2024 at 15:54, lorenzo.affe...@ververica.com.INVALID > wrote: > > > > > > > Huge congrats!

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

2023-12-10 Thread The Xia
+1 On 2023/12/11 02:33:24 Xin Gong wrote: > > good news. > > +1 > > Best, > gongxin > On 2023/12/07 03:24:59 Leonard Xu wrote: > > Dear Flink devs, > > > > As you may have heard, we at Alibaba (Ververica) are planning to donate CDC > > Connectors for the Apache Flink project[1] to the Apache

[RESULT][VOTE] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-12-05 Thread Xia Sun
(binding) - Leonard Xu (binding) - Jingsong Li (binding) Thanks to all involved. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-379%3A+Dynamic+source+parallelism+inference+for+batch+jobs [2] https://lists.apache.org/thread/g03m2r8dodz6gn8jgf36mvq60h1tsnqg Best, Xia

[VOTE] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-11-29 Thread Xia Sun
/FLINK/FLIP-379%3A+Dynamic+source+parallelism+inference+for+batch+jobs [2] https://lists.apache.org/thread/ocftkqy5d2x4n58wzprgm5qqrzzkbmb8 Best Regards, Xia

Re: [DISCUSS] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-11-28 Thread Xia Sun
Hi everyone, Thanks for all the comments! I will initiate the vote tomorrow if there is no further discussion. Best, Xia Leonard Xu 于2023年11月24日周五 18:50写道: > Thanks Xia and Zhu Zhu for driving this work, > > It will help unify the parallelism inference for all operators of ba

Re: [DISCUSS] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-11-24 Thread Xia Sun
:Dynamicsourceparallelisminferenceforbatchjobs-IntroduceDynamicParallelismInferenceinterfaceforSource [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-379%3A+Dynamic+source+parallelism+inference+for+batch+jobs#FLIP379:Dynamicsourceparallelisminferenceforbatchjobs-ConfigurationBehaviorChanges Best, Xia Leonard Xu

Re: [DISCUSS] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-11-20 Thread Xia Sun
is also one part of our FLIP ? The intent was to make the pseudo code easier to understand, but did introduce some confusion. There are no plans to introduce getInferredSourceParallelism() in HiveSource, and I've modified the HiveSource pseudo code in flip. Best regards, Xia Leonard Xu 于2023年11月16日

Re: [VOTE] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-12 Thread Xia Sun
+1 (non-binding) Best, Xia Samrat Deb 于2023年11月13日周一 12:37写道: > +1 (non binding) > > Bests, > Samrat > > On Mon, 13 Nov 2023 at 9:10 AM, Yangze Guo wrote: > > > +1 (binding) > > > > Best, > > Yangze Guo > > > > On Mon, Nov 13, 2023

Re: [DISCUSS] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-11-09 Thread Xia Sun
at the runtime stage. In addition, since the new interface is implemented together with the Source interface, the Source::getBoundedness() method can also be obtained when inferring parallelism. Best regards, Xia Leonard Xu 于2023年11月8日周三 16:19写道: > Thanks Xia and Zhu Zhu for kickoff this dis

Re: [DISCUSS] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-11-01 Thread Xia Sun
parallelism inference. Thanks, Xia Lijie Wang 于2023年11月1日周三 14:52写道: > Hi Xia, > > Thanks for driving this FLIP, +1 for the proposal. > > I have 2 questions about the relationship between static inference and > dynamic inference: > > 1. AFAIK, currently the hive table source

[DISCUSS] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-10-31 Thread Xia Sun
-379%3A+Dynamic+source+parallelism+inference+for+batch+jobs Best regards, Xia

[jira] [Created] (FLINK-32975) Enhance equal() for ChangelogMapState's iterator

2023-08-28 Thread Rui Xia (Jira)
Rui Xia created FLINK-32975: --- Summary: Enhance equal() for ChangelogMapState's iterator Key: FLINK-32975 URL: https://issues.apache.org/jira/browse/FLINK-32975 Project: Flink Issue Type

[jira] [Created] (FLINK-32957) Add current timer trigger lag to metrics

2023-08-25 Thread Rui Xia (Jira)
Rui Xia created FLINK-32957: --- Summary: Add current timer trigger lag to metrics Key: FLINK-32957 URL: https://issues.apache.org/jira/browse/FLINK-32957 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-32954) Metrics expose number of heap timer

2023-08-24 Thread Rui Xia (Jira)
Rui Xia created FLINK-32954: --- Summary: Metrics expose number of heap timer Key: FLINK-32954 URL: https://issues.apache.org/jira/browse/FLINK-32954 Project: Flink Issue Type: Improvement

Re: [VOTE] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-24 Thread Xia Sun
+1 (non-binding) Best Regards, Xia yuxia 于2023年6月25日周日 09:23写道: > +1 (binding) > Thanks Lijie driving it. > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Yuepeng Pan" > 收件人: "dev" > 发送时间: 星期六, 2023年 6 月 24日 下午 9:06:53 > 主题: Re:[VOT

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-12 Thread Xia Sun
the object storage system can meet the performance requirements and concurrent access challenges of large-scale batch jobs(parallelism > 1)? Thanks, Xia Zhu Zhu 于2023年3月10日周五 16:44写道: > Hi Yuxin, > > Thanks for creating this FLIP! > The idea of tiered storage looks good. Instead of ch

[jira] [Created] (FLINK-30235) Comprehensive benchmarks on changelog checkpointing

2022-11-28 Thread Rui Xia (Jira)
Rui Xia created FLINK-30235: --- Summary: Comprehensive benchmarks on changelog checkpointing Key: FLINK-30235 URL: https://issues.apache.org/jira/browse/FLINK-30235 Project: Flink Issue Type

[jira] [Created] (FLINK-21415) JDBC does not query data, and the cache will store an ArrayList without data

2021-02-19 Thread Shuai Xia (Jira)
Shuai Xia created FLINK-21415: - Summary: JDBC does not query data, and the cache will store an ArrayList without data Key: FLINK-21415 URL: https://issues.apache.org/jira/browse/FLINK-21415 Project

Error with Flink-Gelly, lastJobExecutionResult is null

2020-08-02 Thread Xia Rui
Hello, everyone. I am using Flink-Gelly. I got an error when running the example code of Gelly-example. I have reported the problem in Stackoverflow, and this is the link (https://stackoverflow.com/questions/63211746/error-with-flink-gelly-lastjob executionresult-is-null-for-executionenvironment)

[jira] [Created] (FLINK-18147) Orc document display is disordered

2020-06-05 Thread Shuai Xia (Jira)
Shuai Xia created FLINK-18147: - Summary: Orc document display is disordered Key: FLINK-18147 URL: https://issues.apache.org/jira/browse/FLINK-18147 Project: Flink Issue Type: Bug