Congratulations, Rui!
Best,
Xia
Paul Lam 于2024年6月6日周四 11:59写道:
> Congrats, Rui!
>
> Best,
> Paul Lam
>
> > 2024年6月6日 11:02,Junrui Lee 写道:
> >
> > Congratulations, Rui.
> >
> > Best,
> > Junrui
> >
> > Hang Ruan 于2024年6月6日周四 10
)
- Zhu Zhu (binding)
- Lijie Wang (binding)
- yuxia (binding)
Thanks to all involved.
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-445%3A+Support+dynamic+parallelism+inference+for+HiveSource
[2] https://lists.apache.org/thread/lktnb162l2z3042m76to6xfbsdndy4r7
Best,
Xia
/FLINK/FLIP-445%3A+Support+dynamic+parallelism+inference+for+HiveSource
[2] https://lists.apache.org/thread/4k1qx6lodhbkknkhjyl0lq9bx8fcpjvn
Best,
Xia
.
Best,
Xia
Venkatakrishnan Sowrirajan 于2024年4月25日周四 11:52写道:
> Hi Xia,
>
> +1 on introducing dynamic parallelism inference for HiveSource.
>
> Orthogonal to this discussion, curious, how commonly HiveSource is used
> these days in the industry given the popularity of table form
Hi everyone,
Thanks for all the feedback!
If there are no more comments, I would like to start the vote thread,
thanks again!
Best,
Xia
Ahmed Hamdy 于2024年4月18日周四 21:31写道:
> Hi Xia,
> I have read through the FLIP and discussion and the new version of the FLIP
> looks bet
Hi Ron,
Yes, presenting it in a table might be more intuitive. I have already added
the table in the "Public Interfaces | New Config Option" chapter of FLIP.
PTAL~
Ron Liu 于2024年4月18日周四 18:10写道:
> Hi, Xia
>
> Thanks for your reply.
>
> > That m
`InferMode.NONE` option.
Currently, 'adding InferMode.NONE' seems to be the prevailing opinion. I
will add InferMode.NONE as one of the Enum options in InferMode class.
Best,
Xia
Lijie Wang 于2024年4月18日周四 13:50写道:
> Thanks for driving the discussion.
>
> +1 for the proposal and +1 for the `In
ld eliminate the need for
introducing
a new configuration option. I haven't identified any potential
compatibility issues
as yet. If there are no further ideas from others, I'll go ahead and update
the FLIP to
introducing InferMode.NONE.
Best,
Xia
Muhammet Orazov 于2024年4月17日周三 10:31写道:
&g
-445%3A+Support+dynamic+parallelism+inference+for+HiveSource
[2]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-379%3A+Dynamic+source+parallelism+inference+for+batch+jobs
Best regards,
Xia
Congratulations Zakelly!
Best,
Xia
Leonard Xu 于2024年4月15日周一 16:16写道:
> Congratulations Zakelly!
>
>
> Best,
> Leonard
> > 2024年4月15日 下午3:56,Samrat Deb 写道:
> >
> > Congratulations Zakelly!
>
>
bal max parallelism.
Best,
Xia
Venkatakrishnan Sowrirajan 于2024年4月14日周日 10:31写道:
> Let me state why I think "*jobmanager.adaptive-batch-sche*
> *duler.default-source-parallelism*" should not be bound by the "
> *jobmanager.adaptive-batch-sche**duler.max-parallelism*&qu
Congratulations, Jing!
Best,
Xia
Ferenc Csaky 于2024年4月13日周六 00:50写道:
> Congratulations, Jing!
>
> Best,
> Ferenc
>
>
>
> On Friday, April 12th, 2024 at 13:54, Ron liu wrote:
>
> >
> >
> > Congratulations, Jing!
> >
> > Best,
> > R
Congratulations Lincoln !
Best,
Xia
Ferenc Csaky 于2024年4月13日周六 00:50写道:
> Congratulations, Lincoln!
>
> Best,
> Ferenc
>
>
>
>
> On Friday, April 12th, 2024 at 15:54, lorenzo.affe...@ververica.com.INVALID
> wrote:
>
> >
> >
> > Huge congrats!
+1
On 2023/12/11 02:33:24 Xin Gong wrote:
>
> good news.
>
> +1
>
> Best,
> gongxin
> On 2023/12/07 03:24:59 Leonard Xu wrote:
> > Dear Flink devs,
> >
> > As you may have heard, we at Alibaba (Ververica) are planning to donate CDC
> > Connectors for the Apache Flink project[1] to the Apache
(binding)
- Leonard Xu (binding)
- Jingsong Li (binding)
Thanks to all involved.
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-379%3A+Dynamic+source+parallelism+inference+for+batch+jobs
[2] https://lists.apache.org/thread/g03m2r8dodz6gn8jgf36mvq60h1tsnqg
Best,
Xia
/FLINK/FLIP-379%3A+Dynamic+source+parallelism+inference+for+batch+jobs
[2] https://lists.apache.org/thread/ocftkqy5d2x4n58wzprgm5qqrzzkbmb8
Best Regards,
Xia
Hi everyone,
Thanks for all the comments! I will initiate the vote tomorrow if there is
no further discussion.
Best,
Xia
Leonard Xu 于2023年11月24日周五 18:50写道:
> Thanks Xia and Zhu Zhu for driving this work,
>
> It will help unify the parallelism inference for all operators of ba
:Dynamicsourceparallelisminferenceforbatchjobs-IntroduceDynamicParallelismInferenceinterfaceforSource
[2]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-379%3A+Dynamic+source+parallelism+inference+for+batch+jobs#FLIP379:Dynamicsourceparallelisminferenceforbatchjobs-ConfigurationBehaviorChanges
Best,
Xia
Leonard Xu
is also one part of our FLIP ?
The intent was to make the pseudo code easier to understand, but did
introduce some confusion. There are no plans to introduce
getInferredSourceParallelism() in HiveSource, and I've modified the
HiveSource pseudo code in flip.
Best regards,
Xia
Leonard Xu 于2023年11月16日
+1 (non-binding)
Best,
Xia
Samrat Deb 于2023年11月13日周一 12:37写道:
> +1 (non binding)
>
> Bests,
> Samrat
>
> On Mon, 13 Nov 2023 at 9:10 AM, Yangze Guo wrote:
>
> > +1 (binding)
> >
> > Best,
> > Yangze Guo
> >
> > On Mon, Nov 13, 2023
at the runtime stage. In addition,
since the new interface is implemented together with the Source interface,
the Source::getBoundedness() method can also be obtained when inferring
parallelism.
Best regards,
Xia
Leonard Xu 于2023年11月8日周三 16:19写道:
> Thanks Xia and Zhu Zhu for kickoff this dis
parallelism inference.
Thanks,
Xia
Lijie Wang 于2023年11月1日周三 14:52写道:
> Hi Xia,
>
> Thanks for driving this FLIP, +1 for the proposal.
>
> I have 2 questions about the relationship between static inference and
> dynamic inference:
>
> 1. AFAIK, currently the hive table source
-379%3A+Dynamic+source+parallelism+inference+for+batch+jobs
Best regards,
Xia
Rui Xia created FLINK-32975:
---
Summary: Enhance equal() for ChangelogMapState's iterator
Key: FLINK-32975
URL: https://issues.apache.org/jira/browse/FLINK-32975
Project: Flink
Issue Type
Rui Xia created FLINK-32957:
---
Summary: Add current timer trigger lag to metrics
Key: FLINK-32957
URL: https://issues.apache.org/jira/browse/FLINK-32957
Project: Flink
Issue Type: Improvement
Rui Xia created FLINK-32954:
---
Summary: Metrics expose number of heap timer
Key: FLINK-32954
URL: https://issues.apache.org/jira/browse/FLINK-32954
Project: Flink
Issue Type: Improvement
+1 (non-binding)
Best Regards,
Xia
yuxia 于2023年6月25日周日 09:23写道:
> +1 (binding)
> Thanks Lijie driving it.
>
> Best regards,
> Yuxia
>
> - 原始邮件 -
> 发件人: "Yuepeng Pan"
> 收件人: "dev"
> 发送时间: 星期六, 2023年 6 月 24日 下午 9:06:53
> 主题: Re:[VOT
the object storage system can meet the
performance requirements and concurrent access challenges of large-scale
batch jobs(parallelism > 1)?
Thanks,
Xia
Zhu Zhu 于2023年3月10日周五 16:44写道:
> Hi Yuxin,
>
> Thanks for creating this FLIP!
> The idea of tiered storage looks good. Instead of ch
Rui Xia created FLINK-30235:
---
Summary: Comprehensive benchmarks on changelog checkpointing
Key: FLINK-30235
URL: https://issues.apache.org/jira/browse/FLINK-30235
Project: Flink
Issue Type
Shuai Xia created FLINK-21415:
-
Summary: JDBC does not query data, and the cache will store an
ArrayList without data
Key: FLINK-21415
URL: https://issues.apache.org/jira/browse/FLINK-21415
Project
Hello, everyone.
I am using Flink-Gelly. I got an error when running the example code of
Gelly-example. I have reported the problem in Stackoverflow, and this is the
link
(https://stackoverflow.com/questions/63211746/error-with-flink-gelly-lastjob
executionresult-is-null-for-executionenvironment)
Shuai Xia created FLINK-18147:
-
Summary: Orc document display is disordered
Key: FLINK-18147
URL: https://issues.apache.org/jira/browse/FLINK-18147
Project: Flink
Issue Type: Bug
32 matches
Mail list logo