Re: [VOTE] Release flink-connector-jdbc v3.1.1, release candidate #1

2023-05-29 Thread Yuxin Tan
+1 (non-binding) - Checked sign - Checked the hash - Checked tag - Build from source Best, Yuxin weijie guo 于2023年5月29日周一 14:14写道: > +1 (non-binding) > > - checked sign and checksum > - checked tag in github repository > - compiled from source > - checked the web PR > > BTW, please remember

[jira] [Created] (FLINK-32194) Elasticsearch connector should remove the dependency on flink-shaded

2023-05-25 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32194: - Summary: Elasticsearch connector should remove the dependency on flink-shaded Key: FLINK-32194 URL: https://issues.apache.org/jira/browse/FLINK-32194 Project: Flink

[jira] [Created] (FLINK-32193) AWS connector removes the dependency on flink-shaded

2023-05-25 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32193: - Summary: AWS connector removes the dependency on flink-shaded Key: FLINK-32193 URL: https://issues.apache.org/jira/browse/FLINK-32193 Project: Flink Issue Type

Re: [VOTE] Release 1.17.1, release candidate #1

2023-05-22 Thread Yuxin Tan
+1 (non-binding) - verified the signatures - verified the checksums - built from source - start a standalone cluster, run a simple batch and a streaming job successfully - review release announcement PR Best, Yuxin Xintong Song 于2023年5月22日周一 18:24写道: > +1 (binding) > > - verified signatures

Re: [VOTE] Release 1.16.2, release candidate #1

2023-05-19 Thread Yuxin Tan
+1 (non-binding) - Verified signature - Verified hashes - Build form source with mac - Verify that the source archives do not contain any binaries - Run streaming and batch job in sql-client successfully. Thanks weijie for driving this release candidate. Best, Yuxin weijie guo 于2023年5月19日周五

[jira] [Created] (FLINK-32101) FlinkKafkaInternalProducerITCase.testInitTransactionId test failed

2023-05-15 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32101: - Summary: FlinkKafkaInternalProducerITCase.testInitTransactionId test failed Key: FLINK-32101 URL: https://issues.apache.org/jira/browse/FLINK-32101 Project: Flink

[jira] [Created] (FLINK-32060) Migrate subclasses of BatchAbstractTestBase in table and other modules to JUnit5

2023-05-11 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32060: - Summary: Migrate subclasses of BatchAbstractTestBase in table and other modules to JUnit5 Key: FLINK-32060 URL: https://issues.apache.org/jira/browse/FLINK-32060 Project

[jira] [Created] (FLINK-32059) Migrate subclasses of BatchAbstractTestBase in batch.sql.agg and batch.sql.join to JUnit5

2023-05-11 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32059: - Summary: Migrate subclasses of BatchAbstractTestBase in batch.sql.agg and batch.sql.join to JUnit5 Key: FLINK-32059 URL: https://issues.apache.org/jira/browse/FLINK-32059

[jira] [Created] (FLINK-32058) Migrate subclasses of BatchAbstractTestBase in runtime.batch.sql to JUnit5

2023-05-11 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32058: - Summary: Migrate subclasses of BatchAbstractTestBase in runtime.batch.sql to JUnit5 Key: FLINK-32058 URL: https://issues.apache.org/jira/browse/FLINK-32058 Project: Flink

[jira] [Created] (FLINK-32055) Migrate all subclasses of BatchAbstractTestBase to JUnit5

2023-05-11 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-32055: - Summary: Migrate all subclasses of BatchAbstractTestBase to JUnit5 Key: FLINK-32055 URL: https://issues.apache.org/jira/browse/FLINK-32055 Project: Flink Issue

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-21 Thread Yuxin Tan
Congratulations, Leonard! Best, Yuxin Panagiotis Garefalakis 于2023年4月22日周六 08:08写道: > Congrats Leonard! > > On Fri, Apr 21, 2023 at 11:19 AM Ahmed Hamdy wrote: > > > Congratulations Leonard. > > Best Regards > > Ahmed > > > > On Fri, 21 Apr 2023 at 17:23, Samrat Deb wrote: > > > > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

2023-04-21 Thread Yuxin Tan
Congratulations, Qingsheng! Best, Yuxin Ahmed Hamdy 于2023年4月22日周六 02:20写道: > Congratulations Qingsheng. > Best regards > Ahmed > > On Fri, 21 Apr 2023 at 17:22, Samrat Deb wrote: > > > congratulations ! > > > > On Fri, 21 Apr 2023 at 9:45 PM, David Morávek wrote: > > > > > Congratulations,

[jira] [Created] (FLINK-31878) Fix the wrong name of PauseOrResumeSplitsTask#toString in connector fetcher

2023-04-21 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31878: - Summary: Fix the wrong name of PauseOrResumeSplitsTask#toString in connector fetcher Key: FLINK-31878 URL: https://issues.apache.org/jira/browse/FLINK-31878 Project

[jira] [Created] (FLINK-31720) Pulsar connector v3.0 branch's docs are empty

2023-04-04 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31720: - Summary: Pulsar connector v3.0 branch's docs are empty Key: FLINK-31720 URL: https://issues.apache.org/jira/browse/FLINK-31720 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-31688) Broken links in docs for Azure Table Storage

2023-04-02 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31688: - Summary: Broken links in docs for Azure Table Storage Key: FLINK-31688 URL: https://issues.apache.org/jira/browse/FLINK-31688 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-31671) [Connectors/HBase] Update flink to 1.17.0

2023-03-30 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31671: - Summary: [Connectors/HBase] Update flink to 1.17.0 Key: FLINK-31671 URL: https://issues.apache.org/jira/browse/FLINK-31671 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31647) Introduce remote storage tier reader

2023-03-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31647: - Summary: Introduce remote storage tier reader Key: FLINK-31647 URL: https://issues.apache.org/jira/browse/FLINK-31647 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31646) Introduce remote storage tier

2023-03-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31646: - Summary: Introduce remote storage tier Key: FLINK-31646 URL: https://issues.apache.org/jira/browse/FLINK-31646 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31644) Introduce disk tier

2023-03-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31644: - Summary: Introduce disk tier Key: FLINK-31644 URL: https://issues.apache.org/jira/browse/FLINK-31644 Project: Flink Issue Type: Sub-task Components

[jira] [Created] (FLINK-31645) Introduce disk tier reader

2023-03-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31645: - Summary: Introduce disk tier reader Key: FLINK-31645 URL: https://issues.apache.org/jira/browse/FLINK-31645 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31643) Introduce a temporary switch to enable the new shuffle implementation

2023-03-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31643: - Summary: Introduce a temporary switch to enable the new shuffle implementation Key: FLINK-31643 URL: https://issues.apache.org/jira/browse/FLINK-31643 Project: Flink

[jira] [Created] (FLINK-31641) Introduce memory tier

2023-03-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31641: - Summary: Introduce memory tier Key: FLINK-31641 URL: https://issues.apache.org/jira/browse/FLINK-31641 Project: Flink Issue Type: Sub-task Components

[jira] [Created] (FLINK-31642) Introduce memory tier reader

2023-03-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31642: - Summary: Introduce memory tier reader Key: FLINK-31642 URL: https://issues.apache.org/jira/browse/FLINK-31642 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31640) Introduce segment index tracker

2023-03-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31640: - Summary: Introduce segment index tracker Key: FLINK-31640 URL: https://issues.apache.org/jira/browse/FLINK-31640 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31639) Introduce tiered store memory manager

2023-03-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31639: - Summary: Introduce tiered store memory manager Key: FLINK-31639 URL: https://issues.apache.org/jira/browse/FLINK-31639 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31638) Downstream supports reading buffers from tiered store

2023-03-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31638: - Summary: Downstream supports reading buffers from tiered store Key: FLINK-31638 URL: https://issues.apache.org/jira/browse/FLINK-31638 Project: Flink Issue Type

[jira] [Created] (FLINK-31637) Introduce buffer accumulator tier

2023-03-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31637: - Summary: Introduce buffer accumulator tier Key: FLINK-31637 URL: https://issues.apache.org/jira/browse/FLINK-31637 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31636) Upstream supports reading buffers from tiered store

2023-03-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31636: - Summary: Upstream supports reading buffers from tiered store Key: FLINK-31636 URL: https://issues.apache.org/jira/browse/FLINK-31636 Project: Flink Issue Type

[jira] [Created] (FLINK-31635) Support writing records to the new tiered store architecture

2023-03-28 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31635: - Summary: Support writing records to the new tiered store architecture Key: FLINK-31635 URL: https://issues.apache.org/jira/browse/FLINK-31635 Project: Flink

[jira] [Created] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-27 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31634: - Summary: FLIP-301: Hybrid Shuffle supports Remote Storage Key: FLINK-31634 URL: https://issues.apache.org/jira/browse/FLINK-31634 Project: Flink Issue Type: New

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

2023-03-27 Thread Yuxin Tan
Congratulations! Best, Yuxin Guanghui Zhang 于2023年3月28日周二 11:06写道: > Congratulations! > > Best, > Zhang Guanghui > > Hang Ruan 于2023年3月28日周二 10:29写道: > > > Congratulations! > > > > Best, > > Hang > > > > yu zelin 于2023年3月28日周二 10:27写道: > > > >> Congratulations! > >> > >> Best, > >> Yu Zelin

[RESULT][VOTE] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-23 Thread Yuxin Tan
Hi all, I am happy to announce that FLIP-301: Hybrid Shuffle supports Remote Storage[1] has been accepted. The FLIP was voted in this thread[2]. There are 4 binding votes and 3 non-binding votes: - Wencong Liu (non-binding) - Weihua Hu (non-binding) - Junrui Lee (non-binding) - weijie guo

Re: [VOTE] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-23 Thread Yuxin Tan
4:24写道: > > > > > > > > > +1 (non-binding) > > > > > > > > > > Best, > > > > > Weihua > > > > > > > > > > > > > > > On Mon, Mar 20, 2023 at 12:39 PM Wencong Liu > > > > > wrote: > > > > > > > >

[VOTE] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-19 Thread Yuxin Tan
Hi, everyone, Thanks for all your feedback for FLIP-301: Hybrid Shuffle supports Remote Storage[1] on the discussion thread[2]. I'd like to start a vote for it. The vote will be open for at least 72 hours (03/23, 13:00 UTC+8) unless there is an objection or not enough votes. [1]

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-19 Thread Yuxin Tan
Hi all, Thanks for all the feedback and suggestions so far. The discussion has been going on for some time. If there are no further comments, we will start voting today. Best, Yuxin Yuxin Tan 于2023年3月17日周五 12:52写道: > Hi, > Thanks for joining the discussion and giving the ideas. &g

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-16 Thread Yuxin Tan
Hi, Thanks for joining the discussion and giving the ideas. @ron > can the Hybrid Shuffle replace the RSS in the future? The hybrid shuffle and RSS offer distinct solutions to address the shuffle operation challenge. To optimize performance, we store shuffle data in different tiers of memory and

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-15 Thread Yuxin Tan
plicitly in the original FLIP's goals or > design principles. > > > Best > Yun Tang > ____ > From: Yuxin Tan > Sent: Wednesday, March 15, 2023 12:41 > To: dev@flink.apache.org > Subject: Re: [DISCUSS] FLIP-301: Hybrid Shuffle suppo

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-14 Thread Yuxin Tan
ld > switch to kick shuffle data to remote storage once no space left exception > is met. > > > [1] > https://www.alibabacloud.com/help/en/realtime-compute-for-apache-flink/latest/geministatebackend-configurations#section-u0y-on0-owo > > > Best > Yun Tang > > ___

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-13 Thread Yuxin Tan
assumption that tier changing would not be very frequent. > > > > Thanks, > > Zhu > > > > Weihua Hu 于2023年3月10日周五 11:52写道: > > > > > > Thanks Yuxin for your explanation. > > > > > > That sounds reasonable. Looking

Re: 退订

2023-03-12 Thread Yuxin Tan
退订请发任意内容到 dev-unsubscr...@flink.apache.org [1] [1] https://flink.apache.org/community/ Best, Yuxin MuChen <9329...@qq.com.invalid> 于2023年3月13日周一 08:48写道: > 退订 > > > > > MuChen > 9329...@qq.com > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Yuxia Luo

2023-03-12 Thread Yuxin Tan
Congratulations, Yuxia! Best, Yuxin Jark Wu 于2023年3月13日周一 10:26写道: > Hi, everyone > > On behalf of the PMC, I'm very happy to announce Yuxia Luo as a new Flink > Committer. > > Yuxia has been continuously contributing to the Flink project for almost > two > years, authored and reviewed

[jira] [Created] (FLINK-31396) Occasional inaccurate timeout time calculation with System.nanotime in batch read buffer pool

2023-03-10 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31396: - Summary: Occasional inaccurate timeout time calculation with System.nanotime in batch read buffer pool Key: FLINK-31396 URL: https://issues.apache.org/jira/browse/FLINK-31396

Re: [Vote] FLIP-298: Unifying the Implementation of SlotManager

2023-03-09 Thread Yuxin Tan
Thanks, Weihua! +1 (non-binding) Best, Yuxin weijie guo 于2023年3月10日周五 11:29写道: > +1 (binding) > > Best regards, > > Weijie > > > Shammon FY 于2023年3月10日周五 11:02写道: > > > Thanks weihua, +1 (non-binding) > > > > Best, > > Shammon > > > > On Fri, Mar 10, 2023 at 10:32 AM Xintong Song > > wrote:

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-09 Thread Yuxin Tan
d of > storage tier. > Shall we move the local data to remote storage if the producer is finished > for a long time? > So we can release the idle task manager with no shuffle data on it. This > may help to reduce > the resource usage when producer parallelism is larger than consu

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-08 Thread Yuxin Tan
his FLIP. Are these three values fixed at present? If they are fixed, I > suggest that FLIP > could provide clearer explanations. Moreover, although a dynamic segment > size > mechanism is not necessary at the moment, can we provide configuration > options for users > to manually adju

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-07 Thread Yuxin Tan
utilization > rate of Memory Storage Tier, but it may brings extra cost to Disk Storage > Tier or Remote Storage Tier. Deciding the size of Segment dynamicly will be > helpful. > > Best, > > > Wencong Liu > > > > > > > > > > > > > > &

[DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-05 Thread Yuxin Tan
Hi everyone, I would like to start a discussion on FLIP-301: Hybrid Shuffle supports Remote Storage[1]. In the cloud-native environment, it is difficult to determine the appropriate disk space for Batch shuffle, which will affect job stability. This FLIP is to support Remote Storage for Hybrid

[jira] [Created] (FLINK-31314) Hybrid

2023-03-03 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31314: - Summary: Hybrid Key: FLINK-31314 URL: https://issues.apache.org/jira/browse/FLINK-31314 Project: Flink Issue Type: Improvement Reporter: Yuxin Tan

Re: [ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Yuxin Tan
Congratulations, Dong! Best, Yuxin ConradJam 于2023年2月17日周五 09:59写道: > Congratulations Dong > > Dong Lin 于2023年2月16日周四 21:32写道: > > > Thank you all! > > > > I am looking forward to making more contributions to Apache Flink! > > > > On Thu, Feb 16, 2023 at 8:34 PM Jark Wu wrote: > > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

2023-02-14 Thread Yuxin Tan
Congratulations, Jing Ge! Best, Yuxin Shengkai Fang 于2023年2月15日周三 10:52写道: > Congratulations! > > Best, > Shengkai > > Yanfei Lei 于2023年2月15日周三 10:08写道: > > > Congratulations, Jing Ge ! > > > > Best regards, > > Yanfei > > > > yuxia 于2023年2月15日周三 09:34写道: > > > > > > Congratulations, Jing

Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-12 Thread Yuxin Tan
Congratulations, Weijie! Best, Yuxin Yanfei Lei 于2023年2月13日周一 12:16写道: > Congratulations, Weijie! > > Best regards, > Yanfei > > Junrui Lee 于2023年2月13日周一 12:12写道: > > > > Congratulations, Weijie! > > > > Best, > > Junrui >

[jira] [Created] (FLINK-30712) Update network memory configuration docs

2023-01-16 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-30712: - Summary: Update network memory configuration docs Key: FLINK-30712 URL: https://issues.apache.org/jira/browse/FLINK-30712 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-09 Thread Yuxin Tan
Congratulations, Lincoln! Best, Yuxin Qingsheng Ren 于2023年1月10日周二 14:11写道: > Congratulations, Lincoln! > > Best, > Qingsheng > > On Tue, Jan 10, 2023 at 2:06 PM yuxia wrote: > > > Congratulations, Lincoln! > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Shuiqiang Chen" >

Re: [VOTE]FLIP-266: Simplify network memory configurations for TaskManager

2023-01-08 Thread Yuxin Tan
; > 17610775726 <17610775...@163.com> 于2023年1月4日周三 13:03写道: > > > > > > > +1 (no binding) > > > > > > Best > > JasonLee > > > > > > Replied Message > > | From | Yuxin Tan | > > | Date | 01/

[RESULT][VOTE]FLIP-266: Simplify network memory configurations for TaskManager

2023-01-06 Thread Yuxin Tan
Hi all, FLIP-266: Simplify network memory configurations for TaskManager[1] has been accepted. The FLIP was voted in this thread[2]. There are 3 bindings, and 1 non-bindings as follows: Xintong Song (binding) Zhu Zhu (binding) JasonLee (no-binding) Lijie Wang (binding) There are no

[VOTE]FLIP-266: Simplify network memory configurations for TaskManager

2023-01-03 Thread Yuxin Tan
Hi all, Thanks for all the feedback so far. Based on the discussion[1], we have come to a consensus, so I would like to start a vote on FLIP-266: Simplify network memory configurations for TaskManager[2]. The vote will last for at least 72 hours (Jan 6th at 11:00 GMT) unless there is an

Re: [DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

2023-01-02 Thread Yuxin Tan
Hi all, Thanks for all the feedback so far. The discussion has been going on for some time. If there are no more new comments, we will start a vote today. Best, Yuxin Yuxin Tan 于2022年12月29日周四 17:37写道: > Hi, everyone > > Thanks for the reply and the discussion. > &g

Re: [DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

2022-12-29 Thread Yuxin Tan
method. - When the memory used reaches the threshold, the number of exclusive buffers is gradually reduced in a fine-grained manner, rather than directly reducing the number of exclusive buffers to 0. Best, Yuxin Yuxin Tan 于2022年12月29日周四 14:48写道: > Hi, Roman > > Sorry about that I m

Re: [DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

2022-12-28 Thread Yuxin Tan
a reasonable value, but I have a small > > problem. network memory is not only related to the parallelism of the > task, > > but also to the complexity of the task DAG. The more complex a DAG is, > > shuffle write and shuffle read require larger buffers. How can we > dete

Re: [DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

2022-12-28 Thread Yuxin Tan
value, but I have a small > > problem. network memory is not only related to the parallelism of the > task, > > but also to the complexity of the task DAG. The more complex a DAG is, > > shuffle write and shuffle read require larger buffers. How can we > determine > > how ma

Re: [DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

2022-12-28 Thread Yuxin Tan
uffle write and shuffle read require larger buffers. How can we determine > how many RS and IG a DAG has? > > > > Best > JasonLee > > > Replied Message > | From | Yuxin Tan | > | Date | 12/28/2022 18:29 | > | To | | > | Subject | Re: [DISCUSS] F

Re: [DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

2022-12-28 Thread Yuxin Tan
f shuffles will likely result in using > exclusive buffers > for point-wise connections and floating buffers for all-to-all ones. I'm > not sure if that's always optimal. It would be great to have experimental > results for jobs with different exchange types, WDYT? > > [1] &

Re: [DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

2022-12-26 Thread Yuxin Tan
gt; to control maximum read network buffer usage. > Do we really need to change the default value of > 'taskmanager.memory.network.max'? > > Best, > Weihua > > > On Mon, Dec 26, 2022 at 6:26 PM Yuxin Tan wrote: > > > Hi, all > > Thanks for the reply and feedback for everyone! >

Re: [DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

2022-12-26 Thread Yuxin Tan
t might be helpful to add a dedicated public interface > section > > > to describe the config key and config semantics, as suggested in the > FLIP > > > template here > > > < > > > > https://cwiki.apache.org/confluence/display/FLINK/Flink+Imp

[jira] [Created] (FLINK-30473) Optimize the InputGate network memory management for TaskManager

2022-12-21 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-30473: - Summary: Optimize the InputGate network memory management for TaskManager Key: FLINK-30473 URL: https://issues.apache.org/jira/browse/FLINK-30473 Project: Flink

[jira] [Created] (FLINK-30472) Modify the default value of the max network memory config option

2022-12-21 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-30472: - Summary: Modify the default value of the max network memory config option Key: FLINK-30472 URL: https://issues.apache.org/jira/browse/FLINK-30472 Project: Flink

[jira] [Created] (FLINK-30471) Optimize the enriching network memory process in SsgNetworkMemoryCalculationUtils

2022-12-21 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-30471: - Summary: Optimize the enriching network memory process in SsgNetworkMemoryCalculationUtils Key: FLINK-30471 URL: https://issues.apache.org/jira/browse/FLINK-30471 Project

[jira] [Created] (FLINK-30469) FLIP-266: Simplify network memory configurations for TaskManager

2022-12-20 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-30469: - Summary: FLIP-266: Simplify network memory configurations for TaskManager Key: FLINK-30469 URL: https://issues.apache.org/jira/browse/FLINK-30469 Project: Flink

[DISCUSS] FLIP-266: Simplify network memory configurations for TaskManager

2022-12-18 Thread Yuxin Tan
Hi, devs, I'd like to start a discussion about FLIP-266: Simplify network memory configurations for TaskManager[1]. When using Flink, users may encounter the following issues that affect usability. 1. The job may fail with an "Insufficient number of network buffers" exception. 2. Flink network

Re: Need right

2022-12-06 Thread Yuxin Tan
Hi, Stan You could get more contribution details here. [1] Thanks and looking forward to your contribution! [1] https://flink.apache.org/contributing/how-to-contribute.html Best, Yuxin Martijn Visser 于2022年12月5日周一 14:21写道: > Hi, > > There is no need for additional permissions: you can start

Re: [ANNOUNCE] New Apache Flink PMC Member - Danny Cranmer

2022-11-01 Thread Yuxin Tan
Congrats, Danny! Best, Yuxin Guowei Ma 于2022年11月1日周二 16:36写道: > Congratulations Danny! > Best, > Guowei > > > On Tue, Nov 1, 2022 at 2:20 PM weijie guo > wrote: > > > Congratulations Danny! > > > > Best regards, > > > > Weijie > > > > > > Maximilian Michels 于2022年10月13日周四 21:41写道: > > > > >

Re: [ANNOUNCE] Apache Flink 1.16.0 released

2022-10-30 Thread Yuxin Tan
Congrats! Glad to hear that. Best, Yuxin weijie guo 于2022年10月31日周一 11:51写道: > Congratulations, this is a version with many new features and thanks to > everyone involved! > > Best regards, > > Weijie > > > Yun Tang 于2022年10月31日周一 11:32写道: > > > Congratulations, and thanks to everyone

[jira] [Created] (FLINK-29329) Checkpoint can not be triggered if encountering OOM

2022-09-18 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-29329: - Summary: Checkpoint can not be triggered if encountering OOM Key: FLINK-29329 URL: https://issues.apache.org/jira/browse/FLINK-29329 Project: Flink Issue Type

Re: [ANNOUNCE] New Apache Flink Committer - Caizhi Weng

2022-09-08 Thread Yuxin Tan
Caizhi, Congratulations! Best, Yuxin Jane Chan 于2022年9月9日周五 10:09写道: > Congrats Caizhi > > Best, > Jane > > On Fri, Sep 9, 2022 at 9:58 AM Xingbo Huang wrote: > > > Congratulations Caizhi > > > > Best, > > Xingbo > > > > Jingsong Lee 于2022年9月9日周五 09:41写道: > > > > > Hi everyone, > > > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Lijie Wang

2022-08-17 Thread Yuxin Tan
Congratulations, Lijie! Best, Yuxin Guowei Ma 于2022年8月17日周三 18:42写道: > Congratulations, Lijie. Welcome on board~! > Best, > Guowei > > > On Wed, Aug 17, 2022 at 6:25 PM Zhu Zhu wrote: > > > Hi everyone, > > > > On behalf of the PMC, I'm very happy to announce Lijie Wang as > > a new Flink

[jira] [Created] (FLINK-28942) Deadlock may occurs when releasing readers for SortMergeResultPartition

2022-08-11 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-28942: - Summary: Deadlock may occurs when releasing readers for SortMergeResultPartition Key: FLINK-28942 URL: https://issues.apache.org/jira/browse/FLINK-28942 Project: Flink

[jira] [Created] (FLINK-28828) Sorting all unfinished readers in batches at one time in SortMergeResultPartitionReadScheduler

2022-08-05 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-28828: - Summary: Sorting all unfinished readers in batches at one time in SortMergeResultPartitionReadScheduler Key: FLINK-28828 URL: https://issues.apache.org/jira/browse/FLINK-28828

[jira] [Created] (FLINK-28826) Avoid notifying too frequently when recycling buffers for BatchShuffleReadBufferPool

2022-08-05 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-28826: - Summary: Avoid notifying too frequently when recycling buffers for BatchShuffleReadBufferPool Key: FLINK-28826 URL: https://issues.apache.org/jira/browse/FLINK-28826

[jira] [Created] (FLINK-28823) Enlarge the max requested buffers for SortMergeResultPartitionReadScheduler

2022-08-05 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-28823: - Summary: Enlarge the max requested buffers for SortMergeResultPartitionReadScheduler Key: FLINK-28823 URL: https://issues.apache.org/jira/browse/FLINK-28823 Project: Flink

[jira] [Created] (FLINK-28446) Expose more information in PartitionDescriptor to support more optimized Shuffle Service

2022-07-07 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-28446: - Summary: Expose more information in PartitionDescriptor to support more optimized Shuffle Service Key: FLINK-28446 URL: https://issues.apache.org/jira/browse/FLINK-28446

Re: [ANNOUNCE] New PMC member: Yuan Mei

2022-03-15 Thread Yuxin Tan
Congratulations, Yuan! Best, Yuxin Yang Wang 于2022年3月15日周二 15:00写道: > Congratulations, Yuan! > > Best, > Yang > > Lincoln Lee 于2022年3月15日周二 13:32写道: > > > Congratulations, Yuan! > > > > Best, > > Lincoln Lee > > > > > > godfrey he 于2022年3月15日周二 09:53写道: > > > > > Congratulations, Yuan! > > >

<    1   2