[GitHub] [incubator-uniffle] jerqi closed issue #240: Flaky test GetShuffleReportForMultiPartTest

2022-09-23 Thread GitBox
jerqi closed issue #240: Flaky test GetShuffleReportForMultiPartTest URL: https://github.com/apache/incubator-uniffle/issues/240 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [incubator-uniffle] leixm commented on issue #240: Flaky test GetShuffleReportForMultiPartTest

2022-09-23 Thread GitBox
leixm commented on issue #240: URL: https://github.com/apache/incubator-uniffle/issues/240#issuecomment-1256076248 I will follow up on this. @jerqi -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [incubator-uniffle] jerqi commented on issue #196: Flaky test ShuffleFlushManagerOnKerberizedHdfsTest

2022-09-23 Thread GitBox
jerqi commented on issue #196: URL: https://github.com/apache/incubator-uniffle/issues/196#issuecomment-1256062111 > The stacktrace is as follow > > ``` > 2022-09-01 07:31:40,131 ERROR [FlushEventThreadPool] server.ShuffleFlushManager (ShuffleFlushManager.java:flushToFile(209)) -

[GitHub] [incubator-uniffle] jerqi opened a new issue, #240: Flaky test

2022-09-23 Thread GitBox
jerqi opened a new issue, #240: URL: https://github.com/apache/incubator-uniffle/issues/240 The test is still flaky org.apache.uniffle.test.GetShuffleReportForMultiPartTest https://github.com/apache/incubator-uniffle/actions/runs/3111709653/jobs/5044305025 @leixm Could you take a l

Re: [ANNOUNCE] New committer: Junfan Zhang

2022-09-23 Thread Zhifang Li
Congratulations, and Welcome to join ! zf li On 2022/09/23 08:46:56 roryqi wrote: > The Project Management Committee (PMC) *for* Apache Uniffle (incubating) > has asked Junfan Zhang to become a committer and we are pleased to announce > that he has accepted. > > > > > Junfan Zhang has been co

Re: [ANNOUNCE] New committer: Junfan Zhang

2022-09-23 Thread Kaijie Chen
Congrats! Best, Kaijie

[GitHub] [incubator-uniffle] leixm commented on issue #239: [Problem] RssUtils#transIndexDataToSegments should consider the length of the data file

2022-09-23 Thread GitBox
leixm commented on issue #239: URL: https://github.com/apache/incubator-uniffle/issues/239#issuecomment-1255953708 > > You are right, we need to know how much data can be read before HdfsFileReader#read, and then read the corresponding data through HdfsFileReader#read, but how much data ca

[ANNOUNCE] New committer: Junfan Zhang

2022-09-23 Thread roryqi
The Project Management Committee (PMC) *for* Apache Uniffle (incubating) has asked Junfan Zhang to become a committer and we are pleased to announce that he has accepted. Junfan Zhang has been contributing to the Uniffle for several months and has authored 40+ prs. He is responsible for the sup

[GitHub] [incubator-uniffle] jerqi commented on issue #239: [Problem] RssUtils#transIndexDataToSegments should consider the length of the data file

2022-09-23 Thread GitBox
jerqi commented on issue #239: URL: https://github.com/apache/incubator-uniffle/issues/239#issuecomment-1255936097 > You are right, we need to know how much data can be read before HdfsFileReader#read, and then read the corresponding data through HdfsFileReader#read, but how much data can

[GitHub] [incubator-uniffle] jerqi commented on issue #239: [Problem] RssUtils#transIndexDataToSegments should consider the length of the data file

2022-09-23 Thread GitBox
jerqi commented on issue #239: URL: https://github.com/apache/incubator-uniffle/issues/239#issuecomment-1255935159 Maybe local file will occur this similar problems. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [incubator-uniffle] leixm commented on issue #239: [Problem] RssUtils#transIndexDataToSegments should consider the length of the data file

2022-09-23 Thread GitBox
leixm commented on issue #239: URL: https://github.com/apache/incubator-uniffle/issues/239#issuecomment-1255896557 > @leixm Thanks for your explanation, got your thought. > > Could we directly get the expected data in `HdfsFileReader.read()` by analyzing the file size and required le

[GitHub] [incubator-uniffle] leixm commented on issue #239: [Problem] RssUtils#transIndexDataToSegments should consider the length of the data file

2022-09-23 Thread GitBox
leixm commented on issue #239: URL: https://github.com/apache/incubator-uniffle/issues/239#issuecomment-1255893604 You are right, we need to know how much data can be read before HdfsFileReader#read, and then read the corresponding data through HdfsFileReader#read, but how much data can be