> Regards,
> Keyong Zhou
>
> Mridul Muralidharan 于2024年5月3日周五 23:38写道：
>
> > Hi,
> >
> > I meant call it out as part of the board report, so that it is captured
> > in our updates to board.
> >
> > This is the first update post TLP, right ?
> &
doJW-f3BZAvxciDbI3mTw
> <https://mp.weixin.qq.com/s/DdoJW-f3BZAvxciDbI3mTw>
>
> It'll be great if we can call out louder, do you have any idea? : )
>
> Regards,
> Keyong Zhou
>
> Mridul Muralidharan 于2024年5月3日周五 07:40写道：
>
> > Hi,
> >
> > Do we want to call o
ct graduated recently).
> - Chandni Singh was added as committer on 2024-03-21.
> - Mridul Muralidharan was added as committer on 2024-04-29.
>
> ## Project Activity:
> Software development activity:
>
> - We are preparing to release 0.4.1 in May.
> - We are preparing to r
r 29, 2024, at 09:21, Keyong Zhou wrote:
> > >
> > > Hi Celeborn Community,
> > >
> > > The Project Management Committee (PMC) for Apache Celeborn
> > > has invited Mridul Muralidharan to become a committer and we are
> pleased
> > > to announ
r 29, 2024, at 09:21, Keyong Zhou wrote:
> > >
> > > Hi Celeborn Community,
> > >
> > > The Project Management Committee (PMC) for Apache Celeborn
> > > has invited Mridul Muralidharan to become a committer and we are
> pleased
> > > to announ
[
https://issues.apache.org/jira/browse/SPARK-47919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan updated SPARK-47919:
Priority: Minor (was: Major)
> credulousTrustStoreManagers should return em
Mridul Muralidharan created SPARK-47919:
---
Summary: credulousTrustStoreManagers should return empty array for
accepted issuers
Key: SPARK-47919
URL: https://issues.apache.org/jira/browse/SPARK-47919
+1
Regards,
Mridul
On Thu, Apr 18, 2024 at 11:50 PM Ethan Feng wrote:
> +1
>
> Thanks,
> Ethan Feng
>
> Yu Li 于2024年4月16日周二 17:20写道：
> >
> > +1, thanks for driving this and volunteering as our RM, Nicholas!
> >
> > Best Regards,
> > Yu
> >
> > On Sat, 13 Apr 2024 at 10:31, Keyong Zhou
[
https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838474#comment-17838474
]
Mridul Muralidharan edited comment on SPARK-47172 at 4/18/24 5:47 AM
[
https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17838474#comment-17838474
]
Mridul Muralidharan commented on SPARK-47172:
-
We do not backport features to released
[
https://issues.apache.org/jira/browse/SPARK-47172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17837927#comment-17837927
]
Mridul Muralidharan commented on SPARK-47172:
-
Given we have addressed SPARK-47318
+1
Signatures, digests, etc check out fine.
Checked out tag and build/tested with -Phive -Pyarn -Pkubernetes
Regards,
Mridul
On Sun, Apr 14, 2024 at 11:31 PM Dongjoon Hyun wrote:
> I'll start with my +1.
>
> - Checked checksum and signature
> - Checked Scala/Java/R/Python/SQL Document's
[
https://issues.apache.org/jira/browse/SPARK-47253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-47253:
---
Assignee: TakawaAkirayo
> Allow LiveEventBus to stop with
[
https://issues.apache.org/jira/browse/SPARK-47253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-47253.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-47318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan updated SPARK-47318:
Affects Version/s: 3.5.0
3.4.0
> AuthEngine key excha
[
https://issues.apache.org/jira/browse/SPARK-47318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-47318.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835587#comment-17835587
]
Mridul Muralidharan edited comment on SPARK-47759 at 4/10/24 4:08 AM
[
https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835587#comment-17835587
]
Mridul Muralidharan edited comment on SPARK-47759 at 4/10/24 4:08 AM
[
https://issues.apache.org/jira/browse/SPARK-47759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835587#comment-17835587
]
Mridul Muralidharan commented on SPARK-47759:
-
In order to validate, I would suggest two
I am trying to understand if we can simply align with Spark's version for
this ?
Makes the release and jira management much more simpler for developers and
intuitive for users.
Regards,
Mridul
On Tue, Apr 9, 2024 at 10:09 AM Dongjoon Hyun wrote:
> Hi, Liang-Chi.
>
> Thank you for leading
Hi Dongjoon,
Thanks for volunteering !
I would suggest to wait for SPARK-47318 to be merged as well for 3.4
Regards,
Mridul
On Sat, Apr 6, 2024 at 6:49 PM Dongjoon Hyun
wrote:
> Hi, All.
>
> Apache Spark 3.4.2 tag was created on Nov 24th and `branch-3.4` has 85
> commits including important
---
>>> *From:* Denny Lee
>>> *Sent:* Monday, April 1, 2024 10:06:14 AM
>>> *To:* Hussein Awala
>>> *Cc:* Chao Sun ; Hyukjin Kwon ;
>>> Mridul Muralidharan ; dev
>>> *Subject:* Re: [VOTE] SPIP: Pure Python Package in PyPI (Spark Connect)
Can you point me to the SPIP’s discussion thread please ?
I was not able to find it, but I was on vacation, and so might have missed
this …
Regards,
Mridul
On Sun, Mar 31, 2024 at 9:08 PM Haejoon Lee
wrote:
> +1
>
> On Mon, Apr 1, 2024 at 10:15 AM Hyukjin Kwon wrote:
>
>> Hi all,
>>
>> I'd
Congratulations !!
Regards,
Mridul
On Tue, Mar 26, 2024 at 11:54 PM Nicholas Jiang
wrote:
> Congratulations! Witness the continuous development of the
> community.Regards,
> Nicholas Jiang
> At 2024-03-25 20:49:36, "Ethan Feng" wrote:
> >Hello Celeborn community,
> >
> >I am glad to share
al information, JDK version, etc.
>
> Regards,
> Ethan Feng
>
> Mridul Muralidharan 于2024年3月21日周四 15:25写道：
> >
> > Hi,
> >
> >
> > I am observing that a maven build gets 'stuck' when compiling
> "services"
> > for running tests.
>
Congratulations Chandni ! Great job :-)
Regards,
Mridul
On Thu, Mar 21, 2024 at 3:30 AM Keyong Zhou wrote:
> Hi Celeborn Community,
>
> The Podling Project Management Committee (PPMC) for Apache Celeborn
> has invited Chandni Singh to become a committer and we are pleased
> to announce that
Congratulations Chandni ! Great job :-)
Regards,
Mridul
On Thu, Mar 21, 2024 at 3:30 AM Keyong Zhou wrote:
> Hi Celeborn Community,
>
> The Podling Project Management Committee (PPMC) for Apache Celeborn
> has invited Chandni Singh to become a committer and we are pleased
> to announce that
Hi,
I am observing that a maven build gets 'stuck' when compiling "services"
for running tests.
Without tests, this goes through:
$ ARGS="-Pspark-3.1"; ./build/mvn $ARGS clean 2>&1 | tee clean_output.txt
&& ./build/mvn -DskipTests $ARGS package 2>&1 | tee build_output.txt
This gets stuck
[
https://issues.apache.org/jira/browse/SPARK-45375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-45375:
---
Assignee: Hasnain Lakhani
> [CORE] Mark connection as timed
[
https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828087#comment-17828087
]
Mridul Muralidharan edited comment on SPARK-45374 at 3/18/24 8:28 PM
[
https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-45374:
---
Assignee: Hasnain Lakhani
> [CORE] Add test keys for SSL functional
[
https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828087#comment-17828087
]
Mridul Muralidharan edited comment on SPARK-45374 at 3/18/24 8:05 PM
[
https://issues.apache.org/jira/browse/SPARK-45374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828087#comment-17828087
]
Mridul Muralidharan commented on SPARK-45374:
-
Missed your query, you can link by:
"
are some
> open discussion threads on the doc you shared.
>
> @Mridul Muralidharan In what state are your efforts
> along this? Is it something that your team is actively pursuing/ building
> or are mostly planning right now? Asking so that we can align efforts on
> this.
>
&
I am supportive of the proposal - this is a step in the right direction !
Additional metadata (explicit and inferred) for log records, and exposing
them for indexing is extremely useful.
The specifics of the API still need some work IMO and does not need to be
this disruptive, but I consider
[
https://issues.apache.org/jira/browse/SPARK-47146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan updated SPARK-47146:
Fix Version/s: 3.5.2
3.4.3
> Possible thread leak when do
[
https://issues.apache.org/jira/browse/SPARK-47146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17823832#comment-17823832
]
Mridul Muralidharan commented on SPARK-47146:
-
Backported to 3.5 and 3.4 in PR: https
[
https://issues.apache.org/jira/browse/SPARK-47146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-47146:
---
Assignee: JacobZheng
> Possible thread leak when doing sort merge j
[
https://issues.apache.org/jira/browse/SPARK-47146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-47146.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
Hi Gengling,
Thanks for sharing this !
I added a few queries to the proposal doc, and we can continue discussing
there, but overall I am in favor of this.
Regards,
Mridul
On Fri, Mar 1, 2024 at 1:35 AM Gengliang Wang wrote:
> Hi All,
>
> I propose to enhance our logging system by
+1
Regards,
Mridul
On Fri, Mar 1, 2024 at 4:35 AM Nicholas wrote:
>
> +1.
>
>
> Regards,
> Nicholas Jiang
>
>
>
>
> --
> 发自我的网易邮箱手机智能版
>
>
>
> - Original Message -
> From: "Yu Li"
> To: dev@celeborn.apache.org
> Sent: Fri, 1 Mar 2024 16:52:10 +0800
> Subject: [VOTE] Graduate Apache
+1
Looking forward to Celeborn as a TLP !
Best wishes to the community :-)
Regards,
Mridul
On Tue, Feb 27, 2024 at 5:23 AM Willem Jiang wrote:
> Thanks for the clarification. Now we are good to go.
>
> Willem Jiang
>
>
>
> On Tue, Feb 27, 2024 at 7:15 PM Keyong Zhou wrote:
> >
> > Thanks
Congratulations !
Regards,
Mridul
On Mon, Feb 19, 2024 at 7:46 PM Cheng Pan wrote:
> Congrats!
>
> Thanks,
> Cheng Pan
>
>
> > On Feb 20, 2024, at 08:22, Nicholas wrote:
> >
> > Congratulations to Fu Chen!Regards,
> > Nicholas Jiang
> >
> >
> >
> >
> > At 2024-02-20 00:23:06, "Shaoyun Chen"
to choose JIRA at last. Seems
> different projects have different preferences. Maybe
> newer projects tends to use Github.
>
> To me, I'm actually fine with both. JIRA works well so far, will using
> Github be more beneficial? Glad to hear about your opinion.
>
> Thanks,
>
Looks like I am wrong, github issues can be used [1].
Is Celeborn planning to use github issues going forward ?
Regards,
Mridul
[1] https://www.apache.org/dev/#issues
On Wed, Feb 7, 2024 at 12:00 AM Mridul Muralidharan
wrote:
> Hi,
>
> I received a fairly large number
Hi,
I received a fairly large number of emails to
incubator-celeb...@noreply.github.com, which typically are for PR's.
They appear to be github issues - are we trying to move to github issues
instead of Apache jira ? IIRC there is a policy to use jira for tracking
bugs/improvements, right ?
[
https://issues.apache.org/jira/browse/SPARK-46512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-46512.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-46512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-46512:
---
Assignee: Chenyu Zheng
> Optimize shuffle reading when both s
[
https://issues.apache.org/jira/browse/SPARK-46733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-46733:
---
Assignee: Jiaan Geng
> Simplify the ContextCleaner|BlockMana
[
https://issues.apache.org/jira/browse/SPARK-46733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-46733.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-46623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17808080#comment-17808080
]
Mridul Muralidharan commented on SPARK-46623:
-
Issue resolved by pull request 44616
https
[
https://issues.apache.org/jira/browse/SPARK-46623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-46623.
-
Fix Version/s: 4.0.0
Assignee: Jiaan Geng
Resolution: Fixed
[
https://issues.apache.org/jira/browse/SPARK-46696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-46696.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-46696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-46696:
---
Assignee: liangyongyuan
> In ResourceProfileManager, function calls sho
Hi,
We are internally exploring adding support for dynamically changing the
resource profile of a stage based on runtime characteristics.
This includes failures due to OOM and the like, slowness due to excessive
GC, resource wastage due to excessive overprovisioning, etc.
Essentially handles
[
https://issues.apache.org/jira/browse/SPARK-46399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-46399:
---
Assignee: Reza Safi
> Add exit status to the Application End ev
[
https://issues.apache.org/jira/browse/SPARK-46399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-46399.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
+1
Signatures, digests, license, etc check out fine.
Checked out tag and build/tested with -Pspark3.1 and -Pflink-1.17
Regards,
Mridul
On Tue, Dec 19, 2023 at 8:06 PM rexxiong wrote:
> +1 (binding)
> I checked
> - Download links are valid.
> - git commit hash is correct
> - Checksums and
[
https://issues.apache.org/jira/browse/SPARK-46132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-46132.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-46132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-46132:
---
Assignee: Hasnain Lakhani
> [CORE] Support key password for JKS k
I am seeing a bunch of python related (43) failures in the sql module (for
example [1]) ... I am currently on Python 3.11.6, java 8.
Not sure if ubuntu modified anything from under me, thoughts ?
I am currently testing this against an older branch to make sure it is not
an issue with my desktop.
+1 on 0.3.2, thanks Nicholas !
Regards,
Mridul
On Thu, Dec 7, 2023 at 12:51 AM Cheng Pan wrote:
> +1, thanks for volunteering.
>
> Feel free to ping me if you encounter permission issues during the release
> phase.
>
> Thanks,
> Cheng Pan
>
>
> > On Dec 7, 2023, at 14:31, Nicholas wrote:
> >
[
https://issues.apache.org/jira/browse/SPARK-46058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan updated SPARK-46058:
Labels: pull-request-available (was: pull-request-available releasenotes
[
https://issues.apache.org/jira/browse/SPARK-46058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan updated SPARK-46058:
Labels: pull-request-available releasenotes (was: pull-request-available
[
https://issues.apache.org/jira/browse/SPARK-46058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-46058.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-46058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-46058:
---
Assignee: Hasnain Lakhani
> [CORE] Add separate f
+1
Regards,
Mridul
On Mon, Dec 4, 2023 at 11:40 AM L. C. Hsieh wrote:
> +1
>
> Thanks Dongjoon!
>
> On Mon, Dec 4, 2023 at 9:26 AM Yang Jie wrote:
> >
> > +1 for a 3.3.4 EOL Release. Thanks Dongjoon.
> >
> > Jie Yang
> >
> > On 2023/12/04 15:08:25 Tom Graves wrote:
> > > +1 for a 3.3.4 EOL
+1
Signatures, digests, etc check out fine.
Checked out tag and build/tested with -Phive -Pyarn -Pmesos -Pkubernetes
Regards,
Mridul
On Wed, Nov 29, 2023 at 5:08 AM Yang Jie wrote:
> +1(non-binding)
>
> Jie Yang
>
> On 2023/11/29 02:08:04 Kent Yao wrote:
> > +1(non-binding)
> >
> > Kent Yao
>
+1
Regards,
Mridul
On Fri, Nov 24, 2023 at 8:21 AM Kent Yao wrote:
> Hi Spark Dev,
>
> Following the discussion [1], I'd like to start the vote for the SPIP [2].
>
> The SPIP aims to improve the test coverage and develop experience for
> Spark UI-related javascript codes.
>
> This thread will
Congratulations Yihe Li !
Regards,
Mridul
On Wed, Nov 22, 2023 at 2:08 AM Yu Li wrote:
> Congratulations, Yihe!
>
> Best Regards,
> Yu
>
>
> On Fri, 17 Nov 2023 at 15:32, Shaoyun Chen wrote:
>
> > Congrats!
> >
> > Keyong Zhou 于2023年11月16日周四 20:25写道：
> > >
> > > Hi Celeborn Community,
> > >
This should be a very good addition !
Regards,
Mridul
On Tue, Nov 21, 2023 at 7:46 PM Dongjoon Hyun
wrote:
> Thank you for proposing a new UI test framework for Apache Spark 4.0.
>
> It looks very useful.
>
> Thanks,
> Dongjoon.
>
>
> On Tue, Nov 21, 2023 at 1:51 AM Kent Yao wrote:
>
>> Hi
[
https://issues.apache.org/jira/browse/SPARK-45762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-45762:
---
Assignee: Alessandro Bellina
> Shuffle managers defined in user j
[
https://issues.apache.org/jira/browse/SPARK-45762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-45762.
-
Resolution: Fixed
Issue resolved by pull request 43627
[https://github.com
[
https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786077#comment-17786077
]
Mridul Muralidharan edited comment on SPARK-30602 at 11/14/23 8:50 PM
[
https://issues.apache.org/jira/browse/SPARK-30602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786077#comment-17786077
]
Mridul Muralidharan commented on SPARK-30602:
-
@MasterDDT, currently there is no active
+1
Regards,
Mridul
On Tue, Nov 14, 2023 at 12:45 PM Holden Karau wrote:
> +1
>
> On Tue, Nov 14, 2023 at 10:21 AM DB Tsai wrote:
>
>> +1
>>
>> DB Tsai | https://www.dbtsai.com/ | PGP 42E5B25A8F7A82C1
>>
>> On Nov 14, 2023, at 10:14 AM, Vakaris Baškirov <
>> vakaris.bashki...@gmail.com>
[
https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786076#comment-17786076
]
Mridul Muralidharan commented on SPARK-44937:
-
Thanks [~dongjoon] ! Missed out
[
https://issues.apache.org/jira/browse/SPARK-45911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-45911:
---
Assignee: Hasnain Lakhani
> [CORE] Make TLS1.3 the default for RPC
[
https://issues.apache.org/jira/browse/SPARK-45911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-45911.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan updated SPARK-44937:
Epic Name: ssl/tls for rpc and shuffle
> [umbrella] Add SSL/TLS support for
[
https://issues.apache.org/jira/browse/SPARK-44937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-44937.
-
Fix Version/s: (was: 3.4.2)
(was: 3.5.1
[
https://issues.apache.org/jira/browse/SPARK-45431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-45431.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-45431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-45431:
---
Assignee: Hasnain Lakhani
> [DOCS] Document SSL RPC feat
apAndMergeOutput
> > if the current ShuffleMapStage is Indeterminate. What if the current
> stage
> > is determinate, but its
> > upstream stage is Indeterminate, and its upstream stage is rerun?
> >
> > Thanks,
> > Keyong Zhou
> >
> > Mridul Muralidharan 于
[
https://issues.apache.org/jira/browse/SPARK-45730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-45730:
---
Assignee: Hasnain Lakhani
> [CORE] Make ReloadingX509TrustManagerSu
[
https://issues.apache.org/jira/browse/SPARK-45730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-45730.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-45544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-45544.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-45544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-45544:
---
Assignee: Hasnain Lakhani
> [CORE] Integrate SSL supp
[
https://issues.apache.org/jira/browse/SPARK-45545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-45545:
---
Assignee: Hasnain Lakhani
> [CORE] Pass SSLOptions wherever we cre
[
https://issues.apache.org/jira/browse/SPARK-45545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-45545.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-45541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-45541.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
, and then retry
these stages (same shuffle-id, a new stage attempt)
Regards,
Mridul
On Thu, Oct 19, 2023 at 10:08 PM Mridul Muralidharan
wrote:
>
> Good question, and ResultStage is actually special cased in spark as its
> output could have already been consumed (for example collect()
E ShuffleMapStage got entirely recomputed, the
> >> corresponding ResultStage should be entirely recomputed as well, per my
> >> understanding
> >>
> >> I found https://issues.apache.org/jira/browse/SPARK-25342 to rollback a
> >> ResultStage but it was not merged
>
Mridul Muralidharan created SPARK-45613:
---
Summary: Expose DeterministicLevel as a DeveloperApi
Key: SPARK-45613
URL: https://issues.apache.org/jira/browse/SPARK-45613
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-45534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-45534.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
[
https://issues.apache.org/jira/browse/SPARK-45534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-45534:
---
Assignee: Min Zhao
> Use `java.lang.ref.Cleaner` instead of `final
[
https://issues.apache.org/jira/browse/SPARK-45576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan reassigned SPARK-45576:
---
Assignee: Hasnain Lakhani
> [CORE] Remove unnecessary debug l
[
https://issues.apache.org/jira/browse/SPARK-45576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mridul Muralidharan resolved SPARK-45576.
-
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request
ompute and
> remaining shuffle data needs a lot of work to do in Celeborn
> I prefer to implement a simple whole stage recompute first with interface
> defined with recomputeAll = true flag, and explore partial stage recompute
> in seperate ticket as future optimization
> How do you th
With push based shuffle in Apache Spark (magnet), we have both the map
output and reducer orientated merged output preserved - with reducer
oriented view chosen by default for reads and fallback to mapper output
when reducer output is missing/failures. That mitigates this specific issue
for
1 - 100 of 1225 matches
Mail list logo
