Re: [DISCUSS] Apache Spark 3.0.1 Release

Hi Jason, Thanks for reporting! https://issues.apache.org/jira/browse/SPARK-32136 looks like a breaking change and we should investigate. On Wed, Jul 1, 2020 at 11:31 AM Holden Karau wrote: > I can take care of 2.4.7 unless someone else wants to do it. > > On Tue, Jun 30, 2020 at 8:29 PM Jason

Re: [Spark Core] Merging PR #23340 for New Executor Memory Metrics

Thank you! I just reached out to the original author and we'll get the conflicts sorted out amongst us, I'm sure. Thanks again, -Alex From: Dongjoon Hyun Sent: Tuesday, June 30, 2020 9:01 PM To: Alex Scammon Cc: Michel Sumbul ; dev@spark.apache.org Subject:

Re: [Spark Core] Merging PR #23340 for New Executor Memory Metrics

HI, Alex and Michel. I removed the `Stale` label and reopened it for now. You may want to ping the original author because the last update of that PR is one year ago and has many conflicts as of today. Bests, Dongjoon. On Tue, Jun 30, 2020 at 10:56 AM Alex Scammon <

Re: [DISCUSS] Apache Spark 3.0.1 Release

I can take care of 2.4.7 unless someone else wants to do it. On Tue, Jun 30, 2020 at 8:29 PM Jason Moore wrote: > Hi all, > > > > Could I get some input on the severity of this one that I found > yesterday? If that’s a correctness issue, should it block this patch? Let > me know under the

Re: [DISCUSS] Apache Spark 3.0.1 Release

Hi all, Could I get some input on the severity of this one that I found yesterday? If that’s a correctness issue, should it block this patch? Let me know under the ticket if there’s more info that I can provide to help. https://issues.apache.org/jira/browse/SPARK-32136 Thanks, Jason. From:

Re: [DISCUSS] Apache Spark 3.0.1 Release

SPARK-32130 [1] looks to be a performance regression introduced in Spark 3.0.0, which is ideal to look into before releasing another bugfix version. 1. https://issues.apache.org/jira/browse/SPARK-32130 On Wed, Jul 1, 2020 at 7:05 AM Shivaram Venkataraman < shiva...@eecs.berkeley.edu> wrote: >

Re: [DISCUSS] Apache Spark 3.0.1 Release

Hi all I just wanted to ping this thread to see if all the outstanding blockers for 3.0.1 have been fixed. If so, it would be great if we can get the release going. The CRAN team sent us a note that the version SparkR available on CRAN for the current R version (4.0.2) is broken and hence we need

Re: [Spark Core] Merging PR #23340 for New Executor Memory Metrics

Can I buymeacoffee.com for someone to take a look at PR#23340? I'm totally not above outright bribery to get some eyes on this PR. Thanks, -Alex From: Michel Sumbul Sent: Thursday, June 25, 2020 11:48 AM To:

Re: Apache Spark 3.1 Feature Expectation (Dec. 2020)

Stage Level Scheduling -  https://issues.apache.org/jira/browse/SPARK-27495 TomOn Monday, June 29, 2020, 11:07:18 AM CDT, Dongjoon Hyun wrote: Hi, All. After a short celebration of Apache Spark 3.0, I'd like to ask you the community opinion on Apache Spark 3.1 feature expectations.

Re: Spark 3 pod template for the driver

Hi Edeesis, The goal is to not have these settings in the spark submit command. If I specify the same things in a pod template for the executor, I still got the message: "Exception in thread "main" org.apache.spark.SparkException "Must specify the driver container image" it even don't try to

Re: Contribute to Apache Spark

Hi, Thanks for your interest! Please read the contribution guide first: https://spark.apache.org/contributing.html We don't have such a permission and you can file issues in Jira by yourself, then make a PR for them. Enjoy your work! On Tue, Jun 30, 2020 at 2:34 PM 飘鹅玉雪 <397189...@qq.com>