[spark] branch branch-3.0 updated: [SPARK-31860][BUILD] only push release tags on succes

2020-06-02 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new b814cbc [SPARK-31860][BUILD] only push

[spark] branch master updated: [SPARK-31860][BUILD] only push release tags on succes

2020-06-02 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 69ba9b6 [SPARK-31860][BUILD] only push release

[spark] branch branch-2.4 updated: [SPARK-31860][BUILD][2.4] only push release tags on success

2020-06-01 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new bf01280 [SPARK-31860][BUILD][2.4] only

[jira] [Updated] (SPARK-31890) Decommissioning Test Does not wait long enough for executors to launch

2020-06-01 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31890: - Affects Version/s: (was: 3.0.1) (was: 3.0.0) > Decommission

[jira] [Created] (SPARK-31890) Decommissioning Test Does not wait long enough for executors to launch

2020-06-01 Thread Holden Karau (Jira)
Holden Karau created SPARK-31890: Summary: Decommissioning Test Does not wait long enough for executors to launch Key: SPARK-31890 URL: https://issues.apache.org/jira/browse/SPARK-31890 Project

[jira] [Resolved] (SPARK-31889) Docker release script does not allocate enough memory to reliably publish

2020-06-01 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31889. -- Fix Version/s: 2.4.7 3.1.0 3.0.1

[spark] branch branch-2.4 updated: [SPARK-31889][BUILD] Docker release script does not allocate enough memory to reliably publish

2020-06-01 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new ac59a8c [SPARK-31889][BUILD] Docker

[spark] branch branch-3.0 updated: [SPARK-31889][BUILD] Docker release script does not allocate enough memory to reliably publish

2020-06-01 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-3.0 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-3.0 by this push: new 387f57c [SPARK-31889][BUILD] Docker

[spark] branch master updated: [SPARK-31889][BUILD] Docker release script does not allocate enough memory to reliably publish

2020-06-01 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new ab9e5a2 [SPARK-31889][BUILD] Docker release

[jira] [Created] (SPARK-31889) Docker release script does not allocate enough memory to reliably publish

2020-06-01 Thread Holden Karau (Jira)
Holden Karau created SPARK-31889: Summary: Docker release script does not allocate enough memory to reliably publish Key: SPARK-31889 URL: https://issues.apache.org/jira/browse/SPARK-31889 Project

[jira] [Updated] (SPARK-31692) Hadoop confs passed via spark config are not set in URLStream Handler Factory

2020-06-01 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31692: - Fix Version/s: (was: 2.4.7) 2.4.6 > Hadoop confs passed via spark con

[jira] [Updated] (SPARK-31663) Grouping sets with having clause returns the wrong result

2020-06-01 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31663: - Fix Version/s: (was: 2.4.7) 2.4.6 > Grouping sets with having cla

[jira] [Updated] (SPARK-25694) URL.setURLStreamHandlerFactory causing incompatible HttpURLConnection issue

2020-06-01 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-25694: - Fix Version/s: (was: 2.4.7) 2.4.6 > URL.setURLStreamHandlerFact

[jira] [Updated] (SPARK-31655) Upgrade snappy to version 1.1.7.5

2020-06-01 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31655: - Fix Version/s: (was: 2.4.7) 2.4.6 > Upgrade snappy to version 1.1.

Re: [VOTE] Release Spark 2.4.6 (RC8)

2020-05-31 Thread Holden Karau
fix. > > +1 from me, same as last time. This still appears to be OK in licenses and > sigs, and source compiles and passes tests. > > On Sun, May 31, 2020 at 11:23 PM Wenchen Fan wrote: > >> +1 (binding), although I don't know why we jump from RC 3 to RC 8... >> >>

[VOTE] Release Spark 2.4.6 (RC8)

2020-05-31 Thread Holden Karau
Please vote on releasing the following candidate as Apache Spark version 2.4.6. The vote is open until June 5th at 9AM PST and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 2.4.6 [ ] -1 Do not release this package because

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-31 Thread Holden Karau
friends) but >> it would >> be a really nice one to have. >> >> On Mon, May 18, 2020 at 11:59 PM Holden Karau >> wrote: >> > >> > That seems like an important concern. I'm going to go ahead and vote -1 >> on this RC and I'll roll a new RC once

svn commit: r39857 - in /dev/spark/v2.4.6-rc8-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2020-05-29 Thread holden
Author: holden Date: Sat May 30 01:27:54 2020 New Revision: 39857 Log: Apache Spark v2.4.6-rc8 docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r39856 - /dev/spark/v2.4.6-rc8-bin/

2020-05-29 Thread holden
Author: holden Date: Sat May 30 00:54:32 2020 New Revision: 39856 Log: Apache Spark v2.4.6-rc8 Added: dev/spark/v2.4.6-rc8-bin/ dev/spark/v2.4.6-rc8-bin/SparkR_2.4.6.tar.gz (with props) dev/spark/v2.4.6-rc8-bin/SparkR_2.4.6.tar.gz.asc dev/spark/v2.4.6-rc8-bin/SparkR_2.4.6

[spark] 01/01: Preparing development version 2.4.7-SNAPSHOT

2020-05-29 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit f32c60e001abe564736e0d00772dfce23c3b07b5 Author: Holden Karau AuthorDate: Fri May 29 23:28:37 2020 +

[spark] branch branch-2.4 updated (8307f1a -> f32c60e)

2020-05-29 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 8307f1a [SPARK-26095][BUILD] Disable parallelization in make-distibution.sh. add 807e0a4 Preparing Spark

[spark] 01/01: Preparing Spark release v2.4.6-rc8

2020-05-29 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v2.4.6-rc8 in repository https://gitbox.apache.org/repos/asf/spark.git commit 807e0a484d1de767d1f02bd8a622da6450bdf940 Author: Holden Karau AuthorDate: Fri May 29 23:28:32 2020 + Preparing

[spark] tag v2.4.6-rc8 created (now 807e0a4)

2020-05-29 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v2.4.6-rc8 in repository https://gitbox.apache.org/repos/asf/spark.git. at 807e0a4 (commit) This tag includes the following new commits: new 807e0a4 Preparing Spark release v2.4.6-rc8

[jira] [Resolved] (SPARK-31541) Backport SPARK-26095 Disable parallelization in make-distibution.sh. (Avoid build hanging)

2020-05-29 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31541. -- Fix Version/s: 2.4.6 Assignee: Marcelo Masiero Vanzin Resolution: Fixed

[jira] [Updated] (SPARK-26095) make-distribution.sh is hanging in jenkins

2020-05-29 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-26095: - Fix Version/s: 2.4.6 Affects Version/s: 2.4.6 > make-distribution.sh is hang

[spark] branch branch-2.4 updated: [SPARK-26095][BUILD] Disable parallelization in make-distibution.sh.

2020-05-29 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 8307f1a [SPARK-26095][BUILD] Disable

[jira] [Reopened] (SPARK-31541) Backport SPARK-26095 Disable parallelization in make-distibution.sh. (Avoid build hanging)

2020-05-29 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reopened SPARK-31541: -- > Backport SPARK-26095 Disable parallelization in make-distibution.sh. > (Avoid

[jira] [Commented] (SPARK-31541) Backport SPARK-26095 Disable parallelization in make-distibution.sh. (Avoid build hanging)

2020-05-29 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119930#comment-17119930 ] Holden Karau commented on SPARK-31541: -- Ran into issues with this during the RC7 build so I'm

svn commit: r39852 - in /dev/spark: v2.4.6-rc1-bin/ v2.4.6-rc1-docs/ v2.4.6-rc3-bin/ v2.4.6-rc3-docs/ v2.4.6-rc6-bin/ v2.4.6-rc6-docs/ v2.4.6-rc7-bin/

2020-05-29 Thread holden
Author: holden Date: Fri May 29 19:49:01 2020 New Revision: 39852 Log: Remove failed 2.4.6 RCs Removed: dev/spark/v2.4.6-rc1-bin/ dev/spark/v2.4.6-rc1-docs/ dev/spark/v2.4.6-rc3-bin/ dev/spark/v2.4.6-rc3-docs/ dev/spark/v2.4.6-rc6-bin/ dev/spark/v2.4.6-rc6-docs/ dev

[pydotorg-www] Conversion to emeritus status

2020-05-29 Thread Steve Holden
Hi Ewa, Betsy, webmasters and pydotorgers, With my 70th birthday coming up, even though I continue to work happily it's definitely time to wind some activities down. As you know I've been planning to do this for some time, so I'm sure this request to convert to emeritus status will come as no

svn commit: r39820 - /dev/spark/v2.4.6-rc7-bin/

2020-05-29 Thread holden
Author: holden Date: Fri May 29 08:53:39 2020 New Revision: 39820 Log: Apache Spark v2.4.6-rc7 Added: dev/spark/v2.4.6-rc7-bin/ dev/spark/v2.4.6-rc7-bin/SparkR_2.4.6.tar.gz (with props) dev/spark/v2.4.6-rc7-bin/SparkR_2.4.6.tar.gz.asc dev/spark/v2.4.6-rc7-bin/SparkR_2.4.6

[spark] 01/01: Preparing development version 2.4.7-SNAPSHOT

2020-05-29 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit 1c36f8e8f633cce8c78bccdac215acccd2d8202b Author: Holden Karau AuthorDate: Fri May 29 07:51:23 2020 +

[spark] branch branch-2.4 updated (d53363d -> 1c36f8e)

2020-05-29 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from d53363d Preparing development version 2.4.7-SNAPSHOT add 105de0512 Preparing Spark release v2.4.6-rc7

[spark] tag v2.4.6-rc7 created (now 105de0512)

2020-05-29 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v2.4.6-rc7 in repository https://gitbox.apache.org/repos/asf/spark.git. at 105de0512 (commit) This tag includes the following new commits: new 105de0512 Preparing Spark release v2.4.6

[spark] 01/01: Preparing Spark release v2.4.6-rc7

2020-05-29 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v2.4.6-rc7 in repository https://gitbox.apache.org/repos/asf/spark.git commit 105de0512d0860809dc742307700ab777665991c Author: Holden Karau AuthorDate: Fri May 29 07:51:19 2020 + Preparing

svn commit: r39814 - in /dev/spark/v2.4.6-rc6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2020-05-28 Thread holden
Author: holden Date: Fri May 29 03:46:50 2020 New Revision: 39814 Log: Apache Spark v2.4.6-rc6 docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r39813 - /dev/spark/v2.4.6-rc6-bin/

2020-05-28 Thread holden
Author: holden Date: Fri May 29 03:13:16 2020 New Revision: 39813 Log: Apache Spark v2.4.6-rc6 Added: dev/spark/v2.4.6-rc6-bin/ dev/spark/v2.4.6-rc6-bin/SparkR_2.4.6.tar.gz (with props) dev/spark/v2.4.6-rc6-bin/SparkR_2.4.6.tar.gz.asc dev/spark/v2.4.6-rc6-bin/SparkR_2.4.6

[spark] 01/01: Preparing development version 2.4.7-SNAPSHOT

2020-05-28 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit d53363d94fa716f22bd27d39c0cc39a6f154c197 Author: Holden Karau AuthorDate: Fri May 29 00:40:59 2020 +

[spark] branch branch-2.4 updated (7f522d5 -> d53363d)

2020-05-28 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 7f522d5 [BUILD][INFRA] bump the timeout to match the jenkins PRB add 787c947 Preparing Spark release

[spark] 01/01: Preparing Spark release v2.4.6-rc6

2020-05-28 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v2.4.6-rc6 in repository https://gitbox.apache.org/repos/asf/spark.git commit 787c947b67590486746e2736664bfbaec81c0e41 Author: Holden Karau AuthorDate: Fri May 29 00:40:54 2020 + Preparing

[spark] tag v2.4.6-rc6 created (now 787c947)

2020-05-28 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v2.4.6-rc6 in repository https://gitbox.apache.org/repos/asf/spark.git. at 787c947 (commit) This tag includes the following new commits: new 787c947 Preparing Spark release v2.4.6-rc6

[jira] [Created] (SPARK-31860) Only push release tags on success

2020-05-28 Thread Holden Karau (Jira)
Holden Karau created SPARK-31860: Summary: Only push release tags on success Key: SPARK-31860 URL: https://issues.apache.org/jira/browse/SPARK-31860 Project: Spark Issue Type: Improvement

Re: [BVARC] Older ARRL Handbooks

2020-05-27 Thread Bill Holden via BVARC
__ > Brazos Valley Amateur Radio Club > > BVARC mailing list > BVARC@bvarc.org > http://mail.bvarc.org/mailman/listinfo/bvarc_bvarc.org > -- Bill Holden (860) 874-7423 behold...@gmail.com

[spark] branch branch-2.4 updated (6b055a4 -> e1adbac)

2020-05-27 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 6b055a4 Preparing development version 2.4.7-SNAPSHOT add f5962ca Preparing Spark release v2.4.6-rc5

[spark] tag v2.4.6-rc5 created (now f5962ca)

2020-05-27 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v2.4.6-rc5 in repository https://gitbox.apache.org/repos/asf/spark.git. at f5962ca (commit) This tag includes the following new commits: new f5962ca Preparing Spark release v2.4.6-rc5

[spark] 01/01: Preparing development version 2.4.7-SNAPSHOT

2020-05-27 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit e1adbac033f5be3fb2843788a4dfc6e1943fcc2c Author: Holden Karau AuthorDate: Wed May 27 16:38:38 2020 +

[spark] 01/01: Preparing Spark release v2.4.6-rc5

2020-05-27 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v2.4.6-rc5 in repository https://gitbox.apache.org/repos/asf/spark.git commit f5962ca743c65d89f0f539b4b61518bce19a5af1 Author: Holden Karau AuthorDate: Wed May 27 16:38:33 2020 + Preparing

Re: Keycloak integration for spark web ui

2020-05-27 Thread Holden Karau
This is probably better for the user@ list or your vendor. On Wed, May 27, 2020 at 3:09 AM Radhika wrote: > Hi > Can anyone tell me how keycloak integration for spark web ui can be done. > > Thanks ! > > > > -- > Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ > >

[spark] 01/01: Preparing development version 2.4.7-SNAPSHOT

2020-05-26 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit 6b055a417f505cce81a62a1e666bed52582e6be8 Author: Holden Karau AuthorDate: Tue May 26 17:07:42 2020 -0700

[spark] branch branch-2.4 updated (48ba885 -> 6b055a4)

2020-05-26 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 48ba885 [SPARK-31819][K8S][DOCS][TESTS][2.4] Add a workaround for Java 8u251+/K8s 1.17 and update integration

[spark] tag v2.4.6-rc4 created (now e08970b)

2020-05-26 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v2.4.6-rc4 in repository https://gitbox.apache.org/repos/asf/spark.git. at e08970b (commit) This tag includes the following new commits: new e08970b Preparing Spark release v2.4.6-rc4

[spark] 01/01: Preparing Spark release v2.4.6-rc4

2020-05-26 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v2.4.6-rc4 in repository https://gitbox.apache.org/repos/asf/spark.git commit e08970b77b4378f0a8932e07440908c8d3e897a4 Author: Holden Karau AuthorDate: Tue May 26 17:07:39 2020 -0700 Preparing

Re: Spark API and immutability

2020-05-25 Thread Holden Karau
So even on RDDs cache/persist mutate the RDD object. The important thing for Spark is that the data represented/in the RDD/Dataframe isn’t mutated. On Mon, May 25, 2020 at 10:56 AM Chris Thomas wrote: > > The cache() method on the DataFrame API caught me out. > > Having learnt that DataFrames

Re: [BVARC] Off topic - has anyone been successful in turning off the Google Ads on their computer

2020-05-23 Thread Bill Holden via BVARC
___ > Brazos Valley Amateur Radio Club > > BVARC mailing list > BVARC@bvarc.org > http://mail.bvarc.org/mailman/listinfo/bvarc_bvarc.org > -- Bill Holden (860) 874-7423 behold...@gmail.com Brazos Valley Amateur Radio

[jira] [Resolved] (SPARK-31791) Improve cache block migration test reliability

2020-05-22 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31791. -- Resolution: Fixed > Improve cache block migration test reliabil

[jira] [Updated] (SPARK-31791) Improve cache block migration test reliability

2020-05-22 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31791: - Fix Version/s: 3.1.0 > Improve cache block migration test reliabil

[jira] [Assigned] (SPARK-31791) Improve cache block migration test reliability

2020-05-22 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-31791: Assignee: Holden Karau > Improve cache block migration test reliabil

[spark] branch master updated: [SPARK-31791][CORE][TEST] Improve cache block migration test reliability

2020-05-22 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 721cba5 [SPARK-31791][CORE][TEST] Improve cache

[jira] [Created] (SPARK-31791) Improve cache block migration test reliability

2020-05-21 Thread Holden Karau (Jira)
Holden Karau created SPARK-31791: Summary: Improve cache block migration test reliability Key: SPARK-31791 URL: https://issues.apache.org/jira/browse/SPARK-31791 Project: Spark Issue Type

[jira] [Commented] (SPARK-31555) Improve cache block migration

2020-05-21 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17113736#comment-17113736 ] Holden Karau commented on SPARK-31555: -- Rocking. We're running into an issue in master

[PATCH] D80421: [Mips] use correct ld.so for musl soft float

2020-05-21 Thread Joe Holden via Phabricator via cfe-commits
joewholden created this revision. Herald added subscribers: cfe-commits, atanasyan, arichardson, sdardis. Herald added a project: clang. This patch attempts to fix the dynamic linker path for mips64-sf, I'm not entirely familiar with the llvm structure so I am unsure if this is the best way but

[Python-Dev] Re: PEP 618: Add Optional Length-Checking To zip

2020-05-20 Thread Steve Holden
On Wed, May 20, 2020 at 7:11 PM Jim J. Jewett wrote: > David Mertz wrote: > > > Fwiw, I don't think it changes my order, but 'strict' is a better word > than > > 'equal' in all those places. I'd subtract 0.1 from each of those votes if > > they used "equal". > > I would say that 'equal' is worse

[jira] [Created] (SPARK-31778) Support cross-building docker images

2020-05-20 Thread Holden Karau (Jira)
Holden Karau created SPARK-31778: Summary: Support cross-building docker images Key: SPARK-31778 URL: https://issues.apache.org/jira/browse/SPARK-31778 Project: Spark Issue Type: Improvement

Re: [pydotorg-www] Update to our listing on https://wiki.python.org/moin/PythonTraining

2020-05-19 Thread Steve Holden
Hi Tom, Thanks for your email. Surprisingly perhaps, spaces in Wiki names seem to work just fine. I've given your Wiki account editor permissions. I hope you can log in! Kind regards, Steve On Tue, May 19, 2020 at 10:56 AM Tom Walker wrote: > Hi there, > > > > I hope this email finds you

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread Holden Karau
- > Web: https://www.dbtsai.com > PGP Key ID: 42E5B25A8F7A82C1 > > > On Mon, May 18, 2020 at 2:47 PM Holden Karau wrote: > > > > Another two candidates for backporting that have come up since this RC > are SPARK-31692 & SPARK-31399. What are folks thoughts, s

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread Holden Karau
t; > On Mon, May 18, 2020 at 11:25 AM Holden Karau > wrote: > >> That is correct. I asked on the PR if that was ok with folks before I >> moved forward with the RC and was told that it was ok. I believe that >> particular bug is not a regression and is a long standin

[jira] [Resolved] (SPARK-20732) Copy cache data when node is being shut down

2020-05-18 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-20732. -- Fix Version/s: 3.1.0 Resolution: Fixed > Copy cache data when node is being shut d

[spark] branch master updated: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

2020-05-18 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c560428 [SPARK-20732][CORE] Decommission cache

[jira] [Updated] (SPARK-31555) Improve cache block migration

2020-05-18 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31555: - Description: We should explore the following improvements to cache block migration: 1) Peer

[jira] [Updated] (SPARK-31555) Improve cache block migration

2020-05-18 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31555: - Description: We should explore the following improvements to cache block migration: 1) Peer

[jira] [Updated] (SPARK-31555) Improve cache block migration

2020-05-18 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31555: - Description: We should explore the following improvements to cache block migration: 1) Peer

[jira] [Updated] (SPARK-31555) Improve cache block migration

2020-05-18 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31555: - Description: We should explore the following improvements to cache block migration: 1) Peer

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread Holden Karau
17, 2020 at 7:39 AM Sean Owen wrote: >> >> +1 , same response as to the last RC. >> This looks like it includes the fix discussed last time, as well as a >> few more small good fixes. >> >> On Sat, May 16, 2020 at 12:08 AM Holden Karau >> wrote: >> > >

[VOTE] Release Spark 2.4.6 (RC3)

2020-05-15 Thread Holden Karau
Please vote on releasing the following candidate as Apache Spark version 2.4 .6. The vote is open until May 22nd at 9AM PST and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 2.4.6 [ ] -1 Do not release this package because

svn commit: r39621 - in /dev/spark/v2.4.6-rc3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2020-05-15 Thread holden
Author: holden Date: Sat May 16 03:32:15 2020 New Revision: 39621 Log: Apache Spark v2.4.6-rc3 docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r39620 - /dev/spark/v2.4.6-rc3-bin/

2020-05-15 Thread holden
Author: holden Date: Sat May 16 03:05:19 2020 New Revision: 39620 Log: Apache Spark v2.4.6-rc3 Added: dev/spark/v2.4.6-rc3-bin/ dev/spark/v2.4.6-rc3-bin/SparkR_2.4.6.tar.gz (with props) dev/spark/v2.4.6-rc3-bin/SparkR_2.4.6.tar.gz.asc dev/spark/v2.4.6-rc3-bin/SparkR_2.4.6

[spark] 01/01: Preparing development version 2.4.7-SNAPSHOT

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit 18e07677e2e37312981125ebc1b0a15a4e7905f4 Author: Holden Karau AuthorDate: Sat May 16 02:03:49 2020 +

[spark] branch branch-2.4 updated (d2027e7 -> 18e0767)

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from d2027e7 Preparing development version 2.4.7-SNAPSHOT add 570848d Preparing Spark release v2.4.6-rc3

[spark] 01/01: Preparing Spark release v2.4.6-rc3

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v2.4.6-rc3 in repository https://gitbox.apache.org/repos/asf/spark.git commit 570848da7c48ba0cb827ada997e51677ff672a39 Author: Holden Karau AuthorDate: Sat May 16 02:03:44 2020 + Preparing

[spark] tag v2.4.6-rc3 created (now 570848d)

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v2.4.6-rc3 in repository https://gitbox.apache.org/repos/asf/spark.git. at 570848d (commit) This tag includes the following new commits: new 570848d Preparing Spark release v2.4.6-rc3

[jira] [Updated] (SPARK-26908) Fix toMillis

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-26908: - Fix Version/s: (was: 2.4.7) 2.4.6 > Fix toMil

[jira] [Updated] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31456: - Fix Version/s: (was: 2.4.7) 2.4.6 > If shutdownhook is ad

[jira] [Updated] (SPARK-31676) QuantileDiscretizer raise error parameter splits given invalid value (splits array includes -0.0 and 0.0)

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31676: - Fix Version/s: (was: 2.4.7) 2.4.6 > QuantileDiscretizer raise er

[jira] [Updated] (SPARK-31671) Wrong error message in VectorAssembler when column lengths can not be inferred

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31671: - Fix Version/s: (was: 2.4.7) 2.4.6 > Wrong error mess

[jira] [Updated] (SPARK-31632) The ApplicationInfo in KVStore may be accessed before it's prepared

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31632: - Fix Version/s: (was: 2.4.7) 2.4.6 > The ApplicationInfo in KVStore

[spark] branch branch-2.4 updated (8b72eb7 -> d2027e7)

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 8b72eb7 [SPARK-31712][SQL][TESTS][2.4] Check casting timestamps before the epoch to Byte/Short/Int/Long types

[spark] 01/01: Preparing development version 2.4.7-SNAPSHOT

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit d2027e7bcc595a3dd8c40d27e57766c117d612bf Author: Holden Karau AuthorDate: Fri May 15 22:49:14 2020 +

[spark] tag v2.4.6-rc2 created (now d6a488a)

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v2.4.6-rc2 in repository https://gitbox.apache.org/repos/asf/spark.git. at d6a488a (commit) This tag includes the following new commits: new d6a488a Preparing Spark release v2.4.6-rc2

[spark] 01/01: Preparing Spark release v2.4.6-rc2

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v2.4.6-rc2 in repository https://gitbox.apache.org/repos/asf/spark.git commit d6a488a4c15cc2943f4184c11e4d45925620cb78 Author: Holden Karau AuthorDate: Fri May 15 22:49:09 2020 + Preparing

Re: [VOTE] Release Spark 2.4.6 (RC1)

2020-05-12 Thread Holden Karau
Thanks. The 2.4.6 RC1 vote fails because we don’t have enough binding +1s, I’ll start a new RC once 31663 is merged or next week whichever is first. On Tue, May 12, 2020 at 7:28 AM Yuanjian Li wrote: > Thanks Holden and Dongjoon for the help! > The bugfix for SPARK-31663 is ready for

Re: [VOTE] Release Spark 2.4.6 (RC1)

2020-05-09 Thread Holden Karau
ate the JIRA. SPARK-31663 is a correctness issue since > Apache Spark 2.4.0. > > Bests, > Dongjoon. > > On Fri, May 8, 2020 at 10:26 AM Holden Karau wrote: > >> Can you provide a bit more context (is it a regression?) >> >> On Fri, May 8, 2020 at 9:33 AM Yuanjian L

Re: [VOTE] Release Spark 2.4.6 (RC1)

2020-05-08 Thread Holden Karau
Can you provide a bit more context (is it a regression?) On Fri, May 8, 2020 at 9:33 AM Yuanjian Li wrote: > Hi Holden, > > I'm working on the bugfix of SPARK-31663 > <https://issues.apache.org/jira/browse/SPARK-31663>, let me post it here > since it's a correctness bug a

Re: [pydotorg-www] Editing a page

2020-05-08 Thread Steve Holden
Thanks for your interest. I've added EtienneLamy to the list of editors, so you should be fine to go ahead now. Kind regards, Steve On Fri, May 8, 2020 at 1:03 PM wrote: > Hi, > > > > I’m EtienneLamy. I just created an account because I’ve been looking into > doing RPC calls with python and

[Bug 1876286] Re: Evolution reports "Error performing TLS handshake: Internal error in memory allocation."

2020-05-08 Thread Stephen Holden
Started here yesterday accessing Rogers/Yahoo email using imap. Worked fine for the last year until yesterday...Gmail is still working. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1876286 Title:

[Bug 1876286] Re: Evolution reports "Error performing TLS handshake: Internal error in memory allocation."

2020-05-08 Thread Stephen Holden
Started here yesterday accessing Rogers/Yahoo email using imap. Worked fine for the last year until yesterday...Gmail is still working. -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to evolution in Ubuntu.

Re: [VOTE] Release Spark 2.4.6 (RC1)

2020-05-07 Thread Holden Karau
I was expecting. On Thu, May 7, 2020 at 6:43 PM Dongjoon Hyun wrote: > Hi, Holden. > > The following link looks outdated. It was a link used at Spark 2.4.5 RC2. > - https://repository.apache.org/content/repositories/orgapachespark-1340/ > > Instead, in the Apache repo, there ar

Re: [VOTE] Release Spark 2.4.6 (RC1)

2020-05-07 Thread Holden Karau
Sorry correction: this vote is open until Monday May 11th at 9am pacific. On Thu, May 7, 2020 at 11:29 AM Holden Karau wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.4.6. > > The vote is open until February 5th 11PM PST and passes if a major

[VOTE] Release Spark 2.4.6 (RC1)

2020-05-07 Thread Holden Karau
Please vote on releasing the following candidate as Apache Spark version 2.4.6. The vote is open until February 5th 11PM PST and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 2.4.6 [ ] -1 Do not release this package because

[jira] [Updated] (SPARK-24266) Spark client terminates while driver is still running

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-24266: - Target Version/s: 3.0.0, 3.1.0, 2.4.7 (was: 2.4.6, 3.0.0, 3.1.0) > Spark client termina

[jira] [Resolved] (SPARK-31543) Backport SPARK-26306 More memory to de-flake SorterSuite

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31543. -- Resolution: Won't Fix > Backport SPARK-26306 More memory to de-flake SorterSu

<    5   6   7   8   9   10   11   12   13   14   >