svn commit: r39813 - /dev/spark/v2.4.6-rc6-bin/

2020-05-28 Thread holden
Author: holden Date: Fri May 29 03:13:16 2020 New Revision: 39813 Log: Apache Spark v2.4.6-rc6 Added: dev/spark/v2.4.6-rc6-bin/ dev/spark/v2.4.6-rc6-bin/SparkR_2.4.6.tar.gz (with props) dev/spark/v2.4.6-rc6-bin/SparkR_2.4.6.tar.gz.asc dev/spark/v2.4.6-rc6-bin/SparkR_2.4.6

[spark] branch branch-2.4 updated (7f522d5 -> d53363d)

2020-05-28 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 7f522d5 [BUILD][INFRA] bump the timeout to match the jenkins PRB add 787c947 Preparing Spark release

[spark] 01/01: Preparing development version 2.4.7-SNAPSHOT

2020-05-28 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit d53363d94fa716f22bd27d39c0cc39a6f154c197 Author: Holden Karau AuthorDate: Fri May 29 00:40:59 2020 +

[spark] 01/01: Preparing Spark release v2.4.6-rc6

2020-05-28 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v2.4.6-rc6 in repository https://gitbox.apache.org/repos/asf/spark.git commit 787c947b67590486746e2736664bfbaec81c0e41 Author: Holden Karau AuthorDate: Fri May 29 00:40:54 2020 + Preparing

[spark] tag v2.4.6-rc6 created (now 787c947)

2020-05-28 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v2.4.6-rc6 in repository https://gitbox.apache.org/repos/asf/spark.git. at 787c947 (commit) This tag includes the following new commits: new 787c947 Preparing Spark release v2.4.6-rc6

[jira] [Created] (SPARK-31860) Only push release tags on success

2020-05-28 Thread Holden Karau (Jira)
Holden Karau created SPARK-31860: Summary: Only push release tags on success Key: SPARK-31860 URL: https://issues.apache.org/jira/browse/SPARK-31860 Project: Spark Issue Type: Improvement

Re: [BVARC] Older ARRL Handbooks

2020-05-27 Thread Bill Holden via BVARC
__ > Brazos Valley Amateur Radio Club > > BVARC mailing list > BVARC@bvarc.org > http://mail.bvarc.org/mailman/listinfo/bvarc_bvarc.org > -- Bill Holden (860) 874-7423 behold...@gmail.com

[spark] branch branch-2.4 updated (6b055a4 -> e1adbac)

2020-05-27 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 6b055a4 Preparing development version 2.4.7-SNAPSHOT add f5962ca Preparing Spark release v2.4.6-rc5

[spark] tag v2.4.6-rc5 created (now f5962ca)

2020-05-27 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v2.4.6-rc5 in repository https://gitbox.apache.org/repos/asf/spark.git. at f5962ca (commit) This tag includes the following new commits: new f5962ca Preparing Spark release v2.4.6-rc5

[spark] 01/01: Preparing Spark release v2.4.6-rc5

2020-05-27 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v2.4.6-rc5 in repository https://gitbox.apache.org/repos/asf/spark.git commit f5962ca743c65d89f0f539b4b61518bce19a5af1 Author: Holden Karau AuthorDate: Wed May 27 16:38:33 2020 + Preparing

[spark] 01/01: Preparing development version 2.4.7-SNAPSHOT

2020-05-27 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit e1adbac033f5be3fb2843788a4dfc6e1943fcc2c Author: Holden Karau AuthorDate: Wed May 27 16:38:38 2020 +

Re: Keycloak integration for spark web ui

2020-05-27 Thread Holden Karau
This is probably better for the user@ list or your vendor. On Wed, May 27, 2020 at 3:09 AM Radhika wrote: > Hi > Can anyone tell me how keycloak integration for spark web ui can be done. > > Thanks ! > > > > -- > Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ > > -

[spark] 01/01: Preparing development version 2.4.7-SNAPSHOT

2020-05-26 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit 6b055a417f505cce81a62a1e666bed52582e6be8 Author: Holden Karau AuthorDate: Tue May 26 17:07:42 2020 -0700

[spark] branch branch-2.4 updated (48ba885 -> 6b055a4)

2020-05-26 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 48ba885 [SPARK-31819][K8S][DOCS][TESTS][2.4] Add a workaround for Java 8u251+/K8s 1.17 and update integration

[spark] tag v2.4.6-rc4 created (now e08970b)

2020-05-26 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v2.4.6-rc4 in repository https://gitbox.apache.org/repos/asf/spark.git. at e08970b (commit) This tag includes the following new commits: new e08970b Preparing Spark release v2.4.6-rc4

[spark] 01/01: Preparing Spark release v2.4.6-rc4

2020-05-26 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v2.4.6-rc4 in repository https://gitbox.apache.org/repos/asf/spark.git commit e08970b77b4378f0a8932e07440908c8d3e897a4 Author: Holden Karau AuthorDate: Tue May 26 17:07:39 2020 -0700 Preparing

Re: Spark API and immutability

2020-05-25 Thread Holden Karau
So even on RDDs cache/persist mutate the RDD object. The important thing for Spark is that the data represented/in the RDD/Dataframe isn’t mutated. On Mon, May 25, 2020 at 10:56 AM Chris Thomas wrote: > > The cache() method on the DataFrame API caught me out. > > Having learnt that DataFrames a

Re: [BVARC] Off topic - has anyone been successful in turning off the Google Ads on their computer

2020-05-23 Thread Bill Holden via BVARC
> Brazos Valley Amateur Radio Club > > BVARC mailing list > BVARC@bvarc.org > http://mail.bvarc.org/mailman/listinfo/bvarc_bvarc.org > -- Bill Holden (860) 874-7423 behold...@gmail.com Brazos Valley Amateur R

[jira] [Resolved] (SPARK-31791) Improve cache block migration test reliability

2020-05-22 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31791. -- Resolution: Fixed > Improve cache block migration test reliabil

[jira] [Updated] (SPARK-31791) Improve cache block migration test reliability

2020-05-22 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31791: - Fix Version/s: 3.1.0 > Improve cache block migration test reliabil

[jira] [Assigned] (SPARK-31791) Improve cache block migration test reliability

2020-05-22 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-31791: Assignee: Holden Karau > Improve cache block migration test reliabil

[spark] branch master updated: [SPARK-31791][CORE][TEST] Improve cache block migration test reliability

2020-05-22 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 721cba5 [SPARK-31791][CORE][TEST] Improve cache

[jira] [Created] (SPARK-31791) Improve cache block migration test reliability

2020-05-21 Thread Holden Karau (Jira)
Holden Karau created SPARK-31791: Summary: Improve cache block migration test reliability Key: SPARK-31791 URL: https://issues.apache.org/jira/browse/SPARK-31791 Project: Spark Issue Type

[jira] [Commented] (SPARK-31555) Improve cache block migration

2020-05-21 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17113736#comment-17113736 ] Holden Karau commented on SPARK-31555: -- Rocking. We're running into an

[PATCH] D80421: [Mips] use correct ld.so for musl soft float

2020-05-21 Thread Joe Holden via Phabricator via cfe-commits
joewholden created this revision. Herald added subscribers: cfe-commits, atanasyan, arichardson, sdardis. Herald added a project: clang. This patch attempts to fix the dynamic linker path for mips64-sf, I'm not entirely familiar with the llvm structure so I am unsure if this is the best way but

[Python-Dev] Re: PEP 618: Add Optional Length-Checking To zip

2020-05-20 Thread Steve Holden
On Wed, May 20, 2020 at 7:11 PM Jim J. Jewett wrote: > David Mertz wrote: > > > Fwiw, I don't think it changes my order, but 'strict' is a better word > than > > 'equal' in all those places. I'd subtract 0.1 from each of those votes if > > they used "equal". > > I would say that 'equal' is worse

[jira] [Created] (SPARK-31778) Support cross-building docker images

2020-05-20 Thread Holden Karau (Jira)
Holden Karau created SPARK-31778: Summary: Support cross-building docker images Key: SPARK-31778 URL: https://issues.apache.org/jira/browse/SPARK-31778 Project: Spark Issue Type: Improvement

Re: [pydotorg-www] Update to our listing on https://wiki.python.org/moin/PythonTraining

2020-05-19 Thread Steve Holden
Hi Tom, Thanks for your email. Surprisingly perhaps, spaces in Wiki names seem to work just fine. I've given your Wiki account editor permissions. I hope you can log in! Kind regards, Steve On Tue, May 19, 2020 at 10:56 AM Tom Walker wrote: > Hi there, > > > > I hope this email finds you well

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread Holden Karau
> Web: https://www.dbtsai.com > PGP Key ID: 42E5B25A8F7A82C1 > > > On Mon, May 18, 2020 at 2:47 PM Holden Karau wrote: > > > > Another two candidates for backporting that have come up since this RC > are SPARK-31692 & SPARK-31399. What are fo

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread Holden Karau
rouble. > > On Mon, May 18, 2020 at 11:25 AM Holden Karau > wrote: > >> That is correct. I asked on the PR if that was ok with folks before I >> moved forward with the RC and was told that it was ok. I believe that >> particular bug is not a regression and is a long sta

[jira] [Resolved] (SPARK-20732) Copy cache data when node is being shut down

2020-05-18 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-20732. -- Fix Version/s: 3.1.0 Resolution: Fixed > Copy cache data when node is being shut d

[spark] branch master updated: [SPARK-20732][CORE] Decommission cache blocks to other executors when an executor is decommissioned

2020-05-18 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new c560428 [SPARK-20732][CORE] Decommission cache

[jira] [Updated] (SPARK-31555) Improve cache block migration

2020-05-18 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31555: - Description: We should explore the following improvements to cache block migration: 1) Peer

[jira] [Updated] (SPARK-31555) Improve cache block migration

2020-05-18 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31555: - Description: We should explore the following improvements to cache block migration: 1) Peer

[jira] [Updated] (SPARK-31555) Improve cache block migration

2020-05-18 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31555: - Description: We should explore the following improvements to cache block migration: 1) Peer

[jira] [Updated] (SPARK-31555) Improve cache block migration

2020-05-18 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31555: - Description: We should explore the following improvements to cache block migration: 1) Peer

Re: [VOTE] Release Spark 2.4.6 (RC3)

2020-05-18 Thread Holden Karau
17, 2020 at 7:39 AM Sean Owen wrote: >> >> +1 , same response as to the last RC. >> This looks like it includes the fix discussed last time, as well as a >> few more small good fixes. >> >> On Sat, May 16, 2020 at 12:08 AM Holden Karau >> wrote: >> > >

[VOTE] Release Spark 2.4.6 (RC3)

2020-05-15 Thread Holden Karau
Please vote on releasing the following candidate as Apache Spark version 2.4 .6. The vote is open until May 22nd at 9AM PST and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 2.4.6 [ ] -1 Do not release this package because ..

svn commit: r39621 - in /dev/spark/v2.4.6-rc3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2020-05-15 Thread holden
Author: holden Date: Sat May 16 03:32:15 2020 New Revision: 39621 Log: Apache Spark v2.4.6-rc3 docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r39620 - /dev/spark/v2.4.6-rc3-bin/

2020-05-15 Thread holden
Author: holden Date: Sat May 16 03:05:19 2020 New Revision: 39620 Log: Apache Spark v2.4.6-rc3 Added: dev/spark/v2.4.6-rc3-bin/ dev/spark/v2.4.6-rc3-bin/SparkR_2.4.6.tar.gz (with props) dev/spark/v2.4.6-rc3-bin/SparkR_2.4.6.tar.gz.asc dev/spark/v2.4.6-rc3-bin/SparkR_2.4.6

[spark] branch branch-2.4 updated (d2027e7 -> 18e0767)

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from d2027e7 Preparing development version 2.4.7-SNAPSHOT add 570848d Preparing Spark release v2.4.6-rc3

[spark] 01/01: Preparing development version 2.4.7-SNAPSHOT

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit 18e07677e2e37312981125ebc1b0a15a4e7905f4 Author: Holden Karau AuthorDate: Sat May 16 02:03:49 2020 +

[spark] 01/01: Preparing Spark release v2.4.6-rc3

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v2.4.6-rc3 in repository https://gitbox.apache.org/repos/asf/spark.git commit 570848da7c48ba0cb827ada997e51677ff672a39 Author: Holden Karau AuthorDate: Sat May 16 02:03:44 2020 + Preparing

[spark] tag v2.4.6-rc3 created (now 570848d)

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v2.4.6-rc3 in repository https://gitbox.apache.org/repos/asf/spark.git. at 570848d (commit) This tag includes the following new commits: new 570848d Preparing Spark release v2.4.6-rc3

[jira] [Updated] (SPARK-26908) Fix toMillis

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-26908: - Fix Version/s: (was: 2.4.7) 2.4.6 > Fix toMil

[jira] [Updated] (SPARK-31456) If shutdownhook is added with priority Integer.MIN_VALUE, it's supposed to be called the last, but it gets called before other positive priority shutdownhook

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31456: - Fix Version/s: (was: 2.4.7) 2.4.6 > If shutdownhook is added w

[jira] [Updated] (SPARK-31676) QuantileDiscretizer raise error parameter splits given invalid value (splits array includes -0.0 and 0.0)

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31676: - Fix Version/s: (was: 2.4.7) 2.4.6 > QuantileDiscretizer raise er

[jira] [Updated] (SPARK-31671) Wrong error message in VectorAssembler when column lengths can not be inferred

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31671: - Fix Version/s: (was: 2.4.7) 2.4.6 > Wrong error message

[jira] [Updated] (SPARK-31632) The ApplicationInfo in KVStore may be accessed before it's prepared

2020-05-15 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31632: - Fix Version/s: (was: 2.4.7) 2.4.6 > The ApplicationInfo in KVStore

[spark] branch branch-2.4 updated (8b72eb7 -> d2027e7)

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 8b72eb7 [SPARK-31712][SQL][TESTS][2.4] Check casting timestamps before the epoch to Byte/Short/Int/Long types

[spark] 01/01: Preparing development version 2.4.7-SNAPSHOT

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit d2027e7bcc595a3dd8c40d27e57766c117d612bf Author: Holden Karau AuthorDate: Fri May 15 22:49:14 2020 +

[spark] tag v2.4.6-rc2 created (now d6a488a)

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v2.4.6-rc2 in repository https://gitbox.apache.org/repos/asf/spark.git. at d6a488a (commit) This tag includes the following new commits: new d6a488a Preparing Spark release v2.4.6-rc2

[spark] 01/01: Preparing Spark release v2.4.6-rc2

2020-05-15 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v2.4.6-rc2 in repository https://gitbox.apache.org/repos/asf/spark.git commit d6a488a4c15cc2943f4184c11e4d45925620cb78 Author: Holden Karau AuthorDate: Fri May 15 22:49:09 2020 + Preparing

Re: [VOTE] Release Spark 2.4.6 (RC1)

2020-05-12 Thread Holden Karau
Thanks. The 2.4.6 RC1 vote fails because we don’t have enough binding +1s, I’ll start a new RC once 31663 is merged or next week whichever is first. On Tue, May 12, 2020 at 7:28 AM Yuanjian Li wrote: > Thanks Holden and Dongjoon for the help! > The bugfix for SPARK-31663 is ready for

Re: [VOTE] Release Spark 2.4.6 (RC1)

2020-05-09 Thread Holden Karau
the JIRA. SPARK-31663 is a correctness issue since > Apache Spark 2.4.0. > > Bests, > Dongjoon. > > On Fri, May 8, 2020 at 10:26 AM Holden Karau wrote: > >> Can you provide a bit more context (is it a regression?) >> >> On Fri, May 8, 2020 at 9:33 AM Yuanjian L

Re: [VOTE] Release Spark 2.4.6 (RC1)

2020-05-08 Thread Holden Karau
Can you provide a bit more context (is it a regression?) On Fri, May 8, 2020 at 9:33 AM Yuanjian Li wrote: > Hi Holden, > > I'm working on the bugfix of SPARK-31663 > <https://issues.apache.org/jira/browse/SPARK-31663>, let me post it here > since it's a correct

Re: [pydotorg-www] Editing a page

2020-05-08 Thread Steve Holden
Thanks for your interest. I've added EtienneLamy to the list of editors, so you should be fine to go ahead now. Kind regards, Steve On Fri, May 8, 2020 at 1:03 PM wrote: > Hi, > > > > I’m EtienneLamy. I just created an account because I’ve been looking into > doing RPC calls with python and wen

[Bug 1876286] Re: Evolution reports "Error performing TLS handshake: Internal error in memory allocation."

2020-05-08 Thread Stephen Holden
Started here yesterday accessing Rogers/Yahoo email using imap. Worked fine for the last year until yesterday...Gmail is still working. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1876286 Title:

[Bug 1876286] Re: Evolution reports "Error performing TLS handshake: Internal error in memory allocation."

2020-05-08 Thread Stephen Holden
Started here yesterday accessing Rogers/Yahoo email using imap. Worked fine for the last year until yesterday...Gmail is still working. -- You received this bug notification because you are a member of Ubuntu Desktop Bugs, which is subscribed to evolution in Ubuntu. https://bugs.launchpad.net/bu

Re: [VOTE] Release Spark 2.4.6 (RC1)

2020-05-07 Thread Holden Karau
I was expecting. On Thu, May 7, 2020 at 6:43 PM Dongjoon Hyun wrote: > Hi, Holden. > > The following link looks outdated. It was a link used at Spark 2.4.5 RC2. > - https://repository.apache.org/content/repositories/orgapachespark-1340/ > > Instead, in the Apache repo, there ar

Re: [VOTE] Release Spark 2.4.6 (RC1)

2020-05-07 Thread Holden Karau
Sorry correction: this vote is open until Monday May 11th at 9am pacific. On Thu, May 7, 2020 at 11:29 AM Holden Karau wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.4.6. > > The vote is open until February 5th 11PM PST and passes if a major

[VOTE] Release Spark 2.4.6 (RC1)

2020-05-07 Thread Holden Karau
Please vote on releasing the following candidate as Apache Spark version 2.4.6. The vote is open until February 5th 11PM PST and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 2.4.6 [ ] -1 Do not release this package because .

[jira] [Updated] (SPARK-24266) Spark client terminates while driver is still running

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-24266: - Target Version/s: 3.0.0, 3.1.0, 2.4.7 (was: 2.4.6, 3.0.0, 3.1.0) > Spark client termina

[jira] [Resolved] (SPARK-31543) Backport SPARK-26306 More memory to de-flake SorterSuite

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31543. -- Resolution: Won't Fix > Backport SPARK-26306 More memory to de-flake Sor

[jira] [Resolved] (SPARK-31538) Backport SPARK-25338 Ensure to call super.beforeAll() and super.afterAll() in test cases

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31538. -- Resolution: Won't Fix > Backport SPARK-25338 Ensure to call super.beforeA

[jira] [Resolved] (SPARK-31541) Backport SPARK-26095 Disable parallelization in make-distibution.sh. (Avoid build hanging)

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31541. -- Resolution: Won't Fix > Backport SPARK-26095 Disable parallelization

[jira] [Updated] (SPARK-26908) Fix toMillis

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-26908: - Fix Version/s: (was: 2.4.6) 2.4.7 > Fix toMil

[jira] [Commented] (SPARK-26908) Fix toMillis

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17101926#comment-17101926 ] Holden Karau commented on SPARK-26908: -- retagged to 2.4.7, will revist if we

[jira] [Updated] (SPARK-30737) Reenable to generate Rd files

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-30737: - Fix Version/s: (was: 2.4.5) 2.4.6 > Reenable to generate Rd fi

[jira] [Updated] (SPARK-27262) Add explicit UTF-8 Encoding to DESCRIPTION

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-27262: - Fix Version/s: (was: 2.4.5) 2.4.6 > Add explicit UTF-8 Encoding

[jira] [Assigned] (SPARK-30823) %PYTHONPATH% not set in python/docs/make2.bat, resulting in failed/wrong documentation builds

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-30823: Assignee: David Toneian > %PYTHONPATH% not set in python/docs/make2.bat, resulting

[jira] [Updated] (SPARK-30823) %PYTHONPATH% not set in python/docs/make2.bat, resulting in failed/wrong documentation builds

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-30823: - Fix Version/s: 2.4.6 > %PYTHONPATH% not set in python/docs/make2.bat, resulting in failed/wr

[jira] [Updated] (SPARK-31306) rand() function documentation suggests an inclusive upper bound of 1.0

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31306: - Fix Version/s: 3.0.0 2.4.6 > rand() function documentation suggests

[jira] [Updated] (SPARK-31231) Support setuptools 46.1.0+ in PySpark packaging

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31231: - Fix Version/s: 3.1.0 3.0.0 > Support setuptools 46.1.0+ in PySpark packag

[jira] [Updated] (SPARK-31231) Support setuptools 46.1.0+ in PySpark packaging

2020-05-07 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31231: - Fix Version/s: 2.4.6 > Support setuptools 46.1.0+ in PySpark packag

svn commit: r39316 - in /dev/spark/v2.4.6-rc1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2020-05-06 Thread holden
Author: holden Date: Thu May 7 00:48:34 2020 New Revision: 39316 Log: Apache Spark v2.4.6-rc1 docs [This commit notification would consist of 1458 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r39315 - /dev/spark/v2.4.6-rc1-bin/

2020-05-06 Thread holden
Author: holden Date: Thu May 7 00:15:41 2020 New Revision: 39315 Log: Apache Spark v2.4.6-rc1 Added: dev/spark/v2.4.6-rc1-bin/ dev/spark/v2.4.6-rc1-bin/SparkR_2.4.6.tar.gz (with props) dev/spark/v2.4.6-rc1-bin/SparkR_2.4.6.tar.gz.asc dev/spark/v2.4.6-rc1-bin/SparkR_2.4.6

[spark] branch branch-2.4 updated (a00eddc -> 8504bdb)

2020-05-06 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from a00eddc [SPARK-31653][BUILD] Setuptools is needed before installing any other python packages add a3cffc9

[spark] 01/01: Preparing development version 2.4.7-SNAPSHOT

2020-05-06 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git commit 8504bdb945432479e1a23fccf2308580ba92ecc4 Author: Holden Karau AuthorDate: Wed May 6 23:13:27 2020 +

[spark] 01/01: Preparing Spark release v2.4.6-rc1

2020-05-06 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v2.4.6-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git commit a3cffc997035d11e1f6c092c1186e943f2f63544 Author: Holden Karau AuthorDate: Wed May 6 23:13:21 2020 + Preparing

[spark] tag v2.4.6-rc1 created (now a3cffc9)

2020-05-06 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v2.4.6-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git. at a3cffc9 (commit) This tag includes the following new commits: new a3cffc9 Preparing Spark release v2.4.6-rc1

[spark] branch branch-2.4 updated: [SPARK-31653][BUILD] Setuptools is needed before installing any other python packages

2020-05-06 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new a00eddc [SPARK-31653][BUILD] Setuptools

[jira] [Assigned] (SPARK-31653) setuptools needs to be installed before anything else

2020-05-06 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-31653: Assignee: Holden Karau > setuptools needs to be installed before anything e

[jira] [Resolved] (SPARK-31653) setuptools needs to be installed before anything else

2020-05-06 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31653. -- Fix Version/s: 2.4.6 Resolution: Fixed > setuptools needs to be installed bef

[jira] [Updated] (SPARK-31653) setuptools needs to be installed before anything else

2020-05-06 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-31653: - Priority: Blocker (was: Major) > setuptools needs to be installed before anything e

[jira] [Created] (SPARK-31653) setuptools needs to be installed before anything else

2020-05-06 Thread Holden Karau (Jira)
Holden Karau created SPARK-31653: Summary: setuptools needs to be installed before anything else Key: SPARK-31653 URL: https://issues.apache.org/jira/browse/SPARK-31653 Project: Spark Issue

svn commit: r39313 - /dev/spark/KEYS

2020-05-06 Thread holden
Author: holden Date: Wed May 6 20:56:25 2020 New Revision: 39313 Log: Update KEYS Modified: dev/spark/KEYS Modified: dev/spark/KEYS == --- dev/spark/KEYS (original) +++ dev/spark/KEYS Wed May 6 20:56:25 2020

Re: [BVARC] Current Roster

2020-05-05 Thread Bill Holden via BVARC
Official as of today: My new vanity call is W5JAZ. Any Donald Fagen fans might recognize that from the song "The Nightfly"! My old call was KI5HTR. Thanks! Bill Holden On Mon, Apr 20, 2020 at 1:27 PM Jeffery MacMillian via BVARC < bvarc@bvarc.org> wrote: > I don'

Re: Jacek's new Apache Beam Internals Project

2020-05-03 Thread Holden Karau
nning on adding more over time? > > On Tue, Apr 28, 2020 at 1:48 PM Ismaël Mejía wrote: > >> The tweet URL for ref in case someone wants to like/RT >> >> https://twitter.com/jaceklaskowski/status/1255046717277376512?s=19 >> >> On Tue, Apr 28, 2020, 8:04 PM Holden

Re: No LICENSE file in spark custom build distribution

2020-05-01 Thread Holden Karau
Can you send me the output of those two commands On Fri, May 1, 2020 at 1:46 PM Xiangyu Li wrote: > Hi Holden, > > Please check the second email of mine in this email chain. I did that > originally and to qu

Re: No LICENSE file in spark custom build distribution

2020-05-01 Thread Holden Karau
Your problem isn't the missing license per-se (that just happens to be the first error). I don't believe that is the way we expect users to pip install the Python library. pip will only install directories/targets underneath the directory where setup.py, hence the deps directory which is construct

[jira] [Updated] (SPARK-24266) Spark client terminates while driver is still running

2020-04-30 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-24266: - Target Version/s: 2.4.6, 3.0.0, 3.1.0 > Spark client terminates while driver is still runn

[jira] [Commented] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2020-04-30 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096705#comment-17096705 ] Holden Karau commented on SPARK-29048: -- Do we have context for the reaso

[jira] [Updated] (SPARK-29048) Query optimizer slow when using Column.isInCollection() with a large size collection

2020-04-30 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-29048: - Target Version/s: 2.4.6 Affects Version/s: 2.4.6 2.4.5 > Qu

[jira] [Commented] (SPARK-31538) Backport SPARK-25338 Ensure to call super.beforeAll() and super.afterAll() in test cases

2020-04-30 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096704#comment-17096704 ] Holden Karau commented on SPARK-31538: -- So a test reliability improvement

Jacek's new Apache Beam Internals Project

2020-04-28 Thread Holden Karau
Hi Folks, I just saw Jacek's tweet about his new Beam Internals project (he's done a great job on his Spark Internals documentation and blog posts) and I figured I'd share the link https://leanpub.com/the-internals-of-apache-beam in case folks are interested :) Cheers, Holden

[jira] [Commented] (SPARK-31525) Inconsistent result of df.head(1) and df.head()

2020-04-27 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17094028#comment-17094028 ] Holden Karau commented on SPARK-31525: -- I agree it's inconsistent, also

[jira] [Resolved] (SPARK-31536) Backport SPARK-25407 Allow nested access for non-existent field for Parquet file when nested pruning is enabled

2020-04-27 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31536. -- Resolution: Won't Fix > Backport SPARK-25407 Allow nested access for non-existe

[jira] [Commented] (SPARK-31536) Backport SPARK-25407 Allow nested access for non-existent field for Parquet file when nested pruning is enabled

2020-04-27 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17094024#comment-17094024 ] Holden Karau commented on SPARK-31536: -- If the code path is already disable

[jira] [Resolved] (SPARK-31537) Backport SPARK-25559 Remove the unsupported predicates in Parquet when possible

2020-04-27 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-31537. -- Resolution: Won't Fix per [~hyukjin.kwon] > Backport SPARK-25559 Remove the uns

<    6   7   8   9   10   11   12   13   14   15   >