[jira] [Resolved] (SPARK-39799) DataSourceV2: View catalog interface

2022-11-16 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-39799. -- Fix Version/s: 3.4.0 Resolution: Fixed > DataSourceV2: View catalog interf

[jira] [Assigned] (SPARK-39799) DataSourceV2: View catalog interface

2022-11-16 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau reassigned SPARK-39799: Assignee: John Zhuge > DataSourceV2: View catalog interf

[spark] branch master updated: [SPARK-39799][SQL] DataSourceV2: View catalog interface

2022-11-16 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d12abff7e83 [SPARK-39799][SQL] DataSourceV2

Re: [BVARC] noise eliminating headset/microphone for HT

2022-10-31 Thread David Holden via BVARC
Sheree, Your Anytone has Bluetooth. I have the same HT and connected a Bluetooth headset to it. - David WJ9O > On Oct 31, 2022, at 5:58 PM, Sheree Horton via BVARC wrote: > >  > I need a headset with an attached microphone to use with my Yaesu FT60R > and/or my Anytone 878UCII Plus for

Re: Dynamic Scaling without Kubernetes

2022-10-26 Thread Holden Karau
So Spark can dynamically scale on YARN, but standalone mode becomes a bit complicated — where do you envision Spark gets the extra resources from? On Wed, Oct 26, 2022 at 12:18 PM Artemis User wrote: > Has anyone tried to make a Spark cluster dynamically scalable, i.e., > adding a new worker

[Python-Dev] Re: problem with Distributed File System Replication and Namespacing and different versions of Python 3

2022-10-26 Thread Steve Holden
I don't remember it being mentioned, but much of the traffic recently migrated from this list to https://discuss.python.org/c/core-dev/23, which you may wish to keep in touch with. Kind regards, Steve On Tue, Oct 25, 2022 at 7:53 AM Juan Cristóbal Quesada <

[jira] [Created] (SPARK-40850) Tests for Spark SQL Intrepetered Queries may execute Codegen

2022-10-19 Thread Holden Karau (Jira)
Holden Karau created SPARK-40850: Summary: Tests for Spark SQL Intrepetered Queries may execute Codegen Key: SPARK-40850 URL: https://issues.apache.org/jira/browse/SPARK-40850 Project: Spark

[LincolnTalk] Reminder: Crafters, Art Teachers, Quilters

2022-10-08 Thread sarah cannon holden
Good Beautiful Morning! REMINDER. 9-2 Today - BIG SALE and GIVEAWAY of all sorts of fun fabrics, threads, yarn, beads... at 60 Weston Road. Hope to see you today. Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Search the archives at http

[jira] [Resolved] (SPARK-40428) Add a shutdownhook to CoarseGrained scheduler to avoid dangling resources during abnormal shutdown

2022-10-04 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-40428. -- Fix Version/s: 3.4.0 Assignee: Holden Karau Resolution: Fixed >

[spark] branch master updated: [SPARK-40428][CORE] Fix shutdown hook in the CoarseGrainedSchedulerBackend

2022-10-04 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 505a8a04ad6 [SPARK-40428][CORE] Fix shutdown

[LincolnTalk] Lace

2022-09-21 Thread Sarah Cannon Holden
Does anyone have suggestions on what to do with old lace? Black and white. Also some old fur muffs. Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Search the archives at http://lincoln.2330058.n4.nabble.com/. Browse the archives at https

[jira] [Created] (SPARK-40428) Add a shutdownhook to CoarseGrained scheduler to avoid dangling resources during abnormal shutdown

2022-09-14 Thread Holden Karau (Jira)
Holden Karau created SPARK-40428: Summary: Add a shutdownhook to CoarseGrained scheduler to avoid dangling resources during abnormal shutdown Key: SPARK-40428 URL: https://issues.apache.org/jira/browse/SPARK

Re: [LincolnTalk] Love Letter to Lincoln

2022-09-11 Thread sarah cannon holden
Thank you Kathleen. A beautiful tribute. It truly captures the reminder your mother provided me each time I saw her walking north or south along Lincoln Road - just keep moving, have a goal each day and don't let my age tell me what I can and cannot do. She was an inspiration to all who saw

[LincolnTalk] Yard work Help

2022-09-10 Thread Sarah Cannon Holden
We are looking for some hardworking young people/person to help with hauling brush and other outside work. $15-$20/hour depending on experience! Please respond directly to me. Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Search

[jira] [Created] (SPARK-40379) Propagate decommission executor loss reason during onDisconnect in K8s

2022-09-07 Thread Holden Karau (Jira)
Holden Karau created SPARK-40379: Summary: Propagate decommission executor loss reason during onDisconnect in K8s Key: SPARK-40379 URL: https://issues.apache.org/jira/browse/SPARK-40379 Project

Re: Jupyter notebook on Dataproc versus GKE

2022-09-06 Thread Holden Karau
rise from relying on this email's technical content is explicitly >>> disclaimed. The author will in no case be liable for any monetary damages >>> arising from such loss, damage or destruction. >>> >>> >>> >>> >>> On Mon, 5 Sept 2022 at 20:5

Re: Jupyter notebook on Dataproc versus GKE

2022-09-06 Thread Holden Karau
rise from relying on this email's technical content is explicitly >>> disclaimed. The author will in no case be liable for any monetary damages >>> arising from such loss, damage or destruction. >>> >>> >>> >>> >>> On Mon, 5 Sept 2022 at 20:5

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Holden Karau
f data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Mon, 5 Sept 2022 at 12:47, Hold

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Holden Karau
f data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Mon, 5 Sept 2022 at 12:47, Hold

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Holden Karau
I’ve run Jupyter w/Spark on K8s, haven’t tried it with Dataproc personally. The Spark K8s pod scheduler is now more pluggable for Yunikorn and Volcano can be used with less effort. On Mon, Sep 5, 2022 at 7:44 AM Mich Talebzadeh wrote: > > Hi, > > > Has anyone got experience of running Jupyter

Re: Jupyter notebook on Dataproc versus GKE

2022-09-05 Thread Holden Karau
I’ve run Jupyter w/Spark on K8s, haven’t tried it with Dataproc personally. The Spark K8s pod scheduler is now more pluggable for Yunikorn and Volcano can be used with less effort. On Mon, Sep 5, 2022 at 7:44 AM Mich Talebzadeh wrote: > > Hi, > > > Has anyone got experience of running Jupyter

Re: Welcome Fokko Driesprong as a committer!

2022-08-21 Thread Holden Karau
Congratulations  On Sun, Aug 21, 2022 at 1:57 PM wrote: > Congratulations! > > Sent from my iPhone > > On Aug 21, 2022, at 3:00 PM, Kyle Bendickson wrote: > >  > > Congratulations Fokko! This is indeed very well deserved! 拾 > > It’s a pleasure to work with you! > > On Sun, Aug 21, 2022 at

[jira] [Resolved] (SPARK-38969) Graceful decomissionning on Kubernetes fails / decom script error

2022-08-12 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-38969. -- Fix Version/s: 3.4.0 Assignee: Holden Karau Resolution: Fixed Updated

[spark] branch master updated: [SPARK-38969][K8S] Fix Decom reporting

2022-08-12 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 451ac4c4d96 [SPARK-38969][K8S] Fix Decom

[LincolnTalk] Queen Mattress

2022-07-22 Thread Sarah Cannon Holden
The flower delivery has been solved so I thought I would try my luck further!! Does anyone have a queen mattress looking for a new home? Please let me know Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org. Search the archives at http://lincoln

[LincolnTalk] Flower delivery mistake

2022-07-22 Thread Sarah Cannon Holden
A lovely jar of flowers arrived at my house today. Something about Yard Hang from Emilie, Dan and Coleman. I have no idea who/what this is and no way to correct a wrong delivery. Any ideas?? Sarah Cannon Holden -- The LincolnTalk mailing list. To post, send mail to Lincoln@lincolntalk.org

[LincolnTalk] 1776 tickets - beware scam.

2022-06-30 Thread sarah cannon holden
Below in the link to buy your tickets. There is a SCAM offering tickets at an outrageous price - and I am not even sure you will even have a ticket. Be sure to go to https://americanrepertorytheater.org/shows-events/1776-revival/ for your tickets. Sarah -- The LincolnTalk mailing list. To

Re: [LincolnTalk] Don't miss it!

2022-06-30 Thread Sarah Cannon Holden
I second this recommendation. I saw it last night with my 15 year old granddaughter. An inspiring performance. Sarah Sarah Cannon Holden > On Jun 30, 2022, at 9:41 AM, Sara Mattes wrote: > > Just saw Diane Paulus’ “1776” at the A.R.T. in Cambridge…fantastic! > Yes, when it h

Re: [LincolnTalk] Free Upright Piano

2022-06-22 Thread Sarah Cannon Holden
I also have one. If you can move it it’s yours. Also would need tuning. Sarah Cannon Holden > On Jun 22, 2022, at 4:00 PM, Diana Abrashkin wrote: > >  > > Diana Abrashkin, Registered Architect > www.CuracaoWithDiana.com > www.ADCarchitecture.com > US telephone (781)

Re: [SPARK-39515] Improve scheduled jobs in GitHub Actions

2022-06-20 Thread Holden Karau
How about a hallway meet up at Data AI summit to talk about build CI if folks are Interested? On Sun, Jun 19, 2022 at 7:50 PM Hyukjin Kwon wrote: > Increased the priority to a blocker - I don't think we can release with > these build failures and poor CI > > On Mon, 20 Jun 2022 at 10:39,

[jira] [Created] (SPARK-39512) Document the Spark Docker container release process

2022-06-18 Thread Holden Karau (Jira)
Holden Karau created SPARK-39512: Summary: Document the Spark Docker container release process Key: SPARK-39512 URL: https://issues.apache.org/jira/browse/SPARK-39512 Project: Spark Issue

Re: [VOTE][SPIP] Spark Connect

2022-06-16 Thread Holden Karau
+1 On Thu, Jun 16, 2022 at 7:17 AM Thomas Graves wrote: > +1 for the concept. > Correct me if I'm wrong, but at a high level this is proposing adding > a new user API (which is language agnostic) and the proposal is to > start with something like the Logical Plan, with the addition of being >

[PSF-Community] Re: End Of life: Christoph Gohlke, Unofficcial Windows Binaries for Python Extension Packages

2022-06-15 Thread Steve Holden
Would it also be appropriate to nominate Cristoph for a Fellowship and/or community service award? Kind regards, Steve On Wed, Jun 15, 2022 at 11:22 AM Massa, Harald Armin wrote: > Hi dear PSF coMembers, > > Christoph Gohlkes Windows Binaries are nearing end of Life > >

Re: [VOTE] Release Spark 3.3.0 (RC6)

2022-06-13 Thread Holden Karau
+1 On Mon, Jun 13, 2022 at 4:51 PM Yuming Wang wrote: > +1 (non-binding) > > On Tue, Jun 14, 2022 at 7:41 AM Dongjoon Hyun > wrote: > >> +1 >> >> Thanks, >> Dongjoon. >> >> On Mon, Jun 13, 2022 at 3:54 PM Chris Nauroth >> wrote: >> >>> +1 (non-binding) >>> >>> I repeated all checks I

[LincolnTalk] Fwd: Babysitting Job

2022-06-08 Thread Sarah Cannon Holden
Lincoln Neighbors. I am forwarding this message on behalf of my granddaughter who will be living with us this summer. She’ll arrive on Sunday! Sarah > >> Hello, >> My name is Cannon Martin, and I am 15 years old. I will be living with my >> grandparents for the summer and am looking for

Re: Request for buying Apache Spark SWAG

2022-06-01 Thread Holden Karau
+1 On Wed, Jun 1, 2022 at 10:28 AM Takuya UESHIN wrote: > +1 > > On Wed, Jun 1, 2022 at 6:07 AM Wenchen Fan wrote: > >> +1 >> >> On Wed, Jun 1, 2022 at 3:36 PM Hyukjin Kwon wrote: >> >>> +1! >>> >>> On Wed, 1 Jun 2022 at 16:29, Mark Thomas wrote: >>> Xiao, A rough outline of

[LincolnTalk] Original Intent

2022-05-24 Thread sarah cannon holden
Good Evening, I just have to speak out having just heard the latest news from Texas. The guns in this country have to go. The framers of the Constitution would be horrified if they saw what is happening in this country with gun violence. When the Constitution was written men had muskets that

Re: Reverse proxy for Spark UI on Kubernetes

2022-05-17 Thread Holden Karau
Could we make it do the same sort of history server fallback approach? On Tue, May 17, 2022 at 10:41 PM bo yang wrote: > It is like Web Application Proxy in YARN ( > https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html), > to provide easy access for Spark

Re: Reverse proxy for Spark UI on Kubernetes

2022-05-17 Thread Holden Karau
Could we make it do the same sort of history server fallback approach? On Tue, May 17, 2022 at 10:41 PM bo yang wrote: > It is like Web Application Proxy in YARN ( > https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html), > to provide easy access for Spark

Re: Reverse proxy for Spark UI on Kubernetes

2022-05-17 Thread Holden Karau
Oh that’s rad  On Tue, May 17, 2022 at 7:47 AM bo yang wrote: > Hi Spark Folks, > > I built a web reverse proxy to access Spark UI on Kubernetes (working > together with https://github.com/GoogleCloudPlatform/spark-on-k8s-operator). > Want to share here in case other people have similar need.

Re: Reverse proxy for Spark UI on Kubernetes

2022-05-17 Thread Holden Karau
Oh that’s rad  On Tue, May 17, 2022 at 7:47 AM bo yang wrote: > Hi Spark Folks, > > I built a web reverse proxy to access Spark UI on Kubernetes (working > together with https://github.com/GoogleCloudPlatform/spark-on-k8s-operator). > Want to share here in case other people have similar need.

Re: [VOTE] Release Spark 3.3.0 (RC1)

2022-05-11 Thread Holden Karau
> On Wed, May 11, 2022 at 4:23 AM Hyukjin Kwon wrote: > >> I expect to see RC2 too. I guess he just sticks to the standard, leaving >> the vote open till the end. >> It hasn't got enough +1s anyway :-). >> >> On Wed, 11 May 2022 at 10:17, Holden Karau wrote: >>

Re: [VOTE] Release Spark 3.3.0 (RC1)

2022-05-10 Thread Holden Karau
Technically release don't follow vetos (see https://www.apache.org/foundation/voting.html ) it's up to the RM if they get the minimum number of binding +1s (although they are encouraged to cancel the release if any serious issues are raised). That being said I'll add my -1 based on the issues

[jira] [Created] (SPARK-39088) Add support for forwarding Spark History requests to live running driver when present

2022-05-02 Thread Holden Karau (Jira)
Holden Karau created SPARK-39088: Summary: Add support for forwarding Spark History requests to live running driver when present Key: SPARK-39088 URL: https://issues.apache.org/jira/browse/SPARK-39088

[jira] [Commented] (SPARK-38969) Graceful decomissionning on Kubernetes fails / decom script error

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530922#comment-17530922 ] Holden Karau commented on SPARK-38969: -- Most likely it's from the `timeout 60` in there (at least

[jira] [Commented] (SPARK-38158) Rdd and shuffle blocks not migrated to new executors when decommission feature is enabled

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530916#comment-17530916 ] Holden Karau commented on SPARK-38158: -- Do you have executor logs? > Rdd and shuffle blo

[jira] [Commented] (SPARK-38408) Add option for partial nested field writes with nullable fields.

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17530915#comment-17530915 ] Holden Karau commented on SPARK-38408: -- More general > Add option for partial nested field wri

[jira] [Resolved] (SPARK-33178) Dynamic Scaling In/Scaling out of executors - Kubernetes

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-33178. -- Resolution: Incomplete Resolved since there is not enough info for what the request

[jira] [Resolved] (SPARK-34104) Allow users to specify a maximum decommissioning time

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-34104. -- Fix Version/s: 3.2.0 Resolution: Fixed > Allow users to specify a maxi

[jira] [Resolved] (SPARK-34105) In addition to killing exlcuded/flakey executors which should support decommissioning

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-34105. -- Fix Version/s: 3.2.0 Resolution: Fixed > In addition to killing exlcuded/fla

[jira] [Resolved] (SPARK-34530) logError for interrupting block migrations is too high

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-34530. -- Resolution: Incomplete > logError for interrupting block migrations is too h

[jira] [Resolved] (SPARK-36664) Log time spent waiting for cluster resources

2022-05-02 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-36664. -- Fix Version/s: 3.4.0 Assignee: Holden Karau Resolution: Fixed > Log t

[Libreoffice-commits] core.git: icon-themes/breeze icon-themes/breeze_dark icon-themes/colibre icon-themes/colibre_dark icon-themes/elementary icon-themes/karasa_jaga icon-themes/sifr icon-themes/sifr

2022-04-28 Thread Dhiraj Holden (via logerrit)
b5e838334b57fee1e38febd95f944698059dfe4a Author: Dhiraj Holden AuthorDate: Sun Apr 10 21:17:17 2022 -0400 Commit: Heiko Tietze CommitDate: Thu Apr 28 10:48:38 2022 +0200 tdf#144788 Split up footnotes and endnotes in Navigator This patch splits the footnotes and endnotes section in Navigator

[spark] branch master updated: [SPARK-36664][CORE] Log time waiting for cluster resources

2022-04-25 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 148918b5469 [SPARK-36664][CORE] Log time waiting

Re: [LincolnTalk] Great new car service for Lincolnites

2022-04-24 Thread Sarah Cannon Holden
Can you let us know the fee from Lincoln to Logan? And Logan to Lincoln? Sarah Cannon Holden > On Apr 24, 2022, at 2:59 PM, V Saleme wrote: > >  > Also, > > Don’t forget about (Lincoln) resident Alan Giles either folks, arguably the > best in the business! > > V

bug#55059: bug in `guix pull`

2022-04-23 Thread Holden Green
guest@gnu ~/tmp/1$ guix pull Updating channel 'guix' from Git repository at ' https://git.savannah.gnu.org/git/guix.git'... Authenticating channel 'guix', commits 9edb3f6 to eb34ff1 (17,927 new commits)... Building from this channel: guix https://git.savannah.gnu.org/git/guix.git eb34ff1

[Python-Dev] Re: Descriptions in unittest and avoiding confusion

2022-04-06 Thread Steve Holden
On Mon, Apr 4, 2022 at 4:13 PM Coyot Linden (Glenn Glazer) < co...@lindenlab.com> wrote: > I would like to point out another use case of triple quotes outside of > docstrings. We do a lot of SQL here and so doing a parameterized query > like: > > """SELECT foo > FROM bar > WHERE baz = %s""" > >

[Python-Dev] Re: Enhancing generic type documentation in the standard library

2022-03-30 Thread Steve Holden
Not defining the semantics of annotations was a brave move, but inevitably led to the situation where different use cases, all quite reasonable, would spring into being. Now they have, the development team has to decide a) which ones to sanction and b) which will be left out in the cold. I wish

[Python-Dev] Re: Are "Batteries Included" still a Good Thing? [was: It's now time to deprecate the stdlib urllib module]

2022-03-27 Thread Steve Holden
Time for a __legacy__ package? Kind regards, Steve On Sun, Mar 27, 2022 at 7:06 PM Paul Moore wrote: > On Sun, 27 Mar 2022 at 17:11, Christopher Barker > wrote: > > > > With the json package included, all they need to do is `import json`. If > that wasn't there, they's look in PyPi for a

Re: [arin-ppml] Revised and Retitled - Draft Policy ARIN-2021-6: Permit IPv4 Leased Addresses for Purposes of Determining Utilization for Future Allocations

2022-03-17 Thread Holden Karau
Wait so some company could come to ARIN and ask for a block of IP addresses using leasing as the justification and then turn around and lease them. What value is the leasing company providing? It seems like a solid way to get a bunch of LLCs formed to acquire IP addresses from the waiting list

Re: Apache Spark 3.3 Release

2022-03-16 Thread Holden Karau
feature work that are not being well > discussed. > > > > > > > > On Tue, Mar 15, 2022 at 12:12 PM Xiao Li wrote: > > > > Cutting the branch is simple, but we need to avoid backporting the > feature work that are not being well discussed. Not all the members are >

[jira] [Resolved] (SPARK-38561) Add doc for "Customized Kubernetes Schedulers"

2022-03-16 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-38561. -- Fix Version/s: 3.3.0 Assignee: Yikun Jiang Resolution: Fixed > Add

[jira] [Updated] (SPARK-38503) Add warn for getAdditionalPreKubernetesResources in executor side

2022-03-16 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-38503: - Target Version/s: 3.4.0 > Add warn for getAdditionalPreKubernetesResources in executor s

[spark] branch master updated: [SPARK-38561][K8S][DOCS] Add doc for `Customized Kubernetes Schedulers`

2022-03-16 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4ff40c1 [SPARK-38561][K8S][DOCS] Add doc

Re: Apache Spark 3.3 Release

2022-03-15 Thread Holden Karau
May I suggest we push out one week (22nd) just to give everyone a bit of breathing space? Rushed software development more often results in bugs. On Tue, Mar 15, 2022 at 6:23 AM Yikun Jiang wrote: > > To make our release time more predictable, let us collect the PRs and > wait three more days

Re: Apache Spark 3.3 Release

2022-03-14 Thread Holden Karau
On Mon, Mar 14, 2022 at 11:53 PM Xiao Li wrote: > Could you please list which features we want to finish before the branch > cut? How long will they take? > > Xiao > > Chao Sun 于2022年3月14日周一 13:30写道: > >> Hi Max, >> >> As there are still some ongoing work for the above listed SPIPs, can we >>

Re: CVE-2021-38296: Apache Spark Key Negotiation Vulnerability

2022-03-09 Thread Holden Karau
CVEs are generally not mentioned in the release notes or JIRA instead we track them at https://spark.apache.org/security.html once they are resolved (prior to the resolution the reports goes to secur...@spark.apache.org) to allow the project time to fix the issue before public disclosure so there

[jira] [Created] (SPARK-38408) Add option for partial nested field writes with nullable fields.

2022-03-03 Thread Holden Karau (Jira)
Holden Karau created SPARK-38408: Summary: Add option for partial nested field writes with nullable fields. Key: SPARK-38408 URL: https://issues.apache.org/jira/browse/SPARK-38408 Project: Spark

[python-uk] Fwd: It Will Never Work in Theory: live!

2022-03-03 Thread Steve Holden
: It Will Never Work in Theory: live! To: Steve Holden Hi Steve, On April 27, It Will Never Work in Theory is running two sets of online lightning talks from leading software engineering researchers in which they’ll summarize actionable findings from their work for practitioners. Tickets are now

Re: [ANNOUNCE] Apache Spark 3.1.3 released + Docker images

2022-02-25 Thread Holden Karau
maël > > ps. Any plans to make this images official docker images at some point > (for the extra security/validation) [1] > [1] https://docs.docker.com/docker-hub/official_images/ > > On Mon, Feb 21, 2022 at 10:09 PM Holden Karau > wrote: > > > > We are happy t

Re: [ANNOUNCE] Apache Spark 3.1.3 released + Docker images

2022-02-22 Thread Holden Karau
. On Tue, Feb 22, 2022 at 10:51 AM Denis Bolshakov wrote: > Hello Holden, > > Could you please provide more details and plan for docker images support? > > So far I see that there are only two tags, I get from them spark version, > but there is no information about java, hado

Re: [ANNOUNCE] Apache Spark 3.1.3 released + Docker images

2022-02-21 Thread Holden Karau
ybodywiki.com/Mich_Talebzadeh > > > > *Disclaimer:* Use it at your own risk. Any and all responsibility for any > loss, damage or destruction of data or any other property which may arise > from relying on this email's technical content is explicitly disclaimed. > The author will in

[spark-website] branch asf-site updated: Fix dockerhub link

2022-02-21 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new d0d3def Fix dockerhub link d0d3def

Re: [ANNOUNCE] Apache Spark 3.1.3 released + Docker images

2022-02-21 Thread Holden Karau
g on this email's technical content is explicitly disclaimed. > The author will in no case be liable for any monetary damages arising from > such loss, damage or destruction. > > > > > On Mon, 21 Feb 2022 at 21:09, Holden Karau wrote: > >> We are happy to annou

[ANNOUNCE] Apache Spark 3.1.3 released + Docker images

2022-02-21 Thread Holden Karau
to (thanks to NV for the ARM64 machines). You can get them from https://hub.docker.com/apache/spark (and spark-r and spark-py) :) (And version 3.2.1 is also now published on Dockerhub). Holden -- Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https

[spark-website] branch asf-site updated (08c07ea -> e631332)

2022-02-21 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git. from 08c07ea Regenerate site. new a5c41b0 Fix 3.1.3 doc link new e631332 Fix detailed change link

[spark-website] 01/02: Fix 3.1.3 doc link

2022-02-21 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git commit a5c41b0d1f491585dea3d89c3aca660efa954446 Author: Holden Karau AuthorDate: Mon Feb 21 11:58:03 2022 -0800

[spark-website] 02/02: Fix detailed change link for Spark 3.1.3

2022-02-21 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git commit e631332c8ac7ee45b0e1cd4d3ad34320a7bc9124 Author: Holden Karau AuthorDate: Mon Feb 21 12:01:20 2022 -0800

[spark-website] 01/03: Initial 3.1.3 addition

2022-02-21 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git commit cce59bf813570795e1d25d42a98e7c06de413ec5 Author: Holden Karau AuthorDate: Fri Feb 18 17:24:39 2022 -0800

svn commit: r52683 - in /dev/spark: v3.1.3-rc1-bin/ v3.1.3-rc2-bin/ v3.1.3-rc2-docs/ v3.1.3-rc3-bin/ v3.1.3-rc3-docs/ v3.1.3-rc4-docs/

2022-02-21 Thread holden
Author: holden Date: Mon Feb 21 19:39:18 2022 New Revision: 52683 Log: Removing RC artifacts. Removed: dev/spark/v3.1.3-rc1-bin/ dev/spark/v3.1.3-rc2-bin/ dev/spark/v3.1.3-rc2-docs/ dev/spark/v3.1.3-rc3-bin/ dev/spark/v3.1.3-rc3-docs/ dev/spark/v3.1.3-rc4-docs

[spark] tag v3.1.3 created (now d1f8a50)

2022-02-21 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v3.1.3 in repository https://gitbox.apache.org/repos/asf/spark.git. at d1f8a50 (commit) No new revisions were added by this update

svn commit: r52631 - /dev/spark/v3.1.3-rc4-bin/ /release/spark/spark-3.1.3/

2022-02-18 Thread holden
Author: holden Date: Fri Feb 18 22:56:11 2022 New Revision: 52631 Log: Release Spark 3.1.3 Added: release/spark/spark-3.1.3/ - copied from r52630, dev/spark/v3.1.3-rc4-bin/ Removed: dev/spark/v3.1.3-rc4-bin

Re: [VOTE] Spark 3.1.3 RC4

2022-02-18 Thread Holden Karau
The vote passes with no 0s or -1s and the following +1: Holden Karau John Zhuge Mridul Muralidharan Thomas graves Gengliang Wang Wenchen Fan Yuming Wang Ruifeng Zheng Sean Owen I will begin finalizing the release now. On Fri, Feb 18, 2022 at 2:49 PM Holden Karau wrote: > +1 my s

Re: [VOTE] Spark 3.1.3 RC4

2022-02-18 Thread Holden Karau
ith -Pyarn -Pmesos -Pkubernetes >> >> Regards, >> Mridul >> >> >> On Wed, Feb 16, 2022 at 8:32 AM Thomas graves wrote: >> >>> +1 >>> >>> Tom >>> >>> On Mon, Feb 14, 2022 at 2:55 PM Holden Karau >>> wrote:

[jira] [Created] (HADOOP-18132) S3 exponential backoff

2022-02-18 Thread Holden Karau (Jira)
Holden Karau created HADOOP-18132: - Summary: S3 exponential backoff Key: HADOOP-18132 URL: https://issues.apache.org/jira/browse/HADOOP-18132 Project: Hadoop Common Issue Type: Improvement

[jira] [Created] (HADOOP-18132) S3 exponential backoff

2022-02-18 Thread Holden Karau (Jira)
Holden Karau created HADOOP-18132: - Summary: S3 exponential backoff Key: HADOOP-18132 URL: https://issues.apache.org/jira/browse/HADOOP-18132 Project: Hadoop Common Issue Type: Improvement

Re: Bearer Token Refresh Task

2022-02-17 Thread Holden Karau
While we’re talking about this, for engines like Spark/Flink/Dask/Ray where we might have many executors does it make sense to have centralized refresh instead of each executor doing a refresh on token expiration? On Thu, Feb 17, 2022 at 12:40 PM David Li wrote: > That sounds reasonable. > > I

[LincolnTalk] Town Meeting and Elections 2022

2022-02-16 Thread sarah cannon holden
fice any questions that you might have about voting and voter registration. Thank you. I look forward to seeing you on March 26th. Check in begins at 8:30 am. Meeting will begin at 9:30 am. Sarah Cannon Holden Town Moderator -- The LincolnTalk mailing list. To post, send mail to Lincoln@linco

[VOTE] Spark 3.1.3 RC4

2022-02-14 Thread Holden Karau
Please vote on releasing the following candidate as Apache Spark version 3.1.3. The vote is open until Feb. 18th at 1 PM pacific (9 PM GMT) and passes if a majority +1 PMC votes are cast, with a minimum of 3 + 1 votes. [ ] +1 Release this package as Apache Spark 3.1.3 [ ] -1 Do not release this

Re: Unable to access Google buckets using spark-submit

2022-02-12 Thread Holden Karau
You can also put the GS access jar with your Spark jars — that’s what the class not found exception is pointing you towards. On Fri, Feb 11, 2022 at 11:58 PM Mich Talebzadeh wrote: > BTW I also answered you in in stackoverflow : > > >

Re: Change Data Capture for Iceberg

2022-02-11 Thread Holden Karau
Oh cool, I have not had a chance to review much of this, but I was having a conversation with a team which wanted similar features for a table so excited to see folks working on it  On Fri, Feb 11, 2022 at 12:40 PM Yufei Gu wrote: > Hi team, > > We propose a way to generate the CDC records

[BVARC] Radio and Equipment for Sale

2022-02-10 Thread David Holden via BVARC
I am helping a Ham Radio widow sell some gear from the estate of her late husband. The following are available. Yeasu FT-857D. Includes the optional Yeasu DTMF mic MH-36E8J, the standard mic, 2 power cords, the manual and some additional documentation and a pair of external speakers. $500 

[BVARC] Radio and Equipment For Sale

2022-02-10 Thread David Holden via BVARC
 I have been helping a ham widow review a rig and equipment from the estate of her late husband. The following items are for sale.   Yeasu FT-857D. Includes the optional Yeasu DTMF mic MH-36E8J, the standard mic, 2 power cords, the manual and some additional documentation and a pair of external

Re: [VOTE] Spark 3.1.3 RC3

2022-02-08 Thread Holden Karau
Yup, I’ve run into some weirdness with docs again I want to verify before I send the vote email though. On Mon, Feb 7, 2022 at 10:06 PM Wenchen Fan wrote: > Shall we use the release scripts of branch 3.1 to release 3.1? > > On Fri, Feb 4, 2022 at 4:57 AM Holden Karau wrote: > &

svn commit: r52419 - in /dev/spark/v3.1.3-rc4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/parqu

2022-02-06 Thread holden
Author: holden Date: Mon Feb 7 00:26:19 2022 New Revision: 52419 Log: Apache Spark v3.1.3-rc4 docs [This commit notification would consist of 2264 parts, which exceeds the limit of 50 ones, so it was shortened to the summary

svn commit: r52418 - /dev/spark/v3.1.3-rc4-bin/

2022-02-06 Thread holden
Author: holden Date: Sun Feb 6 23:22:00 2022 New Revision: 52418 Log: Apache Spark v3.1.3-rc4 Added: dev/spark/v3.1.3-rc4-bin/ dev/spark/v3.1.3-rc4-bin/SparkR_3.1.3.tar.gz (with props) dev/spark/v3.1.3-rc4-bin/SparkR_3.1.3.tar.gz.asc dev/spark/v3.1.3-rc4-bin/SparkR_3.1.3

[spark] 01/01: Preparing development version 3.1.4-SNAPSHOT

2022-02-06 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git commit 0b35c2464f805970d2a62ccc757616332287eb2b Author: Holden Karau AuthorDate: Sun Feb 6 22:17:37 2022 +

[spark] branch branch-3.1 updated (7540421 -> 0b35c24)

2022-02-06 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to branch branch-3.1 in repository https://gitbox.apache.org/repos/asf/spark.git. from 7540421 Preparing development version 3.1.4-SNAPSHOT add d1f8a50 Preparing Spark release v3.1.3-rc4

[spark] 01/01: Preparing Spark release v3.1.3-rc4

2022-02-06 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a commit to tag v3.1.3-rc4 in repository https://gitbox.apache.org/repos/asf/spark.git commit d1f8a503a26bcfb4e466d9accc5fa241a7933667 Author: Holden Karau AuthorDate: Sun Feb 6 22:17:33 2022 + Preparing

[spark] tag v3.1.3-rc4 created (now d1f8a50)

2022-02-06 Thread holden
This is an automated email from the ASF dual-hosted git repository. holden pushed a change to tag v3.1.3-rc4 in repository https://gitbox.apache.org/repos/asf/spark.git. at d1f8a50 (commit) This tag includes the following new commits: new d1f8a50 Preparing Spark release v3.1.3-rc4

<    1   2   3   4   5   6   7   8   9   10   >