Re: [DISCUSS] Apache Spark 3.0.1 Release

+1 (non-binding) Sent from my iPhone Pardon the dumb thumb typos :) > On Jun 23, 2020, at 11:36 AM, Holden Karau wrote: > >  > +1 on a patch release soon > >> On Tue, Jun 23, 2020 at 10:47 AM Reynold Xin wrote: >> +1 on doing a new patch release soon. I saw some of these issues when >>

Re: [VOTE] Amend Spark's Semantic Versioning Policy

+1 (non-binding) Sent from my iPhone Pardon the dumb thumb typos :) > On Mar 6, 2020, at 7:09 PM, Sean Owen wrote: > > +1 > >> On Fri, Mar 6, 2020 at 8:59 PM Michael Armbrust >> wrote: >> >> I propose to add the following text to Spark's Semantic Versioning policy >> and adopt it as the

Re: [Proposal] Modification to Spark's Semantic Versioning Policy

+1 Well said! Sent from my iPhone Pardon the dumb thumb typos :) > On Feb 24, 2020, at 3:03 PM, Michael Armbrust wrote: > >  > Hello Everyone, > > As more users have started upgrading to Spark 3.0 preview (including myself), > there have been many discussions around APIs that have been

Re: Request to document the direct relationship between other configurations

All are valid and valuable observations to put into practice: * structured and meaningful config names * explainable text or succinct description * easily accessible or searchable While these are aspirational but gradually doable if we make it part of the dev and review cycle. Often

Re: More publicly documenting the options under spark.sql.*

It’s one thing to get the names/values of the configurations, via the Spark.sql(“set -v”), but another thing to understand what each achieves and when and why you’ll want to use it. A webpage with a table and description of each is huge benefit. Cheers Jules Sent from my iPhone Pardon the

Re: Should python-2 be supported in Spark 3.0?

Here’s the tweet from the horse’s mouth: https://twitter.com/gvanrossum/status/1133496146700058626?s=21 Cheers Jules — Sent from my iPhone Pardon the dumb thumb typos :) > On May 29, 2019, at 10:12 PM, Sean Owen wrote: > > Deprecated -- certainly and sooner than later. > I don't have a

Re: [VOTE][SPARK-27396] SPIP: Public APIs for extended Columnar Processing Support

+ (non-binding) Sent from my iPhone Pardon the dumb thumb typos :) > On Apr 19, 2019, at 10:30 AM, Bryan Cutler wrote: > > +1 (non-binding) > >> On Thu, Apr 18, 2019 at 11:41 AM Jason Lowe wrote: >> +1 (non-binding). Looking forward to seeing better support for processing >> columnar data.

Re: Standardized Join Types for DataFrames

Also, Holden Karau conducts PR requests reviews and shows how you can contribute to this communal project. Attend one of her live PR sessions. Cheers Jules Sent from my iPhone Pardon the dumb thumb typos :) > On Feb 22, 2019, at 7:16 AM, Pooja Agrawal wrote: > > Hi, > > I am new to spark

Re: Welcome Jose Torres as a Spark committer

Congrats Jose! Sent from my iPhone Pardon the dumb thumb typos :) > On Jan 29, 2019, at 11:07 AM, shane knapp wrote: > > congrats, and welcome! > >> On Tue, Jan 29, 2019 at 11:07 AM Dean Wampler wrote: >> Congrats, Jose! >> >> Dean Wampler, Ph.D. >> VP, Fast Data Engineering at Lightbend

Re: [VOTE] [SPARK-25994] SPIP: DataFrame-based Property Graphs, Cypher Queries, and Algorithms

+1 (non-binding) (Heard their proposed tech-talk at Spark + A.I summit in London. Well attended & well received.) — Sent from my iPhone Pardon the dumb thumb typos :) > On Jan 29, 2019, at 7:30 AM, Denny Lee wrote: > > +1 > > yay - let's do it! > >> On Tue, Jan 29, 2019 at 6:28 AM

Re: [ANNOUNCE] Announcing Apache Spark 2.4.0

Indeed! Sent from my iPhone Pardon the dumb thumb typos :) > On Nov 8, 2018, at 11:31 AM, Dongjoon Hyun wrote: > > Finally, thank you all. Especially, thanks to the release manager, Wenchen! > > Bests, > Dongjoon. > > >> On Thu, Nov 8, 2018 at 11:24 AM Wenchen Fan wrote: >> + user list >>

Re: Python friendly API for Spark 3.0

+1 I think phasing out EOL of any feature or supported language is a better strategy if possible than a quick drop. With enough admonition, it can gradually be dropped in 3.x— of course, there are exceptions. Cheers Jules Sent from my iPhone Pardon the dumb thumb typos :) > On Sep 15,

Re: [discuss] replacing SPIP template with Heilmeier's Catechism?

+1 One could argue that the litany of the questions are really a double-click on the essence: why, what, how. The three interrogatives ought to be the essence and distillation of any proposal or technical exposition. Cheers Jules Sent from my iPhone Pardon the dumb thumb typos :) > On Aug

Re: [ANNOUNCE] Announcing Apache Spark 2.3.1

Matei & I own it. I normally tweet or handle Spark related PSAs Cheers Jules Sent from my iPhone Pardon the dumb thumb typos :) > On Jun 14, 2018, at 11:45 AM, Marcelo Vanzin > wrote: > > Hi Jacek, > > I seriously have no idea... I don't even know who owns that account (I > hope they

Re: Generalised Spark-HBase integration

Brilliant! Will check it out. Cheers Jules -- The Best Ideas Are Simple Jules Damji Developer Relations Community Outreach jda...@hortonworks.com http://hortonworks.com On 7/28/15, 8:59 AM, Michal Haris michal.ha...@visualdna.commailto:michal.ha...@visualdna.com wrote: Hi all, last couple