Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-26 Thread Hyukjin Kwon
This is already getting too long to follow the original topic. Would be great if we can separate others to a different thread. On Mon, Feb 27, 2023 at 7:41 AM Mich Talebzadeh wrote: > if we are going to do it, we might as well do it all. it is more cost > effective so to speak. > > > HTH > > >

Fwd: 自动回复: Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-26 Thread Mich Talebzadeh
amages arising from such loss, damage or destruction. -- Forwarded message - From: xyqiao Date: Sun, 26 Feb 2023 at 22:42 Subject: 自动回复: Re: [DISCUSS] Show Python code examples first in Spark documentation To: Mich Talebzadeh 这是来自QQ邮箱的假期自动回复邮件。 您好,我最近正在休假中,无法亲自回复您的邮件。我将在假期结束后,尽快给您回复。

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-26 Thread Mich Talebzadeh
if we are going to do it, we might as well do it all. it is more cost effective so to speak. HTH view my Linkedin profile https://en.everybodywiki.com/Mich_Talebzadeh *Disclaimer:* Use it at your own risk. Any and all

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-26 Thread Hyukjin Kwon
Probably it's worthwhile discussing the order for others but I would keep it separate from this thread to focus on Python as the default since that can be done as an incremental improvement. On Mon, Feb 27, 2023 at 3:36 AM Mich Talebzadeh wrote: > > To me as I stated before this is a

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-26 Thread Mich Talebzadeh
To me as I stated before this is a tangential issue. However, if it has to be done, we ought to work out how much effort is needed). Besides, how about others? [image: image.png] what next in the order? 1. Python 2. Scala 3. SQL 4. Java 5. R SQL is still very important and

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-25 Thread Matei Zaharia
ut I hope we can give clear communication > and direction in this effort because this is one of the most user-facing > changes. > > Dongjoon. > > On Wed, Feb 22, 2023 at 5:26 PM 416161...@qq.com <mailto:416161...@qq.com> > mailto:ruife...@foxmail.com

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Santosh Pingale
gt; more versions, etc. At least scheduled jobs like we're doing JDK and >>>>>>> Scala >>>>>>> versions. >>>>>>> >>>>>>> >>>>>>> FWIW, my take about this change is: people use Python and PySpark

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Hyukjin Kwon
s first :-). >>>>>> >>>>>> >>>>>> On Thu, 23 Feb 2023 at 10:27, Dongjoon Hyun >>>>>> wrote: >>>>>> >>>>>>> I have two questions to clarify the scope and boundaries. >>>>>>> >>&

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Santosh Pingale
been the full feature >>>>>> because >>>>>> they are the underlying main developer languages while Python/R/SQL >>>>>> environments were the nice-to-have. >>>>>> >>>>>> 2. Does this suggestion assume that

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Allan Folting
e nice-to-have. >>>>> >>>>> 2. Does this suggestion assume that the Python environment is easier >>>>> for users than Scala/Java always? Given that we support Python 3.8 to >>>>> 3.11, >>>>> the support matrix for Python library depen

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Dongjoon Hyun
storically and we have many `Pinned` python libraries issues. >>>> >>>> Changing documentation is easy, but I hope we can give clear >>>> communication and direction in this effort because this is one of the most >>>> user-facing changes. >>>> >>>> Dongjo

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Allan Folting
tion in this effort because this is one of the most >>> user-facing changes. >>> >>> Dongjoon. >>> >>> On Wed, Feb 22, 2023 at 5:26 PM 416161...@qq.com >>> wrote: >>> >>>> +1 LGTM >>>> >>>> --

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-23 Thread Mich Talebzadeh
d_midpage=true=Ruifeng+Zheng=https%3A%2F%2Fres.mail.qq.com%2Fzh_CN%2Fhtmledition%2Fimages%2Frss%2Fmale.gif%3Frand%3D1617349242=ruifengz%40foxmail.com=> >>> >>> >>> >>> -- Original -- >>> *From:* "Xinrong Meng" ; >>&

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Hyukjin Kwon
%40foxmail.com=> >> >> >> >> -- Original ------ >> *From:* "Xinrong Meng" ; >> *Date:* Thu, Feb 23, 2023 09:17 AM >> *To:* "Allan Folting"; >> *Cc:* "dev"; >> *Subject:* Re: [DISCUSS] S

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Dongjoon Hyun
gt; *From:* "Xinrong Meng" ; > *Date:* Thu, Feb 23, 2023 09:17 AM > *To:* "Allan Folting"; > *Cc:* "dev"; > *Subject:* Re: [DISCUSS] Show Python code examples first in Spark > documentation > > +1 Good idea! > > On Thu, Feb 23, 2023 at 7:41

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread 416161...@qq.com
+1 LGTM RuifengZheng ruife...@foxmail.com --Original-- From: "Xinrong Meng"

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Xinrong Meng
+1 Good idea! On Thu, Feb 23, 2023 at 7:41 AM Jack Goodson wrote: > Good idea, at the company I work at we discussed using Scala as our > primary language because technically it is slightly stronger than python > but ultimately chose python in the end as it’s easier for other devs to be > on

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Jack Goodson
Good idea, at the company I work at we discussed using Scala as our primary language because technically it is slightly stronger than python but ultimately chose python in the end as it’s easier for other devs to be on boarded to our platform and future hiring for the team etc would be easier On

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Hyukjin Kwon
+1 I like this idea too. On Thu, Feb 23, 2023 at 6:00 AM Allan Folting wrote: > Hi all, > > I would like to propose that we show Python code examples first in the > Spark documentation where we have multiple programming language examples. > An example is on the Quick Start page: >

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Mich Talebzadeh
I have seen many data engineering teams start out with Scala because technically it is the best choice for many given reasons and basically it is what Spark is. I also concur that Python is more popular than Scala because of the advent of data science. A majority of use cases we see these days are

Re: [DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Sean Owen
FWIW I agree with this. On Wed, Feb 22, 2023 at 2:59 PM Allan Folting wrote: > Hi all, > > I would like to propose that we show Python code examples first in the > Spark documentation where we have multiple programming language examples. > An example is on the Quick Start page: >

[DISCUSS] Show Python code examples first in Spark documentation

2023-02-22 Thread Allan Folting
Hi all, I would like to propose that we show Python code examples first in the Spark documentation where we have multiple programming language examples. An example is on the Quick Start page: https://spark.apache.org/docs/latest/quick-start.html I propose this change because Python has become