No offence taken. Glad that it was rectified. Cheers
Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On 2 September 2016 at 16:03, Nicholas Chammas <nicholas.cham...@gmail.com> wrote: > I apologize for my harsh tone. You are right, it was unnecessary and > discourteous. > > On Fri, Sep 2, 2016 at 11:01 AM Mich Talebzadeh <mich.talebza...@gmail.com> > wrote: > >> Hi, >> >> You made such statement: >> >> "That's complete nonsense." >> >> That is a strong language and void of any courtesy. Only dogmatic >> individuals make such statements, engaging the keyboard before thinking >> about it. >> >> You are perfectly in your right to agree to differ. However, that does >> not give you the right to call other peoples opinion nonsense. >> >> >> >> Dr Mich Talebzadeh >> >> >> >> LinkedIn * >> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* >> >> >> >> http://talebzadehmich.wordpress.com >> >> >> *Disclaimer:* Use it at your own risk. Any and all responsibility for >> any loss, damage or destruction of data or any other property which may >> arise from relying on this email's technical content is explicitly >> disclaimed. The author will in no case be liable for any monetary damages >> arising from such loss, damage or destruction. >> >> >> >> On 2 September 2016 at 15:54, Nicholas Chammas < >> nicholas.cham...@gmail.com> wrote: >> >>> You made a specific claim -- that Spark will move away from Python -- >>> which I responded to with clear references and data. How on earth is that a >>> "religious argument"? >>> >>> I'm not saying that Python is better than Scala or anything like that. >>> I'm just addressing your specific claim about its future in the Spark >>> project. >>> >>> On Fri, Sep 2, 2016 at 10:48 AM Mich Talebzadeh < >>> mich.talebza...@gmail.com> wrote: >>> >>>> Right so. We are back into religious arguments. Best of luck >>>> >>>> >>>> >>>> Dr Mich Talebzadeh >>>> >>>> >>>> >>>> LinkedIn * >>>> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >>>> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* >>>> >>>> >>>> >>>> http://talebzadehmich.wordpress.com >>>> >>>> >>>> *Disclaimer:* Use it at your own risk. Any and all responsibility for >>>> any loss, damage or destruction of data or any other property which may >>>> arise from relying on this email's technical content is explicitly >>>> disclaimed. The author will in no case be liable for any monetary damages >>>> arising from such loss, damage or destruction. >>>> >>>> >>>> >>>> On 2 September 2016 at 15:35, Nicholas Chammas < >>>> nicholas.cham...@gmail.com> wrote: >>>> >>>>> On Fri, Sep 2, 2016 at 3:58 AM Mich Talebzadeh < >>>>> mich.talebza...@gmail.com> wrote: >>>>> >>>>>> I believe as we progress in time Spark is going to move away from >>>>>> Python. If you look at 2014 Databricks code examples, they were >>>>>> mostly in Python. Now they are mostly in Scala for a reason. >>>>>> >>>>> >>>>> That's complete nonsense. >>>>> >>>>> First off, you can find dozens and dozens of Python code examples >>>>> here: https://github.com/apache/spark/tree/master/ >>>>> examples/src/main/python >>>>> >>>>> The Python API was added to Spark in 0.7.0 >>>>> <http://spark.apache.org/news/spark-0-7-0-released.html>, back in >>>>> February of 2013, before Spark was even accepted into the Apache >>>>> incubator. >>>>> Since then it's undergone major and continuous development. Though it does >>>>> lag behind the Scala API in some areas, it's a first-class language and >>>>> bringing it up to parity with Scala is an explicit project goal. A quick >>>>> example off the top of my head is all the work that's going into model >>>>> import/export for Python: SPARK-11939 >>>>> <https://issues.apache.org/jira/browse/SPARK-11939> >>>>> >>>>> Additionally, according to the 2015 Spark Survey >>>>> <http://cdn2.hubspot.net/hubfs/438089/DataBricks_Surveys_-_Content/Spark-Survey-2015-Infographic.pdf?t=1472746902480>, >>>>> 58% of Spark users use the Python API, more than any other language save >>>>> for Scala (71%). (Users can select multiple languages on the survey.) >>>>> Python users were also the 3rd-fastest growing "demographic" for Spark, >>>>> after Windows and Spark Streaming users. >>>>> >>>>> Any notion that Spark is going to "move away from Python" is >>>>> completely contradicted by the facts. >>>>> >>>>> Nick >>>>> >>>>> >>>> >>
