Re: Scala, Python or Java for Spark programming

2017-06-13 Thread Irving Duran
I agree with most of the statements. I would add that there is more support in the python community than scala (nowadays). Which it will make it easier for a new programmer to learn. On Sat, Jun 10, 2017 at 6:43 PM vaquar khan wrote: > It's depends on programming style

Re: Scala, Python or Java for Spark programming

2017-06-10 Thread vaquar khan
It's depends on programming style ,I would like to say setup few rules to avoid complex code in scala , if needed ask programmer to add proper comments. Regards, Vaquar khan On Jun 8, 2017 4:17 AM, "JB Data" wrote: > Java is Object langage borned to Data, Python is Data

Re: Scala, Python or Java for Spark programming

2017-06-08 Thread JB Data
Java is Object langage borned to Data, Python is Data langage borned to Objects or else... Eachone has its owns uses. @JBD 2017-06-08 8:44 GMT+02:00 Jörn Franke : > A slight advantage of Java is also the tooling that exist around it - > better

Re: Scala, Python or Java for Spark programming

2017-06-08 Thread Jörn Franke
A slight advantage of Java is also the tooling that exist around it - better support by build tools and plugins, advanced static code analysis (security, bugs, performance) etc. > On 8. Jun 2017, at 08:20, Mich Talebzadeh wrote: > > What I like about Scala is that

Re: Scala, Python or Java for Spark programming

2017-06-08 Thread Mich Talebzadeh
What I like about Scala is that it is less ceremonial compared to Java. Java users claim that Scala is built on Java so the error tracking is very difficult. Also Scala sits on top of Java and that makes it virtually depending on Java. For me the advantage of Scala is its simplicity and

Re: Scala, Python or Java for Spark programming

2017-06-07 Thread Matt Tenenbaum
A lot depends on your context as well. If I'm using Spark _for analysis_, I frequently use python; it's a starting point, from which I can then leverage pandas, matplotlib/seaborn, and other powerful tools available on top of python. If the Spark outputs are the ends themselves, rather than the

Re: Scala, Python or Java for Spark programming

2017-06-07 Thread Bryan Jeffrey
Mich, We use Scala for a large project. On our team we've set a few standards to ensure readability (we try to avoid excessive use of tuples, use named functions, etc.) Given these constraints, I find Scala to be very readable, and far easier to use than Java. The Lambda functionality of Java

Re: Scala, Python or Java for Spark programming

2017-06-07 Thread Jörn Franke
I think this is a religious question ;-) Java is often underestimated, because people are not aware of its lambda functionality which makes the code very readable. Scala - it depends who programs it. People coming with the normal Java background write Java-like code in scala which might not be

Scala, Python or Java for Spark programming

2017-06-07 Thread Mich Talebzadeh
Hi, I am a fan of Scala and functional programming hence I prefer Scala. I had a discussion with a hardcore Java programmer and a data scientist who prefers Python. Their view is that in a collaborative work using Scala programming it is almost impossible to understand someone else's Scala