Scala VS Java VS Python

[Daniel Valdivia]

Hello,

This is more of a "survey" question for the community, you can reply to me 
directly so we don't flood the mailing list.

I'm having a hard time learning Spark using Python since the API seems to be 
slightly incomplete, so I'm looking at my options to start doing all my apps in 
either Scala or Java, being a Java Developer, java 1.8 looks like the logical 
way, however I'd like to ask here what's the most common (Scala Or Java) since 
I'm observing mixed results in the social documentation, however Scala seems to 
be the predominant language for spark examples.

Thank for the advice
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: Scala VS Java VS Python

[Daniel Lopes]

For me Scala is better like Spark is written in Scala, and I like python
cuz I always used python for data science. :)

On Wed, Dec 16, 2015 at 5:54 PM, Daniel Valdivia 
wrote:

> Hello,
>
> This is more of a "survey" question for the community, you can reply to me
> directly so we don't flood the mailing list.
>
> I'm having a hard time learning Spark using Python since the API seems to
> be slightly incomplete, so I'm looking at my options to start doing all my
> apps in either Scala or Java, being a Java Developer, java 1.8 looks like
> the logical way, however I'd like to ask here what's the most common (Scala
> Or Java) since I'm observing mixed results in the social documentation,
> however Scala seems to be the predominant language for spark examples.
>
> Thank for the advice
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>


-- 
*Daniel Lopes, B.Eng*
Data Scientist - BankFacil
CREA/SP 5069410560

Mob +55 (18) 99764-2733 
Ph +55 (11) 3522-8009
http://about.me/dannyeuu

Av. Nova Independência, 956, São Paulo, SP
Bairro Brooklin Paulista
CEP 04570-001
https://www.bankfacil.com.br

Re: Scala VS Java VS Python

[Gary Struthers]

“Learning Spark” code examples are in Scala, Java, and Python and is an 
excellent book both for learning Spark and for showing just enough Scala to 
program Spark. 
http://shop.oreilly.com/product/0636920028512.do 


Then compare the api for a Spark RDD and a Scala collection. Spark is Scala’s 
killer app as Martin Ordersky explains in this talk
https://www.youtube.com/watch?v=NW5h8d_ZyOs 


Gary Struthers

Re: Scala VS Java VS Python

[Stephen Boesch]

There are solid reasons to have built spark on the jvm vs python. The
question for Daniel appear to be at this point scala vs java8. For that
there are many comparisons already available: but in the case of working
with spark there is the additional benefit for the scala side that the core
libraries are in that language.

2015-12-16 13:41 GMT-08:00 Darren Govoni <dar...@ontrenet.com>:

> I use python too. I'm actually surprises it's not the primary language
> since it is by far more used in data science than java snd Scala combined.
>
> If I had a second choice of script language for general apps I'd want
> groovy over scala.
>
>
>
> Sent from my Verizon Wireless 4G LTE smartphone
>
>
>  Original message 
> From: Daniel Lopes <dan...@bankfacil.com.br>
> Date: 12/16/2015 4:16 PM (GMT-05:00)
> To: Daniel Valdivia <h...@danielvaldivia.com>
> Cc: user <user@spark.apache.org>
> Subject: Re: Scala VS Java VS Python
>
> For me Scala is better like Spark is written in Scala, and I like python
> cuz I always used python for data science. :)
>
> On Wed, Dec 16, 2015 at 5:54 PM, Daniel Valdivia <h...@danielvaldivia.com>
> wrote:
>
>> Hello,
>>
>> This is more of a "survey" question for the community, you can reply to
>> me directly so we don't flood the mailing list.
>>
>> I'm having a hard time learning Spark using Python since the API seems to
>> be slightly incomplete, so I'm looking at my options to start doing all my
>> apps in either Scala or Java, being a Java Developer, java 1.8 looks like
>> the logical way, however I'd like to ask here what's the most common (Scala
>> Or Java) since I'm observing mixed results in the social documentation,
>> however Scala seems to be the predominant language for spark examples.
>>
>> Thank for the advice
>> -
>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>> For additional commands, e-mail: user-h...@spark.apache.org
>>
>>
>
>
> --
> *Daniel Lopes, B.Eng*
> Data Scientist - BankFacil
> CREA/SP 5069410560
> <http://edital.confea.org.br/ConsultaProfissional/cartao.aspx?rnp=2613651334>
> Mob +55 (18) 99764-2733 <callto:+5518997642733>
> Ph +55 (11) 3522-8009
> http://about.me/dannyeuu
>
> Av. Nova Independência, 956, São Paulo, SP
> Bairro Brooklin Paulista
> CEP 04570-001
> https://www.bankfacil.com.br
>
>

Re: Scala VS Java VS Python

[Darren Govoni]

I use python too. I'm actually surprises it's not the primary language since it 
is by far more used in data science than java snd Scala combined.
If I had a second choice of script language for general apps I'd want groovy 
over scala.


Sent from my Verizon Wireless 4G LTE smartphone

 Original message 
From: Daniel Lopes <dan...@bankfacil.com.br> 
Date: 12/16/2015  4:16 PM  (GMT-05:00) 
To: Daniel Valdivia <h...@danielvaldivia.com> 
Cc: user <user@spark.apache.org> 
Subject: Re: Scala VS Java VS Python 

For me Scala is better like Spark is written in Scala, and I like python cuz I 
always used python for data science. :)
On Wed, Dec 16, 2015 at 5:54 PM, Daniel Valdivia <h...@danielvaldivia.com> 
wrote:
Hello,



This is more of a "survey" question for the community, you can reply to me 
directly so we don't flood the mailing list.



I'm having a hard time learning Spark using Python since the API seems to be 
slightly incomplete, so I'm looking at my options to start doing all my apps in 
either Scala or Java, being a Java Developer, java 1.8 looks like the logical 
way, however I'd like to ask here what's the most common (Scala Or Java) since 
I'm observing mixed results in the social documentation, however Scala seems to 
be the predominant language for spark examples.



Thank for the advice

-

To unsubscribe, e-mail: user-unsubscr...@spark.apache.org

For additional commands, e-mail: user-h...@spark.apache.org






-- 
Daniel Lopes, B.EngData Scientist - BankFacilCREA/SP 5069410560Mob +55 (18) 
99764-2733Ph +55 (11) 3522-8009http://about.me/dannyeuu
Av. Nova Independência, 956, São Paulo, SPBairro Brooklin PaulistaCEP 
04570-001https://www.bankfacil.com.br

Re: Scala VS Java VS Python

[Lan Jiang]

For Spark data science project, Python might be a good choice. However, for 
Spark streaming, Python API is still lagging. For example, for Kafka no 
receiver connector, according to the Spark 1.5.2 doc:  "Spark 1.4 added a 
Python API, but it is not yet at full feature parity”. 

Java does not have REPL shell, which is a major drawback from my perspective.

Lan



> On Dec 16, 2015, at 3:46 PM, Stephen Boesch <java...@gmail.com> wrote:
> 
> There are solid reasons to have built spark on the jvm vs python. The 
> question for Daniel appear to be at this point scala vs java8. For that there 
> are many comparisons already available: but in the case of working with spark 
> there is the additional benefit for the scala side that the core libraries 
> are in that language.  
> 
> 2015-12-16 13:41 GMT-08:00 Darren Govoni <dar...@ontrenet.com 
> <mailto:dar...@ontrenet.com>>:
> I use python too. I'm actually surprises it's not the primary language since 
> it is by far more used in data science than java snd Scala combined.
> 
> If I had a second choice of script language for general apps I'd want groovy 
> over scala.
> 
> 
> 
> Sent from my Verizon Wireless 4G LTE smartphone
> 
> 
>  Original message 
> From: Daniel Lopes <dan...@bankfacil.com.br <mailto:dan...@bankfacil.com.br>> 
> Date: 12/16/2015 4:16 PM (GMT-05:00) 
> To: Daniel Valdivia <h...@danielvaldivia.com 
> <mailto:h...@danielvaldivia.com>> 
> Cc: user <user@spark.apache.org <mailto:user@spark.apache.org>> 
> Subject: Re: Scala VS Java VS Python 
> 
> For me Scala is better like Spark is written in Scala, and I like python cuz 
> I always used python for data science. :)
> 
> On Wed, Dec 16, 2015 at 5:54 PM, Daniel Valdivia <h...@danielvaldivia.com 
> <mailto:h...@danielvaldivia.com>> wrote:
> Hello,
> 
> This is more of a "survey" question for the community, you can reply to me 
> directly so we don't flood the mailing list.
> 
> I'm having a hard time learning Spark using Python since the API seems to be 
> slightly incomplete, so I'm looking at my options to start doing all my apps 
> in either Scala or Java, being a Java Developer, java 1.8 looks like the 
> logical way, however I'd like to ask here what's the most common (Scala Or 
> Java) since I'm observing mixed results in the social documentation, however 
> Scala seems to be the predominant language for spark examples.
> 
> Thank for the advice
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org 
> <mailto:user-unsubscr...@spark.apache.org>
> For additional commands, e-mail: user-h...@spark.apache.org 
> <mailto:user-h...@spark.apache.org>
> 
> 
> 
> 
> -- 
> Daniel Lopes, B.Eng
> Data Scientist - BankFacil
> CREA/SP 5069410560 
> <http://edital.confea.org.br/ConsultaProfissional/cartao.aspx?rnp=2613651334>
> Mob +55 (18) 99764-2733 <callto:+5518997642733>
> Ph +55 (11) 3522-8009
> http://about.me/dannyeuu <http://about.me/dannyeuu>
> 
> Av. Nova Independência, 956, São Paulo, SP
> Bairro Brooklin Paulista
> CEP 04570-001
> https://www.bankfacil.com.br <https://www.bankfacil.com.br/>
> 
> 

Re: Scala VS Java VS Python

[Veljko Skarich]

I use Scala, since I was most familiar with it out of the three languages,
when I started using Spark. I would say that learning Scala with no
functional programming background is somewhat challenging, but well worth
it if you have the time. As others have pointed out, using the REPL and
inspecting the core libraries are great points in Scala's favor here.

On Wed, Dec 16, 2015 at 1:53 PM, Lan Jiang <ljia...@gmail.com> wrote:

> For Spark data science project, Python might be a good choice. However,
> for Spark streaming, Python API is still lagging. For example, for Kafka no
> receiver connector, according to the Spark 1.5.2 doc:  "Spark 1.4 added a
> Python API, but it is not yet at full feature parity”.
>
> Java does not have REPL shell, which is a major drawback from my
> perspective.
>
> Lan
>
>
>
>
> On Dec 16, 2015, at 3:46 PM, Stephen Boesch <java...@gmail.com> wrote:
>
> There are solid reasons to have built spark on the jvm vs python. The
> question for Daniel appear to be at this point scala vs java8. For that
> there are many comparisons already available: but in the case of working
> with spark there is the additional benefit for the scala side that the core
> libraries are in that language.
>
> 2015-12-16 13:41 GMT-08:00 Darren Govoni <dar...@ontrenet.com>:
>
>> I use python too. I'm actually surprises it's not the primary language
>> since it is by far more used in data science than java snd Scala combined.
>>
>> If I had a second choice of script language for general apps I'd want
>> groovy over scala.
>>
>>
>>
>> Sent from my Verizon Wireless 4G LTE smartphone
>>
>>
>>  Original message 
>> From: Daniel Lopes <dan...@bankfacil.com.br>
>> Date: 12/16/2015 4:16 PM (GMT-05:00)
>> To: Daniel Valdivia <h...@danielvaldivia.com>
>> Cc: user <user@spark.apache.org>
>> Subject: Re: Scala VS Java VS Python
>>
>> For me Scala is better like Spark is written in Scala, and I like python
>> cuz I always used python for data science. :)
>>
>> On Wed, Dec 16, 2015 at 5:54 PM, Daniel Valdivia <h...@danielvaldivia.com
>> > wrote:
>>
>>> Hello,
>>>
>>> This is more of a "survey" question for the community, you can reply to
>>> me directly so we don't flood the mailing list.
>>>
>>> I'm having a hard time learning Spark using Python since the API seems
>>> to be slightly incomplete, so I'm looking at my options to start doing all
>>> my apps in either Scala or Java, being a Java Developer, java 1.8 looks
>>> like the logical way, however I'd like to ask here what's the most common
>>> (Scala Or Java) since I'm observing mixed results in the social
>>> documentation, however Scala seems to be the predominant language for spark
>>> examples.
>>>
>>> Thank for the advice
>>> -
>>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>>> For additional commands, e-mail: user-h...@spark.apache.org
>>>
>>>
>>
>>
>> --
>> *Daniel Lopes, B.Eng*
>> Data Scientist - BankFacil
>> CREA/SP 5069410560
>> <http://edital.confea.org.br/ConsultaProfissional/cartao.aspx?rnp=2613651334>
>> Mob +55 (18) 99764-2733 <callto:+5518997642733>
>> Ph +55 (11) 3522-8009
>> http://about.me/dannyeuu
>>
>> Av. Nova Independência, 956, São Paulo, SP
>> Bairro Brooklin Paulista
>> CEP 04570-001
>> https://www.bankfacil.com.br
>>
>>
>
>