For Spark data science project, Python might be a good choice. However, for Spark streaming, Python API is still lagging. For example, for Kafka no receiver connector, according to the Spark 1.5.2 doc: "Spark 1.4 added a Python API, but it is not yet at full feature parity”.
Java does not have REPL shell, which is a major drawback from my perspective. Lan > On Dec 16, 2015, at 3:46 PM, Stephen Boesch <java...@gmail.com> wrote: > > There are solid reasons to have built spark on the jvm vs python. The > question for Daniel appear to be at this point scala vs java8. For that there > are many comparisons already available: but in the case of working with spark > there is the additional benefit for the scala side that the core libraries > are in that language. > > 2015-12-16 13:41 GMT-08:00 Darren Govoni <dar...@ontrenet.com > <mailto:dar...@ontrenet.com>>: > I use python too. I'm actually surprises it's not the primary language since > it is by far more used in data science than java snd Scala combined. > > If I had a second choice of script language for general apps I'd want groovy > over scala. > > > > Sent from my Verizon Wireless 4G LTE smartphone > > > -------- Original message -------- > From: Daniel Lopes <dan...@bankfacil.com.br <mailto:dan...@bankfacil.com.br>> > Date: 12/16/2015 4:16 PM (GMT-05:00) > To: Daniel Valdivia <h...@danielvaldivia.com > <mailto:h...@danielvaldivia.com>> > Cc: user <user@spark.apache.org <mailto:user@spark.apache.org>> > Subject: Re: Scala VS Java VS Python > > For me Scala is better like Spark is written in Scala, and I like python cuz > I always used python for data science. :) > > On Wed, Dec 16, 2015 at 5:54 PM, Daniel Valdivia <h...@danielvaldivia.com > <mailto:h...@danielvaldivia.com>> wrote: > Hello, > > This is more of a "survey" question for the community, you can reply to me > directly so we don't flood the mailing list. > > I'm having a hard time learning Spark using Python since the API seems to be > slightly incomplete, so I'm looking at my options to start doing all my apps > in either Scala or Java, being a Java Developer, java 1.8 looks like the > logical way, however I'd like to ask here what's the most common (Scala Or > Java) since I'm observing mixed results in the social documentation, however > Scala seems to be the predominant language for spark examples. > > Thank for the advice > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > <mailto:user-unsubscr...@spark.apache.org> > For additional commands, e-mail: user-h...@spark.apache.org > <mailto:user-h...@spark.apache.org> > > > > > -- > Daniel Lopes, B.Eng > Data Scientist - BankFacil > CREA/SP 5069410560 > <http://edital.confea.org.br/ConsultaProfissional/cartao.aspx?rnp=2613651334> > Mob +55 (18) 99764-2733 <callto:+5518997642733> > Ph +55 (11) 3522-8009 > http://about.me/dannyeuu <http://about.me/dannyeuu> > > Av. Nova Independência, 956, São Paulo, SP > Bairro Brooklin Paulista > CEP 04570-001 > https://www.bankfacil.com.br <https://www.bankfacil.com.br/> > >
