I use Scala, since I was most familiar with it out of the three languages, when I started using Spark. I would say that learning Scala with no functional programming background is somewhat challenging, but well worth it if you have the time. As others have pointed out, using the REPL and inspecting the core libraries are great points in Scala's favor here.
On Wed, Dec 16, 2015 at 1:53 PM, Lan Jiang <ljia...@gmail.com> wrote: > For Spark data science project, Python might be a good choice. However, > for Spark streaming, Python API is still lagging. For example, for Kafka no > receiver connector, according to the Spark 1.5.2 doc: "Spark 1.4 added a > Python API, but it is not yet at full feature parity”. > > Java does not have REPL shell, which is a major drawback from my > perspective. > > Lan > > > > > On Dec 16, 2015, at 3:46 PM, Stephen Boesch <java...@gmail.com> wrote: > > There are solid reasons to have built spark on the jvm vs python. The > question for Daniel appear to be at this point scala vs java8. For that > there are many comparisons already available: but in the case of working > with spark there is the additional benefit for the scala side that the core > libraries are in that language. > > 2015-12-16 13:41 GMT-08:00 Darren Govoni <dar...@ontrenet.com>: > >> I use python too. I'm actually surprises it's not the primary language >> since it is by far more used in data science than java snd Scala combined. >> >> If I had a second choice of script language for general apps I'd want >> groovy over scala. >> >> >> >> Sent from my Verizon Wireless 4G LTE smartphone >> >> >> -------- Original message -------- >> From: Daniel Lopes <dan...@bankfacil.com.br> >> Date: 12/16/2015 4:16 PM (GMT-05:00) >> To: Daniel Valdivia <h...@danielvaldivia.com> >> Cc: user <user@spark.apache.org> >> Subject: Re: Scala VS Java VS Python >> >> For me Scala is better like Spark is written in Scala, and I like python >> cuz I always used python for data science. :) >> >> On Wed, Dec 16, 2015 at 5:54 PM, Daniel Valdivia <h...@danielvaldivia.com >> > wrote: >> >>> Hello, >>> >>> This is more of a "survey" question for the community, you can reply to >>> me directly so we don't flood the mailing list. >>> >>> I'm having a hard time learning Spark using Python since the API seems >>> to be slightly incomplete, so I'm looking at my options to start doing all >>> my apps in either Scala or Java, being a Java Developer, java 1.8 looks >>> like the logical way, however I'd like to ask here what's the most common >>> (Scala Or Java) since I'm observing mixed results in the social >>> documentation, however Scala seems to be the predominant language for spark >>> examples. >>> >>> Thank for the advice >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>> For additional commands, e-mail: user-h...@spark.apache.org >>> >>> >> >> >> -- >> *Daniel Lopes, B.Eng* >> Data Scientist - BankFacil >> CREA/SP 5069410560 >> <http://edital.confea.org.br/ConsultaProfissional/cartao.aspx?rnp=2613651334> >> Mob +55 (18) 99764-2733 <callto:+5518997642733> >> Ph +55 (11) 3522-8009 >> http://about.me/dannyeuu >> >> Av. Nova Independência, 956, São Paulo, SP >> Bairro Brooklin Paulista >> CEP 04570-001 >> https://www.bankfacil.com.br >> >> > >
