Re: Parquet divide by zero

Hi Jim, I am sorry, I know about your patch and I will commit it ASAP. Lukas Nalezenec On 28.1.2015 22:28, Jim Carroll wrote: Hello all, I've been hitting a divide by zero error in Parquet though Spark detailed (and fixed) here: https://github.com/apache/incubator-parquet-mr/pull/102

Re: Spark Team - Paco Nathan said that your team can help

+1 On 22.1.2015 18:30, Marco Shaw wrote: Sudipta - Please don't ever come here or post here again. On Thu, Jan 22, 2015 at 1:25 PM, Sudipta Banerjee asudipta.baner...@gmail.com mailto:asudipta.baner...@gmail.com wrote: Hi Nicos, Taking forward your argument,please be a smart a$$ and

Re: Mapping Hadoop Reduce to Spark

Hi, FYI: There is bug in Java mapPartitions - SPARK-3369 https://issues.apache.org/jira/browse/SPARK-3369. In Java results from mapPartitions and similar functions must fit in memory. Look at example below - it returns List. Lukas On 1.9.2014 00:50, Matei Zaharia wrote: mapPartitions just

Re: Configuring Spark for reduceByKey on on massive data sets

Hi Try using *reduceByKeyLocally*. Regards Lukas Nalezenec On Sun, May 18, 2014 at 3:33 AM, Matei Zaharia matei.zaha...@gmail.comwrote: Make sure you set up enough reduce partitions so you don’t overload them. Another thing that may help is checking whether you’ve run out of local disk space

Re: Is there any problem on the spark mailing list?

There was an outage: https://blogs.apache.org/infra/entry/mail_outage On Fri, May 9, 2014 at 1:27 PM, wxhsdp wxh...@gmail.com wrote: i think so, fewer questions and answers these three days -- View this message in context:

Cannot compile SIMR with Spark 9.1

Hi, I am trying to recompile SIMR with Spark 9.1 but it fails on incompatible method: [error] /home/lukas/src/simr/src/main/scala/org/apache/spark/simr/RelayServer.scala:213: not enough arguments for method createActorSystem: (name: String, host: String, port: Int, indestructible: Boolean, conf: