Unsubscribe

Unsubscribe - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Unsubscribe

Unsubscribe

Re: Java : Testing RDD aggregateByKey

Hi, I'm sorry , the problem was really silly: In the test the number of partitions were zero (it was a division of the original number of partitions of the RDD source and in the test that number was just one) and that's why the test was failing. Anyway, maybe the behavior is weird, I could expect

Re: spark-submit not running on macbook pro

Looks like PySpark can't initiate a JVM in the backend.  How did you set up Java and Spark on your machine?  Some suggestions that may help solve your issue: 1. Use OpenJDK instead of Apple JDK since Spark was developed using OpenJDK, not Apple's.  You can use homebrew to install OpenJDK (I

[Announce] Spark on MR3

Hi Spark users, We would like to announce the release of Spark on MR3, which is Apache Spark using MR3 as the execution backend. MR3 is a general purpose execution engine for Hadoop and Kubernetes, and Hive on MR3 has been its main application. Spark on MR3 is a new application of MR3. The main

Re: Java : Testing RDD aggregateByKey

Hi Pedro, No idea what might be causing it. Do you perhaps have some code to reproduce it locally? Pozdrawiam, Jacek Laskowski https://about.me/JacekLaskowski "The Internals Of" Online Books Follow me on https://twitter.com/jaceklaskowski

How can I LoadIncrementalHFiles

DF.toJavaRDD.rdd.hbaseBulkLoadThinRows(hbaseContext, TableName.valueOf(config.getString("table")), R => { val rowKey = Bytes.toBytes(R.getAs[String](name)) val family = Bytes.toBytes(_family) val qualifier = Bytes.toBytes(name) var value: Array[Byte] = value =