CheckpointRDD has different number of partitions than original RDD

Hello, Spark community! My name is Paul. I am a Spark newbie, evaluating version 0.9.0 without any Hadoop at all, and need some help. I run into the following error with the StatefulNetworkWordCount example (and similarly in my prototype app, when I use the updateStateByKey operation). I get t

RE: CheckpointRDD has different number of partitions than original RDD

do this you can take any RDD and do the following.  myRDD.checkpoint() myRDD.count() If there is some issue, then this should reproduce the above error. TD On Mon, Apr 7, 2014 at 3:48 PM, Paul Mogren wrote: Hello, Spark community!  My name is Paul. I am a Spark newbie, evaluating version 0.9.0

Error specifying Kafka params from Java

Hi all, I get the following exception when trying to build a Kafka input DStream with custom properties from Java. I am wondering if it's a problem with the Java to Scala binding - I am at a loss for what I could be doing wrong. 14/04/10 16:46:28 ERROR NetworkInputTracker: De-registered receive

Error specifying Kafka params from Java

Hi all, I get the following exception when trying to build a Kafka input DStream with custom properties from Java. I am wondering if it's a problem with the Java to Scala binding - I am at a loss for what I could be doing wrong. 14/04/10 16:46:28 ERROR NetworkInputTracker: De-registered rec

Shutdown with streaming driver running in cluster broke master web UI permanently

I had a cluster running with a streaming driver deployed into it. I shut down the cluster using sbin/stop-all.sh. Upon restarting (and restarting, and restarting), the master web UI cannot respond to requests. The cluster seems to be otherwise functional. Below is the master's log, showing stack