Re: kafka spark streaming with mesos

2015-06-24 Thread Akhil Das
A screenshot of your framework running would also be helpful. How many cores does it have? Did you try running it in coarse grained mode? Try to add these to the conf: sparkConf.set("spark.mesos.coarse", "true") sparkConfset("spark.cores.max", "2") Thanks Best Regards On Wed, Jun 24, 2015 at 1

kafka spark streaming with mesos

2015-06-23 Thread Bartek Radziszewski
Hey, I’m trying to run kafka spark streaming using mesos with following example: sc.stop import org.apache.spark.SparkConf import org.apache.spark.SparkContext._ import kafka.serializer.StringDecoder import org.apache.spark.streaming._ import org.apache.spark.streaming.kafka._ import org.apache.s