No logs from my cluster / worker ... (running DSE 4.6.1)

2015-05-04 Thread Eric Ho
I'm submitting this via 'dse spark-submit' but somehow, I don't see any loggings in my cluster or worker machines... How can I find out ? My cluster is running DSE 4.6.1 with Spark enabled. My source is running Kafka 0.8.2.0 I'm launching my program on one of my DSE machines. Any insights much

Re: No logs from my cluster / worker ... (running DSE 4.6.1)

2015-05-04 Thread Ted Yu
bq. its Spark libs are all at 2.10 Clarification: 2.10 is version of Scala Your Spark version is 1.1.0 You can use earlier release of Kafka. Cheers On Mon, May 4, 2015 at 2:39 PM, Eric Ho eric...@intel.com wrote: I still prefer to use Spark core / streaming /... at 2.10 becuase my DSE is at

Re: No logs from my cluster / worker ... (running DSE 4.6.1)

2015-05-04 Thread Ted Yu
Looks like you're using Spark 1.1.0 Support for Kafka 0.8.2 was added by: https://issues.apache.org/jira/browse/SPARK-2808 which would come in Spark 1.4.0 FYI On Mon, May 4, 2015 at 12:22 PM, Eric Ho eric...@intel.com wrote: I'm submitting this via 'dse spark-submit' but somehow, I don't see