Re: flume spark streaming receiver host random

I don't think you control which host he receiver runs on, right? So that Spark can handle the failure of that node and reassign the receiver. On Sep 27, 2014 2:43 AM, centerqi hu cente...@gmail.com wrote: the receiver is not running on the machine I expect 2014-09-26 14:09 GMT+08:00 Sean

Re: flume spark streaming receiver host random

I think you may be missing a key word here. Are you saying that the machine has multiple interfaces and it is not using the one you expect or the receiver is not running on the machine you expect? On Sep 26, 2014 3:33 AM, centerqi hu cente...@gmail.com wrote: Hi all My code is as follows:

Re: flume spark streaming receiver host random

the receiver is not running on the machine I expect 2014-09-26 14:09 GMT+08:00 Sean Owen so...@cloudera.com: I think you may be missing a key word here. Are you saying that the machine has multiple interfaces and it is not using the one you expect or the receiver is not running on the

flume spark streaming receiver host random

Hi all My code is as follows: /usr/local/webserver/sparkhive/bin/spark-submit --class org.apache.spark.examples.streaming.FlumeEventCount --master yarn --deploy-mode cluster --queue online --num-executors 5 --driver-memory 6g --executor-memory 20g --executor-cores 5