Re: Spark Streaming on Yarn Input from Flume

2015-03-15 Thread tarek_abouzeid
have you fixed this issue ?



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-on-Yarn-Input-from-Flume-tp11755p22055.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org



Re: Spark Streaming on Yarn Input from Flume

2014-08-08 Thread Hari Shreedharan
Do you see anything suspicious in the logs? How did you run the application?


On Thu, Aug 7, 2014 at 10:02 PM, XiaoQinyu xiaoqinyu_sp...@outlook.com
wrote:

 Hi~

 I run a spark streaming app to receive data from flume event.When I run on
 standalone,Spark Streaming can receive the Flume event normally .But if I
 run this app on yarn,no matter on yarn-client or yarn-cluster. This app can
 not receive data from flume,and I check the net stat,I find the port which
 connect to flume,didn't be listened.

 I am not sure,if spark streaming run on Yarn,will affect connect to flume.

 And then I run the FlumeEventCount  example, when I run this example on
 Yarn, it also can not receive data from flume.

 And  I will be very pleasure if some one can help me.


 XiaoQinyu



 --
 View this message in context:
 http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-on-Yarn-Input-from-Flume-tp11755.html
 Sent from the Apache Spark User List mailing list archive at Nabble.com.

 -
 To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
 For additional commands, e-mail: user-h...@spark.apache.org




Spark Streaming on Yarn Input from Flume

2014-08-07 Thread XiaoQinyu
Hi~

I run a spark streaming app to receive data from flume event.When I run on
standalone,Spark Streaming can receive the Flume event normally .But if I
run this app on yarn,no matter on yarn-client or yarn-cluster. This app can
not receive data from flume,and I check the net stat,I find the port which
connect to flume,didn't be listened.

I am not sure,if spark streaming run on Yarn,will affect connect to flume. 

And then I run the FlumeEventCount  example, when I run this example on
Yarn, it also can not receive data from flume.

And  I will be very pleasure if some one can help me. 


XiaoQinyu



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-on-Yarn-Input-from-Flume-tp11755.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org