...@spark.incubator.apache.org
Subject: Re: How to use FlumeInputDStream in spark cluster?
Hi,
BindException comes when two processes are using the same port. In your spark
configuration just set (spark.ui.port,x),
to some other port. x can be any number say 12345. BindException will not
break your job
or FlumeInputDStream will not be working in a
cluster environment?
--
If you reply to this email, your message will be added to the discussion
below:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-use-FlumeInputDStream-in-spark-cluster-tp1604p19997.html
To start
-FlumeInputDStream-in-spark-cluster-tp1604p15102.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h
and stays on it till the program runs. Why is it not checking
on the host and port i am providing. Also, host and port should
necessarily any worker node?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-use-FlumeInputDStream-in-spark-cluster-tp1604p2987
that is running the code to bind to
address:port has a different ip.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-use-FlumeInputDStream-in-spark-cluster-tp1604p2990.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
we are sending the data using
flume agent, it should work. Let me give a shot to this and check what
is happening.
Thanks you for the immediate reply. Ill keep you posted.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/How-to-use-FlumeInputDStream
.nabble.com/How-to-use-FlumeInputDStream-in-spark-cluster-tp1604p2993.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-to-use-FlumeInputDStream-in-spark-cluster-tp1604p2994.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.