Spark STreaming's TwitterUtils, depends on twitter4j 3.0.3 (if i
remember correctly). That may be the issue here.
TD
On Mon, Aug 4, 2014 at 11:08 AM, durin <m...@simon-schaefer.net> wrote:
> I am using the latest Spark master and additionally, I am loading these jars:
> - spark-streaming-twitter_2.10-1.1.0-SNAPSHOT.jar
> - twitter4j-core-4.0.2.jar
> - twitter4j-stream-4.0.2.jar
>
>
> My simple test program that I execute in the shell looks as follows:
>
> import org.apache.spark.streaming._
> import org.apache.spark.streaming.twitter._
> import org.apache.spark.streaming.StreamingContext._
>
> System.setProperty("twitter4j.oauth.consumerKey", "jXgXF...")
> System.setProperty("twitter4j.oauth.consumerSecret", "mWPvQRl1....")
> System.setProperty("twitter4j.oauth.accessToken", "26176....")
> System.setProperty("twitter4j.oauth.accessTokenSecret", "J8Fcosm4...")
>
> var ssc = new StreamingContext(sc, Seconds(1))
> var tweets = TwitterUtils.createStream(ssc, None)
> var statuses = tweets.map(_.getText)
> statuses.print()
>
> ssc.start()
>
>
> However, I won't get any tweets. The main error I see is
>
>
> 14/08/04 10:52:35 ERROR scheduler.ReceiverTracker: Deregistered receiver for
> stream 0: Error starting receiver 0 - java.lang.NoSuchMethodError:
> twitter4j.TwitterStream.addListener(Ltwitter4j/StatusListener;)V
> at
> org.apache.spark.streaming.twitter.TwitterReceiver.onStart(TwitterInputDStream.scala:72)
> ....
>
>
> And then for each iteration:
> INFO scheduler.ReceiverTracker: Stream 0 received 0 blocks
>
>
> I'm not sure where the problem lies.
> How can I verify that my twitter credentials are correctly recognized?
> Might there be another jar missing?
>
>
> Kindly,
> Simon
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-fails-where-is-the-problem-tp11355.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
