You need to pay a lot of money to get the full stream, so unless you are doing that, it's the sample stream!
On Thu, Jul 23, 2015 at 9:26 PM, Patrick McCarthy <pmccar...@eatonvance.com> wrote: > How can I tell if it's the sample stream or full stream ? > Thanks > > Sent from my iPhone > > On Jul 23, 2015, at 4:17 PM, Enno Shioji <eshi...@gmail.com> wrote: > > You are probably listening to the sample stream, and THEN filtering. > This means you listen to 1% of the twitter stream, and then looking for the > tweet by Bloomberg, so there is a very good chance you don't see the > particular tweet. > > In order to get all Bloomberg related tweets, you must connect to > twitter using the filter API and not the sample API: > https://dev.twitter.com/streaming/reference/post/statuses/filter > > On Thu, Jul 23, 2015 at 8:23 PM, pjmccarthy <pmccar...@eatonvance.com> > wrote: > >> Hopefully this is an easy one. I am trying to filter a twitter dstream by >> user ScreenName - my code is as follows >> val stream = TwitterUtils.createStream(ssc, None) >> .filter(_.getUser.getScreenName.contains("markets")) >> >> however nothing gets returned and I can see that Bloomberg has tweeted. >> If >> I remove the filter I get tweets >> If I change the code to looke for engligh or french tweets that works >> >> Is there a better way to do it ? >> >> Can anyone assist ? >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Twitter4J-streaming-question-tp23974.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> >> >
