Re: I coded an example to use Twitter stream as a data source for Spark

Thats my goal brother. But lets agree spark is not a very straight forward repo to get yourself started. I have got some initiaö code though. On Wednesday, 23 December 2015, Akhil Das wrote: > Why not create a custom dstream >

Re: I coded an example to use Twitter stream as a data source for Spark

Why not create a custom dstream and generate the data from there itself instead of spark connecting to a socket server which will be fed by another twitter client? Thanks Best Regards On Sat, Dec 19, 2015 at 5:47 PM, Amir

I coded an example to use Twitter stream as a data source for Spark

Hi guys, Thought someone would need this: https://github.com/ambodi/realtime-spark-twitter-stream-mining you can use this approach to feed twitter stream to your spark job. So far, PySpark does not have a twitter dstream source. -- Thanks and Regards, Amir Hossein Rahnama *Tel: +46 (0)