spark streaming socket read issue

2017-06-30 Thread pradeepbill
hi there, I have a spark streaming issue that i am not able to figure out , below code reads from a socket, but I don't see any input going into the job, I have nc -l running, and dumping data though, not sure why my spark job is not able to read data from 10.176.110.112:.Please advice.

backward compatibility

2017-01-10 Thread pradeepbill
hi there, I am using spark 1.4 code and now we plan to move to spark 2.0, and when I check the documentation below, there are only a few features backward compatible, does that mean I have change most of my code , please advice. One of the largest changes in Spark 2.0 is the new updated APIs: