Re: Streaming K-means not printing predictions

2016-04-28 Thread Ashutosh Kumar
It is reading the files now but throws another error complaining vector sizes does not match. I saw this error reported on stack trace . http://stackoverflow.com/questions/30737361/getting-java-lang-illegalargumentexception-requirement-failed-while-calling-spa Also example given in scala

Re: Streaming K-means not printing predictions

2016-04-27 Thread Ashutosh Kumar
The problem seems to be streamconxt.textFileStream(path) is not reading the file at all. It does not throw any exception also. I tried some tricks given in mailing lists like copying the file to specified directory after start of program, touching the file to change timestamp etc but no luck.

Re: Streaming K-means not printing predictions

2016-04-26 Thread Prashant Sharma
Since you are reading from file stream, I would suggest instead of printing try to save it on a file. There may be output the first time and then no data in subsequent iterations. Prashant Sharma On Tue, Apr 26, 2016 at 7:40 PM, Ashutosh Kumar wrote: > I created a

Streaming K-means not printing predictions

2016-04-26 Thread Ashutosh Kumar
I created a Streaming k means based on scala example. It keeps running without any error but never prints predictions Here is Log 19:15:05,050 INFO org.apache.spark.streaming.scheduler.InputInfoTracker - remove old batch metadata: 146167824 ms 19:15:10,001 INFO