Running JavaBased Implementation of StreamingKmeans Spark
Hi, Something is wrong with my spark subscription so I can't see the responses properly on nabble, so I subscribed from a different id, hopefully it is solved and I am putting my question again here. I implemented the streamingKmeans example provided in the spark website but in Java. The full implementation is here, http://pastebin.com/CJQfWNvk But i am not getting anything in the output except occasional timestamps like one below: --- Time: 1466176935000 ms --- Also, i have 2 directories: "D:\spark\streaming example\Data Sets\training" "D:\spark\streaming example\Data Sets\test" and inside these directories i have 1 file each "samplegpsdata_train.txt" and "samplegpsdata_test.txt" with training data having 500 datapoints and test data with 60 datapoints. I have already tried putting the data files after starting the code but still no output, i am also not getting any exception or anything, so its hard to debug for me. I am very new to the spark systems and any help is highly appreciated. Thank you so much Biplob Biswas
Re: Running JavaBased Implementation of StreamingKmeans Spark
Hi, I tried doing that but even then I couldn't see any results. I started the program and added the files later. Thanks & Regards Biplob Biswas On Sat, Jun 25, 2016 at 2:19 AM, Jayant Shekhar <jayantbaya...@gmail.com> wrote: > Hi Biplop, > > Can you try adding new files to the training/test directories after you > have started your streaming application! Especially the test directory as > you are printing your predictions. > > On Fri, Jun 24, 2016 at 2:32 PM, Biplob Biswas <revolutioni...@gmail.com> > wrote: > >> >> Hi, >> >> I implemented the streamingKmeans example provided in the spark website >> but >> in Java. >> The full implementation is here, >> >> http://pastebin.com/CJQfWNvk >> >> But i am not getting anything in the output except occasional timestamps >> like one below: >> >> --- >> Time: 1466176935000 ms >> --- >> >> Also, i have 2 directories: >> "D:\spark\streaming example\Data Sets\training" >> "D:\spark\streaming example\Data Sets\test" >> >> and inside these directories i have 1 file each "samplegpsdata_train.txt" >> and "samplegpsdata_test.txt" with training data having 500 datapoints and >> test data with 60 datapoints. >> >> I am very new to the spark systems and any help is highly appreciated. >> >> Thank you so much >> Biplob Biswas >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Running-JavaBased-Implementation-of-StreamingKmeans-Spark-tp27225.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> - >> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >> For additional commands, e-mail: user-h...@spark.apache.org >> >> >
Re: Running JavaBased Implementation of StreamingKmeans Spark
Hi Biplop, Can you try adding new files to the training/test directories after you have started your streaming application! Especially the test directory as you are printing your predictions. On Fri, Jun 24, 2016 at 2:32 PM, Biplob Biswas <revolutioni...@gmail.com> wrote: > > Hi, > > I implemented the streamingKmeans example provided in the spark website but > in Java. > The full implementation is here, > > http://pastebin.com/CJQfWNvk > > But i am not getting anything in the output except occasional timestamps > like one below: > > --- > Time: 1466176935000 ms > --- > > Also, i have 2 directories: > "D:\spark\streaming example\Data Sets\training" > "D:\spark\streaming example\Data Sets\test" > > and inside these directories i have 1 file each "samplegpsdata_train.txt" > and "samplegpsdata_test.txt" with training data having 500 datapoints and > test data with 60 datapoints. > > I am very new to the spark systems and any help is highly appreciated. > > Thank you so much > Biplob Biswas > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Running-JavaBased-Implementation-of-StreamingKmeans-Spark-tp27225.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
Running JavaBased Implementation of StreamingKmeans Spark
Hi, I implemented the streamingKmeans example provided in the spark website but in Java. The full implementation is here, http://pastebin.com/CJQfWNvk But i am not getting anything in the output except occasional timestamps like one below: --- Time: 1466176935000 ms --- Also, i have 2 directories: "D:\spark\streaming example\Data Sets\training" "D:\spark\streaming example\Data Sets\test" and inside these directories i have 1 file each "samplegpsdata_train.txt" and "samplegpsdata_test.txt" with training data having 500 datapoints and test data with 60 datapoints. I am very new to the spark systems and any help is highly appreciated. Thank you so much Biplob Biswas -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Running-JavaBased-Implementation-of-StreamingKmeans-Spark-tp27225.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Running JavaBased Implementation of StreamingKmeans Spark
Hi, I implemented the streamingKmeans example provided in the spark website but in Java. The full implementation is here, http://pastebin.com/CJQfWNvk But i am not getting anything in the output except occasional timestamps like one below: --- Time: 1466176935000 ms --- Also, i have 2 directories: "D:\spark\streaming example\Data Sets\training" "D:\spark\streaming example\Data Sets\test" and inside these directories i have 1 file each "samplegpsdata_train.txt" and "samplegpsdata_test.txt" with training data having 500 datapoints and test data with 60 datapoints. I am very new to the spark systems and any help is highly appreciated. Thank you so much Biplob Biswas -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Running-JavaBased-Implementation-of-StreamingKmeans-Spark-tp27206.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
