unsubscribe

2020-06-29 Thread obaidul karim

Spark Streaming: Combine MLlib Prediction and Features on Dstreams

2016-05-31 Thread obaidul karim
n 'process_rdd' function. There's nothing return in output of > 'foreachRdd' function, of course. > > 2016-05-31 14:39 GMT+07:00 obaidul karim <obaidc...@gmail.com > <javascript:_e(%7B%7D,'cvml','obaidc...@gmail.com');>>: > >> Hi nguyen, >> >> Thanks a lot for y

Re: Spark Streaming: Combine MLlib Prediction and Features on Dstreams

2016-05-31 Thread obaidul karim
.map(lambda x: extract_feature(rf_model, x)) > //do something as you want (saving,...) > > stream.foreachRDD(process_rdd) > > 2016-05-31 12:57 GMT+07:00 obaidul karim <obaidc...@gmail.com>: > >> foreachRDD does not return any value. I can be used just to send result >> t

Re: Spark Streaming: Combine MLlib Prediction and Features on Dstreams

2016-05-31 Thread obaidul karim
Sorry for lots of typos (writing from mobile) On Tuesday, 31 May 2016, obaidul karim <obaidc...@gmail.com> wrote: > foreachRDD does not return any value. I can be used just to send result to > another place/context, like db,file etc. > I could use that but seems like over head of

Re: Spark Streaming: Combine MLlib Prediction and Features on Dstreams

2016-05-30 Thread obaidul karim
> How about using foreachRDD ? I think this is much better than your trick. > > > 2016-05-31 12:32 GMT+07:00 obaidul karim <obaidc...@gmail.com > <javascript:_e(%7B%7D,'cvml','obaidc...@gmail.com');>>: > >> Hi Guys, >> >> In the end, I am using

Re: Spark Streaming: Combine MLlib Prediction and Features on Dstreams

2016-05-30 Thread obaidul karim
PM, nguyen duc tuan <newvalu...@gmail.com> wrote: > Dstream has an method foreachRDD, so you can walk through all RDDs inside > DStream as you want. > > > https://spark.apache.org/docs/1.4.0/api/java/org/apache/spark/streaming/dstream/DStream.html > > 2016-05-30 19:

Re: Spark Streaming: Combine MLlib Prediction and Features on Dstreams

2016-05-30 Thread obaidul karim
Hi, Anybody has any idea on below? -Obaid On Friday, 27 May 2016, obaidul karim <obaidc...@gmail.com> wrote: > Hi Guys, > > This is my first mail to spark users mailing list. > > I need help on Dstream operation. > > In fact, I am using a MLlib randomforest m

Spark Streaming: Combine MLlib Prediction and Features on Dstreams

2016-05-26 Thread obaidul karim
Hi Guys, This is my first mail to spark users mailing list. I need help on Dstream operation. In fact, I am using a MLlib randomforest model to predict using spark streaming. In the end, I want to combine the feature Dstream & prediction Dstream together for further downstream processing. I am