Re: Possible approaches for adding extra metadata (Spark Streaming)?

Thanks Mayur and TD for your inputs. ~Shrikar On Fri, Jun 20, 2014 at 1:20 PM, Tathagata Das wrote: > If the metadata is directly related to each individual records, then it > can be done either ways. Since I am not sure how easy or hard will it be > for you add tags before putting the data in

Re: Possible approaches for adding extra metadata (Spark Streaming)?

If the metadata is directly related to each individual records, then it can be done either ways. Since I am not sure how easy or hard will it be for you add tags before putting the data into spark streaming, its hard to recommend one method over the other. However, if the metadata is related to ea

Re: Possible approaches for adding extra metadata (Spark Streaming)?

You can apply transformations on RDD's inside Dstreams using transform or any number of operations. Regards Mayur Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi On Fri, Jun 20, 2014 at 2:16 PM, Shrikar archak wrote: > Hi

Possible approaches for adding extra metadata (Spark Streaming)?

Hi All, I was curious to know which of the two approach is better for doing analytics using spark streaming. Lets say we want to add some metadata to the stream which is being processed like sentiment, tags etc and then perform some analytics using these added metadata. 1) Is it ok to make a htt

Possible approaches for adding extra metadata (Spark Streaming)

Hi All, I was curious to know which of the two approach is better for doing analytics using spark streaming. Lets say we want to add some metadata to the stream which is being processed like sentiment, tags etc and then perform some analytics using these added metadata. 1) Is it ok to make a htt