Re: MappedStream vs Transform API

2015-03-17 Thread madhu phatak
if there’s no related DStream API (but have related RDD API). But using map maybe more straightforward and easy to understand. Thanks Jerry *From:* madhu phatak [mailto:phatak@gmail.com] *Sent:* Monday, March 16, 2015 4:32 PM *To:* user@spark.apache.org *Subject:* MappedStream vs

Re: MappedStream vs Transform API

2015-03-17 Thread madhu phatak
DStream API (but have related RDD API). But using map maybe more straightforward and easy to understand. Thanks Jerry *From:* madhu phatak [mailto:phatak@gmail.com] *Sent:* Monday, March 16, 2015 4:32 PM *To:* user@spark.apache.org *Subject:* MappedStream vs Transform API Hi

Re: MappedStream vs Transform API

2015-03-17 Thread Tathagata Das
and easy to understand. Thanks Jerry *From:* madhu phatak [mailto:phatak@gmail.com] *Sent:* Monday, March 16, 2015 4:32 PM *To:* user@spark.apache.org *Subject:* MappedStream vs Transform API Hi, Current implementation of map function in spark streaming looks as below

Re: MappedStream vs Transform API

2015-03-17 Thread madhu phatak
if there’s no related DStream API (but have related RDD API). But using map maybe more straightforward and easy to understand. Thanks Jerry *From:* madhu phatak [mailto:phatak@gmail.com] *Sent:* Monday, March 16, 2015 4:32 PM *To:* user@spark.apache.org *Subject:* MappedStream vs

Re: MappedStream vs Transform API

2015-03-16 Thread madhu phatak
straightforward and easy to understand. Thanks Jerry *From:* madhu phatak [mailto:phatak@gmail.com] *Sent:* Monday, March 16, 2015 4:32 PM *To:* user@spark.apache.org *Subject:* MappedStream vs Transform API Hi, Current implementation of map function in spark streaming looks as below

Re: MappedStream vs Transform API

2015-03-16 Thread Tathagata Das
:* MappedStream vs Transform API Hi, Current implementation of map function in spark streaming looks as below. *def *map[U: ClassTag](mapFunc: T = U): DStream[U] = { *new *MappedDStream(*this*, context.sparkContext.clean(mapFunc)) } It creates an instance of MappedDStream which

MappedStream vs Transform API

2015-03-16 Thread madhu phatak
Hi, Current implementation of map function in spark streaming looks as below. def map[U: ClassTag](mapFunc: T = U): DStream[U] = { new MappedDStream(this, context.sparkContext.clean(mapFunc)) } It creates an instance of MappedDStream which is a subclass of DStream. The same function can

RE: MappedStream vs Transform API

2015-03-16 Thread Shao, Saisai
From: madhu phatak [mailto:phatak@gmail.com] Sent: Monday, March 16, 2015 4:32 PM To: user@spark.apache.org Subject: MappedStream vs Transform API Hi, Current implementation of map function in spark streaming looks as below. def map[U: ClassTag](mapFunc: T = U): DStream[U] = { new