Re: Getting parent RDD

2015-09-16 Thread Akhil Das
s to refer to that in catch block. > > > > Regards, > > Sam > > > > *From:* Akhil Das [mailto:ak...@sigmoidanalytics.com] > *Sent:* Wednesday, September 16, 2015 12:24 PM > *To:* Samya MAITI > *Cc:* user@spark.apache.org > *Subject:* Re: Getting parent RDD >

RE: Getting parent RDD

2015-09-16 Thread Samya MAITI
m: Akhil Das [mailto:ak...@sigmoidanalytics.com] Sent: Wednesday, September 16, 2015 12:24 PM To: Samya MAITI Cc: user@spark.apache.org Subject: Re: Getting parent RDD ​How many RDDs are you having in that stream? If its a single RDD then you could do a .foreach and log the message, something lik

Re: Getting parent RDD

2015-09-15 Thread Akhil Das
​How many RDDs are you having in that stream? If its a single RDD then you could do a .foreach and log the message, something like: val ssc = val msgStream = . //SparkKafkaDirectAPI val wordCountPair = TransformStream.transform(msgStream) /wordCountPair.foreach( ​msg​ => try{