i'm running the LogAnalyzerStreaming Example. Its processing the files fine but it keeps emitting the output of last processed RDD until it gets a new one. Is there a way to prevent that. I'm planning to use this example in a real scenario where when I have processed the data, I would be pushing it to a Database. So if the RDD keeps emitting the same values, I would be persisting the same values again and again, till I don't get new one. Any ideas how to do it? I have tried using unPersist() on the RDD, but it doesn't help.
Thanks Harjit
signature.asc
Description: Message signed with OpenPGP using GPGMail
