I'm trying to update some spark streaming code from 0.8.1 to 0.9.0.
Among other things, I've found the function clearMetadata, who's comment
says:
"...Subclasses of DStream may override this to clear their own metadata
along with the generated RDDs"
yet which is declared private[streaming].
How are subclasses expected to override this if it's private? If they
aren't, how and when should they now clear any extraneous data they have?
Similarly, I now see no way to get the timing information - how is a custom
dstream supposed to do this now?
Thanks,
-Nathan
--
Nathan Kronenfeld
Senior Visualization Developer
Oculus Info Inc
2 Berkeley Street, Suite 600,
Toronto, Ontario M5A 4J5
Phone: +1-416-203-3003 x 238
Email: [email protected]
