Re: Potential NPE while exiting spark-shell

2015-09-01 Thread nasokan
bump -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Potential-NPE-while-exiting-spark-shell-tp24523p24539.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Potential NPE while exiting spark-shell

2015-08-31 Thread nasokan
a problem with the way shutdown hook behaves currently? Note: I referenced source from apache spark repo than cloudera. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Potential-NPE-while-exiting-spark-shell-tp24523.html Sent from the Apache Spark User List ma

Re: Potential NPE while exiting spark-shell

2015-08-31 Thread Akhil Das
; here > > > https://github.com/apache/spark/blob/v1.3.0/core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala#L161 > > Has anyone faced this issue before? Could this be a problem with the way > shutdown hook behaves currently? > > Note: I referenced source

Re: Potential NPE while exiting spark-shell

2015-08-31 Thread Nithin Asokan
e yarn >> application was not submitted successfully, the block manager was not >> registered; as a result it does not have a valid blockManagerId as seen >> here >> >> >> https://github.com/apache/spark/blob/v1.3.0/core/src/main/scala/org/apache/spark/storage/DiskB