[
https://issues.apache.org/jira/browse/SPARK-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723180#comment-14723180
]
Kevin Jung commented on SPARK-10039:
------------------------------------
I quickly look over scala github to investigate it. Scala has not only
PlainFile but also PlainDirectory so I think virtualDirectory must be a
instance of PlainDirectory. However, PlainDirectory extends PlainFile so that
its create() method which Spark uses always create a file. It seems like a bug
in Scala so I close this issue.
> Resetting REPL state does not work
> ----------------------------------
>
> Key: SPARK-10039
> URL: https://issues.apache.org/jira/browse/SPARK-10039
> Project: Spark
> Issue Type: Bug
> Components: Spark Shell
> Affects Versions: 1.4.1
> Reporter: Kevin Jung
> Priority: Minor
>
> Spark shell can't find a base directory of class server after running
> ":reset" command.
> {quote}
> scala> :reset
> scala> 1
> uncaught exception during compilation: java.lang.AssertiON-ERROR
> java.lang.AssertiON-ERROR: assertion failed: Tried to find '$line33' in
> '/tmp/spark-f47f3917-ac31-4138-bf1a-a8cefd094ac3' but it is not a directory
> ~~~impossible to command anymore including 'exit'~~~
> {quote}
> I figure out reset() method in SparkIMain try to delete virtualDirectory and
> then create again. But virtualDirectory.create() makes a file, not a
> directory. Details here.
> {quote}
> drwxrwxr-x. 3 root root 0 2015-08-17 09:09
> spark-9cfc6b06-c902-4caf-8712-9ea63f17d017
> (After :reset)
> \-rw-rw-r--. 1 root root 0 2015-08-17 09:09
> spark-9cfc6b06-c902-4caf-8712-9ea63f17d017
> {quote}
> "vd.delete; vd.givenPath.createDirectory(true);" will temporarily solve the
> problem.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
