[ https://issues.apache.org/jira/browse/SPARK-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15048144#comment-15048144 ]
Prashant Sharma commented on SPARK-3200: ---------------------------------------- However, the good part is no one actually ran into this bug except me imagining it and filing it. This bug exists since the beginning of the spark-repl. So we can close it with some other rationale. > Class defined with reference to external variables crashes in REPL. > ------------------------------------------------------------------- > > Key: SPARK-3200 > URL: https://issues.apache.org/jira/browse/SPARK-3200 > Project: Spark > Issue Type: Bug > Components: Spark Shell > Affects Versions: 1.1.0 > Reporter: Prashant Sharma > Assignee: Prashant Sharma > > Reproducer: > {noformat} > val a = sc.textFile("README.md").count > case class A(i: Int) { val j = a} > sc.parallelize(1 to 10).map(A(_)).collect() > {noformat} > This will happen only in distributed mode, when one refers something that > refers sc and not otherwise. > There are many ways to work around this, like directly assign a constant > value instead of referring the variable. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org