[jira] [Commented] (SPARK-11244) sparkR.stop doesn't clean up .sparkRSQLsc in environment

2015-10-21 Thread Shivaram Venkataraman (JIRA) 

[ 
https://issues.apache.org/jira/browse/SPARK-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967778#comment-14967778
 ] 

Shivaram Venkataraman commented on SPARK-11244:
---

Good catch -- Could you send a PR for this ?

> sparkR.stop doesn't clean up .sparkRSQLsc in environment
> 
>
> Key: SPARK-11244
> URL: https://issues.apache.org/jira/browse/SPARK-11244
> Project: Spark
>  Issue Type: Bug
>  Components: SparkR
>Affects Versions: 1.5.1
>Reporter: Sen Fang
>
> Currently {{sparkR.stop}} removes relevant variables from {{.sparkREnv}} for 
> SparkContext and backend. However it doesn't clean up {{.sparkRSQLsc}} and 
> {{.sparkRHivesc}}.
> It results 
> {code}
> sc <- sparkR.init("local")
> sqlContext <- sparkRSQL.init(sc)
> sparkR.stop()
> sc <- sparkR.init("local")
> sqlContext <- sparkRSQL.init(sc)
> sqlContext
> {code}
> producing
> {code}
>  sqlContext
> Error in callJMethod(x, "getClass") : 
>   Invalid jobj 1. If SparkR was restarted, Spark operations need to be 
> re-executed.
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Commented] (SPARK-11244) sparkR.stop doesn't clean up .sparkRSQLsc in environment

2015-10-21 Thread Apache Spark (JIRA) 

[ 
https://issues.apache.org/jira/browse/SPARK-11244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967806#comment-14967806
 ] 

Apache Spark commented on SPARK-11244:
--

User 'saurfang' has created a pull request for this issue:
https://github.com/apache/spark/pull/9205

> sparkR.stop doesn't clean up .sparkRSQLsc in environment
> 
>
> Key: SPARK-11244
> URL: https://issues.apache.org/jira/browse/SPARK-11244
> Project: Spark
>  Issue Type: Bug
>  Components: SparkR
>Affects Versions: 1.5.1
>Reporter: Sen Fang
>
> Currently {{sparkR.stop}} removes relevant variables from {{.sparkREnv}} for 
> SparkContext and backend. However it doesn't clean up {{.sparkRSQLsc}} and 
> {{.sparkRHivesc}}.
> It results 
> {code}
> sc <- sparkR.init("local")
> sqlContext <- sparkRSQL.init(sc)
> sparkR.stop()
> sc <- sparkR.init("local")
> sqlContext <- sparkRSQL.init(sc)
> sqlContext
> {code}
> producing
> {code}
>  sqlContext
> Error in callJMethod(x, "getClass") : 
>   Invalid jobj 1. If SparkR was restarted, Spark operations need to be 
> re-executed.
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org