[
https://issues.apache.org/jira/browse/SPARK-44078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739775#comment-17739775
]
Snoot.io commented on SPARK-44078:
----------------------------------
User 'vicennial' has created a pull request for this issue:
https://github.com/apache/spark/pull/41625
> Add support for classloader/resource isolation
> ----------------------------------------------
>
> Key: SPARK-44078
> URL: https://issues.apache.org/jira/browse/SPARK-44078
> Project: Spark
> Issue Type: New Feature
> Components: Connect, Spark Core
> Affects Versions: 3.5.0
> Reporter: Venkata Sai Akhil Gudesa
> Assignee: Venkata Sai Akhil Gudesa
> Priority: Major
> Fix For: 3.5.0
>
>
> A current limitation of Scala UDFs is that a Spark cluster would only be able
> to support a single REPL at a time due to the fact that classloaders of
> different Spark Sessions (and therefore, Spark Connect sessions) aren't
> isolated from each other. Without isolation, REPL-generated classfiles as
> well as user-added JARs may conflict if there are multiple users of the
> cluster.
> Thus, we need a mechanism to support isolated sessions (i.e isolated
> resources/classloader) so that each REPL user does not conflict with other
> users on the same cluster.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
