[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17272272#comment-17272272
]
Ajith S commented on SPARK-26961:
-
Scala issue : https://github.com/scala/bug/issues/11429
> Found
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794551#comment-16794551
]
Ajith S commented on SPARK-26961:
-
[~srowen] ok, will raise a PR for this. Thanks
> Found Java-level
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794532#comment-16794532
]
Sean Owen commented on SPARK-26961:
---
Yes, I think implementing in Java is viable just for this reason.
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794403#comment-16794403
]
Mi Zi commented on SPARK-26961:
---
copy or create a new Configuration every time in
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794300#comment-16794300
]
Sean Owen commented on SPARK-26961:
---
Hm! OK, I believe it. That almost seems like a bug in the JDK. I
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791739#comment-16791739
]
Sean Owen commented on SPARK-26961:
---
When I run your class and print the result of
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791751#comment-16791751
]
Ajith S commented on SPARK-26961:
-
Yes, the registerAsParallelCapable will return true, but if you
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791712#comment-16791712
]
Ajith S commented on SPARK-26961:
-
[~srowen] That too will not work
Here is my custom classloader
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791634#comment-16791634
]
Sean Owen commented on SPARK-26961:
---
[~ajithshetty] I see, OK. It could happen in the class itself, in
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790208#comment-16790208
]
Ajith S commented on SPARK-26961:
-
[~srowen] Yes. I too have same opinion of fixing it via
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789829#comment-16789829
]
Mi Zi commented on SPARK-26961:
---
I think the problem could be fixed from a more general prospect if there
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789598#comment-16789598
]
Sean Owen commented on SPARK-26961:
---
I think registerAsParallelCapable() sounds like it could resolve
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789180#comment-16789180
]
Ajith S commented on SPARK-26961:
-
[~xsapphire] i agree with your opinion.
cc [~hyukjin.kwon]
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783727#comment-16783727
]
Mi Zi commented on SPARK-26961:
---
Hi Ajith,
IMHO ClassLoader.registerAsParallelCapable() only helps to
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783227#comment-16783227
]
Ajith S commented on SPARK-26961:
-
The problem is here org.apache.spark.util.MutableURLClassLoader
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783161#comment-16783161
]
Ajith S commented on SPARK-26961:
-
The problem is here org.apache.spark.util.MutableURLClassLoader
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783031#comment-16783031
]
Ajith S commented on SPARK-26961:
-
The problem is here org.apache.spark.util.MutableURLClassLoader
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782645#comment-16782645
]
Mi Zi commented on SPARK-26961:
---
Hi there,
I'm one of Jialei's coworkers. By using prototype
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781458#comment-16781458
]
Jungtaek Lim commented on SPARK-26961:
--
Which distribution of Spark are you using? Specifically the
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780771#comment-16780771
]
Rong Jialei commented on SPARK-26961:
-
Hi
Thanks for the response, from our current investigation,
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780534#comment-16780534
]
Ajith S commented on SPARK-26961:
-
I think the root cause is
[
https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776211#comment-16776211
]
Hyukjin Kwon commented on SPARK-26961:
--
How did this happen? Would you be able to provide a
22 matches
Mail list logo
