[ https://issues.apache.org/jira/browse/SPARK-17255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jukka Vaaramaki closed SPARK-17255. ----------------------------------- Resolution: Won't Fix > Spark queries inside Futures occasionally fail due to missing class > definitions > ------------------------------------------------------------------------------- > > Key: SPARK-17255 > URL: https://issues.apache.org/jira/browse/SPARK-17255 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 2.0.0 > Environment: OSX El Capitan, Scala 2.11.8, JDK 1.8 > Reporter: Jukka Vaaramaki > > Wrapping Spark queries inside Future's causes them to occasionally run in > threads that have very limited context class loaders. The class loader > obtained by calling Thread.currentThread.getContextClassLoader can be very > minimal despite any classpath definitions and missing all the Spark > libraries. This causes ClassNotFoundException or ScalaReflectionException to > be thrown when building or executing the Spark query. Sometimes an > IllegalArgumentException is thrown when none of the compression codecs are > found. > An easy fix is to replace the Thread.currentThread.getContextClassLoader > calls with getClass.getClassLoader. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org