[
https://issues.apache.org/jira/browse/SPARK-17985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15586644#comment-15586644
]
Reynold Xin edited comment on SPARK-17985 at 10/18/16 8:59 PM:
---------------------------------------------------------------
The patch was reverted due to build failures in Hadoop 2.2:
Actually I'm seeing the following exceptions locally as well as on Jenkins for
Hadoop 2.2:
{noformat}
[error]
/scratch/rxin/spark/core/src/main/scala/org/apache/spark/util/Utils.scala:1489:
value read is not a member of object org.apache.commons.io.IOUtils
[error] var numBytes = IOUtils.read(gzInputStream, buf)
[error] ^
[error]
/scratch/rxin/spark/core/src/main/scala/org/apache/spark/util/Utils.scala:1492:
value read is not a member of object org.apache.commons.io.IOUtils
[error] numBytes = IOUtils.read(gzInputStream, buf)
[error] ^
{noformat}
I'm going to revert the patch for now.
was (Author: rxin):
The patch was reverted due to build failures in Hadoop 2.2:
Actually I'm seeing the following exceptions locally as well as on Jenkins for
Hadoop 2.2:
```
[error]
/scratch/rxin/spark/core/src/main/scala/org/apache/spark/util/Utils.scala:1489:
value read is not a member of object org.apache.commons.io.IOUtils
[error] var numBytes = IOUtils.read(gzInputStream, buf)
[error] ^
[error]
/scratch/rxin/spark/core/src/main/scala/org/apache/spark/util/Utils.scala:1492:
value read is not a member of object org.apache.commons.io.IOUtils
[error] numBytes = IOUtils.read(gzInputStream, buf)
[error] ^
```
I'm going to revert the patch for now.
> Bump commons-lang3 version to 3.5.
> ----------------------------------
>
> Key: SPARK-17985
> URL: https://issues.apache.org/jira/browse/SPARK-17985
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Reporter: Takuya Ueshin
> Assignee: Takuya Ueshin
> Fix For: 2.1.0
>
>
> {{SerializationUtils.clone()}} of commons-lang3 (<3.5) has a bug that break
> thread safety, which gets stack sometimes caused by race condition of
> initializing hash map.
> See https://issues.apache.org/jira/browse/LANG-1251.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
