[ https://issues.apache.org/jira/browse/SPARK-993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matei Zaharia resolved SPARK-993. --------------------------------- Resolution: Won't Fix We investigated this for 1.0 but found that many InputFormats behave wrongly if you try to clone the object, so we won't fix it. > Don't reuse Writable objects in HadoopRDDs by default > ----------------------------------------------------- > > Key: SPARK-993 > URL: https://issues.apache.org/jira/browse/SPARK-993 > Project: Spark > Issue Type: Improvement > Reporter: Matei Zaharia > > Right now we reuse them as an optimization, which leads to weird results when > you call collect() on a file with distinct items. We should instead make that > behavior optional through a flag. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org