Liang-Chi Hsieh created SPARK-4741: -------------------------------------- Summary: Do not destroy and re-create FileInputStream Key: SPARK-4741 URL: https://issues.apache.org/jira/browse/SPARK-4741 Project: Spark Issue Type: Improvement Reporter: Liang-Chi Hsieh Priority: Minor
The FileInputStream in DiskMapIterator is destroyed and recreate after each batch reading. However, since we can change the reading position on that stream, it is no need and inefficient to destroy and recreate it every time. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org