spark git commit: [SPARK-14031][SQL] speedup CSV writer

2016-05-23 Thread lian
Repository: spark Updated Branches: refs/heads/master dafcb05c2 -> 80091b8a6 [SPARK-14031][SQL] speedup CSV writer ## What changes were proposed in this pull request? Currently, we create an CSVWriter for every row, it's very expensive and memory hungry, took about 15 seconds to write out 1

spark git commit: [SPARK-14031][SQL] speedup CSV writer

2016-05-23 Thread lian
Repository: spark Updated Branches: refs/heads/branch-2.0 4462da707 -> 6eb8ec6f4 [SPARK-14031][SQL] speedup CSV writer ## What changes were proposed in this pull request? Currently, we create an CSVWriter for every row, it's very expensive and memory hungry, took about 15 seconds to write ou