spark git commit: [SPARK-18943][SQL] Avoid per-record type dispatch in CSV when reading

2016-12-24 Thread wenchen
Repository: spark Updated Branches: refs/heads/master f2ceb2abe -> d6cbec759 [SPARK-18943][SQL] Avoid per-record type dispatch in CSV when reading ## What changes were proposed in this pull request? `CSVRelation.csvParser` does type dispatch for each value in each row. We can prevent this be

spark git commit: [SPARK-18837][WEBUI] Very long stage descriptions do not wrap in the UI

2016-12-24 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 5bafdc45d -> ca25b1e51 [SPARK-18837][WEBUI] Very long stage descriptions do not wrap in the UI ## What changes were proposed in this pull request? This issue was reported by wangyum. In the AllJobsPage, JobPage and StagePage, the desc

spark git commit: [SPARK-18837][WEBUI] Very long stage descriptions do not wrap in the UI

2016-12-24 Thread srowen
Repository: spark Updated Branches: refs/heads/master 07fcbea51 -> f2ceb2abe [SPARK-18837][WEBUI] Very long stage descriptions do not wrap in the UI ## What changes were proposed in this pull request? This issue was reported by wangyum. In the AllJobsPage, JobPage and StagePage, the descript

spark git commit: [SPARK-18800][SQL] Correct the assert in UnsafeKVExternalSorter which ensures array size

2016-12-24 Thread srowen
Repository: spark Updated Branches: refs/heads/master 3cff81615 -> 07fcbea51 [SPARK-18800][SQL] Correct the assert in UnsafeKVExternalSorter which ensures array size ## What changes were proposed in this pull request? `UnsafeKVExternalSorter` uses `UnsafeInMemorySorter` to sort the records o