spark git commit: [SPARK-8890] [SQL] Fallback on sorting when writing many dynamic partitions

2015-08-07 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.5 295266049 -> ea4dfb90a [SPARK-8890] [SQL] Fallback on sorting when writing many dynamic partitions Previously, we would open a new file for each new dynamic written out using `HadoopFsRelation`. For formats like parquet this is very c

spark git commit: [SPARK-8890] [SQL] Fallback on sorting when writing many dynamic partitions

2015-08-07 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 902334fd5 -> 49702bd73 [SPARK-8890] [SQL] Fallback on sorting when writing many dynamic partitions Previously, we would open a new file for each new dynamic written out using `HadoopFsRelation`. For formats like parquet this is very costl