spark git commit: [SPARK-19082][SQL] Make ignoreCorruptFiles work for Parquet

2017-01-15 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.1 bf2f233e4 -> 4f3ce062c [SPARK-19082][SQL] Make ignoreCorruptFiles work for Parquet ## What changes were proposed in this pull request? We have a config `spark.sql.files.ignoreCorruptFiles` which can be used to ignore corrupt files whe

spark git commit: [SPARK-19082][SQL] Make ignoreCorruptFiles work for Parquet

2017-01-15 Thread wenchen
Repository: spark Updated Branches: refs/heads/master de62ddf7f -> 61e48f52d [SPARK-19082][SQL] Make ignoreCorruptFiles work for Parquet ## What changes were proposed in this pull request? We have a config `spark.sql.files.ignoreCorruptFiles` which can be used to ignore corrupt files when re