Re: One corrupt gzip in a directory of 100s

2015-04-01 Thread Ted Yu
in case of corrupted zip files. From: Dale Richardson dale...@hotmail.com To: dev@spark.apache.org dev@spark.apache.org Date: 29/03/2015 11:48 PM Subject:One corrupt gzip in a directory of 100s Recently had an incident reported to me where somebody was analysing

Re: One corrupt gzip in a directory of 100s

2015-04-01 Thread Romi Kuntsman
on the entire job. I like SPARK-6593, since it can cover also additional cases, not just in case of corrupted zip files. From: Dale Richardson dale...@hotmail.com To: dev@spark.apache.org dev@spark.apache.org Date: 29/03/2015 11:48 PM Subject:One corrupt gzip in a directory of 100s