Re: scala.collection.mutable.ArrayOps$ofRef$.length$extension since Spark 1.1.0

2014-10-27 Thread Marius Soutier
ers. perhaps you want to use map instead, and then >> collect the failed file names locally, or save the whole thing out to a file >> >> From: Marius Soutier [mps@gmail.com] >> Sent: Friday, October 24, 2014 6:35 AM >> To: user@spa

Re: scala.collection.mutable.ArrayOps$ofRef$.length$extension since Spark 1.1.0

2014-10-26 Thread Marius Soutier
ed file names locally, or save the whole thing out to a file > > From: Marius Soutier [mps@gmail.com] > Sent: Friday, October 24, 2014 6:35 AM > To: user@spark.apache.org > Subject: scala.collection.mutable.ArrayOps$ofRef$.length$extension since &g

scala.collection.mutable.ArrayOps$ofRef$.length$extension since Spark 1.1.0

2014-10-24 Thread Marius Soutier
Hi, I’m running a job whose simple task it is to find files that cannot be read (sometimes our gz files are corrupted). With 1.0.x, this worked perfectly. Since 1.1.0 however, I’m getting an exception: scala.collection.mutable.ArrayOps$ofRef$.length$extension(ArrayOps.scala:114) sc.wholeT