Re: How to avoid use snappy compression when saveAsSequenceFile?

2014-11-05 Thread Marcelo Vanzin
On Mon, Oct 27, 2014 at 7:37 PM, buring qyqb...@gmail.com wrote: Here is error log,I abstract as follows: INFO [binaryTest---main]: before first WARN [org.apache.spark.scheduler.TaskSetManager---Result resolver thread-0]: Lost task 0.0 in stage 0.0 (TID 0, spark-dev136):

Re: How to avoid use snappy compression when saveAsSequenceFile?

2014-10-28 Thread Shixiong Zhu
. Thanks. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-avoid-use-snappy-compression-when-saveAsSequenceFile-tp17350p17456.html Sent from the Apache Spark User List mailing list archive at Nabble.com

How to avoid use snappy compression when saveAsSequenceFile?

2014-10-27 Thread buring
with my environment ,I just can't solve it out. can any one give me some idea about this problem or to void use snappy when saveAsSequenceFile? Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-avoid-use-snappy-compression-when

Re: How to avoid use snappy compression when saveAsSequenceFile?

2014-10-27 Thread Holden Karau
idea about this problem or to void use snappy when saveAsSequenceFile? Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-avoid-use-snappy-compression-when-saveAsSequenceFile-tp17350.html Sent from the Apache Spark User List mailing list

Re: How to avoid use snappy compression when saveAsSequenceFile?

2014-10-27 Thread buring
) println(rdd.first()) logInfo(after first) val seq = new SequenceFileRDDFunctions(rdd) seq.saveAsSequenceFile(args(0)) Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-avoid-use-snappy-compression-when-saveAsSequenceFile

Re: How to avoid use snappy compression when saveAsSequenceFile?

2014-10-27 Thread Shixiong Zhu
this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-avoid-use-snappy-compression-when-saveAsSequenceFile-tp17350p17424.html Sent from the Apache Spark User List mailing list archive at Nabble.com