There is no compress type for snappy.
Sent from my iPhone5s
On 2014年4月4日, at 23:06, Konstantin Kudryavtsev
kudryavtsev.konstan...@gmail.com wrote:
Can anybody suggest how to change compression level (Record, Block) for
Snappy?
if it possible, of course
thank you in advance
Thank
For textFile I believe we overload it and let you set a codec directly:
https://github.com/apache/spark/blob/master/core/src/test/scala/org/apache/spark/FileSuite.scala#L59
For saveAsSequenceFile yep, I think Mark is right, you need an option.
On Wed, Apr 2, 2014 at 12:36 PM, Mark Hamstra
Is this a
Scala-onlyhttp://spark.incubator.apache.org/docs/latest/api/pyspark/pyspark.rdd.RDD-class.html#saveAsTextFilefeature?
On Wed, Apr 2, 2014 at 5:55 PM, Patrick Wendell pwend...@gmail.com wrote:
For textFile I believe we overload it and let you set a codec directly:
Thanks for pointing that out.
On Wed, Apr 2, 2014 at 6:11 PM, Mark Hamstra m...@clearstorydata.comwrote:
First, you shouldn't be using spark.incubator.apache.org anymore, just
spark.apache.org. Second, saveAsSequenceFile doesn't appear to exist in
the Python API at this point.
On Wed,