Hi,
Guess it's spark.io.compression.codec with lz4 being default.
Supported are lzf or snappy.
Pozdrawiam,
Jacek Laskowski
https://medium.com/@jaceklaskowski/
Mastering Apache Spark http://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski
On Tue, Jul 26, 2016
All,
I am running Spark 1.6.1. I enabled 'spark.eventLog.compress', and the data
is now being compressed using lz4. I would like to move that back to
Snappy as I have some third party tools that require using Snappy.
Is there a variable used to control Spark eventLog compression algorithm?
