Repository: spark
Updated Branches:
refs/heads/branch-0.9 ef8501d33 -> 950981971
[SPARK-1912] fix compress memory issue during reduce
When we need to read a compressed block, we will first create a compress stream
instance(LZF or Snappy) and use it to wrap that block.
Let's say a reducer task
Repository: spark
Updated Branches:
refs/heads/branch-1.0 b4b0a54cf -> abb62f0b9
[SPARK-1912] fix compress memory issue during reduce
When we need to read a compressed block, we will first create a compress stream
instance(LZF or Snappy) and use it to wrap that block.
Let's say a reducer task
Repository: spark
Updated Branches:
refs/heads/master 6c044ed10 -> 45e9bc85d
[SPARK-1912] fix compress memory issue during reduce
When we need to read a compressed block, we will first create a compress stream
instance(LZF or Snappy) and use it to wrap that block.
Let's say a reducer task nee