git commit: [SPARK-1912] fix compress memory issue during reduce

2014-06-25 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-0.9 ef8501d33 -> 950981971 [SPARK-1912] fix compress memory issue during reduce When we need to read a compressed block, we will first create a compress stream instance(LZF or Snappy) and use it to wrap that block. Let's say a reducer task

git commit: [SPARK-1912] fix compress memory issue during reduce

2014-06-25 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 b4b0a54cf -> abb62f0b9 [SPARK-1912] fix compress memory issue during reduce When we need to read a compressed block, we will first create a compress stream instance(LZF or Snappy) and use it to wrap that block. Let's say a reducer task

git commit: [SPARK-1912] fix compress memory issue during reduce

2014-06-03 Thread matei
Repository: spark Updated Branches: refs/heads/master 6c044ed10 -> 45e9bc85d [SPARK-1912] fix compress memory issue during reduce When we need to read a compressed block, we will first create a compress stream instance(LZF or Snappy) and use it to wrap that block. Let's say a reducer task nee