spark git commit: [SPARK-21369][CORE] Don't use Scala Tuple2 in common/network-*

2017-07-10 Thread wenchen 
Repository: spark
Updated Branches:
  refs/heads/branch-2.2 a05edf454 -> edcd9fbc9


[SPARK-21369][CORE] Don't use Scala Tuple2 in common/network-*

## What changes were proposed in this pull request?

Remove all usages of Scala Tuple2 from common/network-* projects. Otherwise, 
Yarn users cannot use `spark.reducer.maxReqSizeShuffleToMem`.

## How was this patch tested?

Jenkins.

Author: Shixiong Zhu 

Closes #18593 from zsxwing/SPARK-21369.

(cherry picked from commit 833eab2c9bd273ee9577fbf9e480d3e3a4b7d203)
Signed-off-by: Wenchen Fan 


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/edcd9fbc
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/edcd9fbc
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/edcd9fbc

Branch: refs/heads/branch-2.2
Commit: edcd9fbc92683753d55ed0c69f391bf3bed59da4
Parents: a05edf4
Author: Shixiong Zhu 
Authored: Tue Jul 11 11:26:17 2017 +0800
Committer: Wenchen Fan 
Committed: Tue Jul 11 11:26:28 2017 +0800

--
 common/network-common/pom.xml   |  3 ++-
 .../client/TransportResponseHandler.java| 20 ++--
 .../network/server/OneForOneStreamManager.java  | 17 +
 common/network-shuffle/pom.xml  |  1 +
 common/network-yarn/pom.xml |  1 +
 5 files changed, 19 insertions(+), 23 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/spark/blob/edcd9fbc/common/network-common/pom.xml
--
diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml
index 7577253..303e25f 100644
--- a/common/network-common/pom.xml
+++ b/common/network-common/pom.xml
@@ -90,7 +90,8 @@
 
   org.apache.spark
   spark-tags_${scala.binary.version}
-
+  test
+

spark git commit: [SPARK-21369][CORE] Don't use Scala Tuple2 in common/network-*

2017-07-10 Thread wenchen 
Repository: spark
Updated Branches:
  refs/heads/master 1471ee7af -> 833eab2c9


[SPARK-21369][CORE] Don't use Scala Tuple2 in common/network-*

## What changes were proposed in this pull request?

Remove all usages of Scala Tuple2 from common/network-* projects. Otherwise, 
Yarn users cannot use `spark.reducer.maxReqSizeShuffleToMem`.

## How was this patch tested?

Jenkins.

Author: Shixiong Zhu 

Closes #18593 from zsxwing/SPARK-21369.


Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/833eab2c
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/833eab2c
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/833eab2c

Branch: refs/heads/master
Commit: 833eab2c9bd273ee9577fbf9e480d3e3a4b7d203
Parents: 1471ee7
Author: Shixiong Zhu 
Authored: Tue Jul 11 11:26:17 2017 +0800
Committer: Wenchen Fan 
Committed: Tue Jul 11 11:26:17 2017 +0800

--
 common/network-common/pom.xml   |  3 ++-
 .../client/TransportResponseHandler.java| 20 ++--
 .../network/server/OneForOneStreamManager.java  | 17 +
 common/network-shuffle/pom.xml  |  1 +
 common/network-yarn/pom.xml |  1 +
 5 files changed, 19 insertions(+), 23 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/spark/blob/833eab2c/common/network-common/pom.xml
--
diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml
index 066970f..0254d0c 100644
--- a/common/network-common/pom.xml
+++ b/common/network-common/pom.xml
@@ -90,7 +90,8 @@
 
   org.apache.spark
   spark-tags_${scala.binary.version}
-
+  test
+