[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14275 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r72141303 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -105,16 +105,27 @@ private[mesos] object

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-24 Thread tnachen
Github user tnachen commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r72003350 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -105,16 +105,27 @@ private[mesos] object

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-24 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71985992 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/MesosDriverDescription.scala --- @@ -40,24 +41,28 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-23 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71978483 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/MesosDriverDescription.scala --- @@ -40,24 +41,28 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71916241 --- Diff: dev/deps/spark-deps-hadoop-2.2 --- @@ -116,7 +116,7 @@ libfb303-0.9.2.jar libthrift-0.9.2.jar log4j-1.2.17.jar lz4-1.3.0.jar

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71915701 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -131,9 +140,18 @@ private[mesos] object

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71915660 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -105,16 +105,25 @@ private[mesos] object

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71915307 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/MesosDriverDescription.scala --- @@ -40,24 +41,28 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71912703 --- Diff: core/src/main/scala/org/apache/spark/TaskState.scala --- @@ -49,5 +49,6 @@ private[spark] object TaskState extends Enumeration { case

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71912466 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -370,6 +370,13 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71912447 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -47,7 +47,7 @@ import org.apache.spark.util.Utils * * @param loadDefaults

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71870499 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/MesosDriverDescription.scala --- @@ -40,24 +41,28 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71870262 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/MesosDriverDescription.scala --- @@ -40,24 +41,28 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71869149 --- Diff: dev/deps/spark-deps-hadoop-2.2 --- @@ -116,7 +116,7 @@ libfb303-0.9.2.jar libthrift-0.9.2.jar log4j-1.2.17.jar lz4-1.3.0.jar

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71869084 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -131,9 +140,18 @@ private[mesos] object

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71869025 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -105,16 +105,25 @@ private[mesos] object

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71868873 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -370,6 +370,13 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with Logging

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71868805 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -47,7 +47,7 @@ import org.apache.spark.util.Utils * * @param loadDefaults

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71868244 --- Diff: core/src/main/scala/org/apache/spark/TaskState.scala --- @@ -49,5 +49,6 @@ private[spark] object TaskState extends Enumeration { case

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71868130 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/MesosDriverDescription.scala --- @@ -40,24 +41,28 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71809553 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -105,16 +105,25 @@ private[mesos] object

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71786978 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -105,16 +105,25 @@ private[mesos] object

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71786430 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -105,16 +105,25 @@ private[mesos] object

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71763139 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -79,7 +80,7 @@ private[mesos] trait

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71761953 --- Diff: core/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackendSuite.scala --- @@ -106,10 +106,10 @@ class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71750078 --- Diff: dev/make-distribution.sh --- @@ -156,7 +156,7 @@ BUILD_COMMAND=("$MVN" -T 1C clean package -DskipTests $@) echo -e "\nBuilding with..."

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71749653 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -105,16 +105,25 @@ private[mesos] object

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71747044 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -353,43 +353,62 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71747570 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -434,19 +451,19 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71746880 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/ui/DriverPage.scala --- @@ -50,7 +50,7 @@ private[ui] class DriverPage(parent: MesosClusterUI)

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71746242 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/MesosDriverDescription.scala --- @@ -40,24 +41,28 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71746197 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/MesosDriverDescription.scala --- @@ -40,24 +41,28 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71745913 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -370,6 +370,12 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71745795 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -47,7 +47,7 @@ import org.apache.spark.util.Utils * * @param loadDefaults

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71690510 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -105,16 +105,25 @@ private[mesos] object

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71688940 --- Diff: core/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackendSuite.scala --- @@ -120,10 +120,10 @@ class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71688958 --- Diff: core/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackendSuite.scala --- @@ -134,10 +134,10 @@ class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71688894 --- Diff: core/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosCoarseGrainedSchedulerBackendSuite.scala --- @@ -106,10 +106,10 @@ class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71687752 --- Diff: core/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterSchedulerSuite.scala --- @@ -31,17 +31,24 @@ import

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71687654 --- Diff: core/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterSchedulerSuite.scala --- @@ -31,17 +31,24 @@ import

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71687466 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -131,9 +140,18 @@ private[mesos] object

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71687133 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -478,6 +495,33 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71686268 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -434,19 +451,19 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71686260 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -434,19 +451,19 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71686283 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -434,19 +451,19 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71686150 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosClusterScheduler.scala --- @@ -353,43 +353,62 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71685603 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/ui/DriverPage.scala --- @@ -50,7 +50,7 @@ private[ui] class DriverPage(parent: MesosClusterUI)

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71684671 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/MesosDriverDescription.scala --- @@ -40,24 +41,28 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71684506 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/MesosDriverDescription.scala --- @@ -40,24 +41,28 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71680547 --- Diff: core/src/main/scala/org/apache/spark/TaskState.scala --- @@ -49,5 +49,6 @@ private[spark] object TaskState extends Enumeration { case

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71679591 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -370,6 +370,12 @@ class SparkConf(loadDefaults: Boolean) extends Cloneable with Logging

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71675287 --- Diff: dev/make-distribution.sh --- @@ -156,7 +156,7 @@ BUILD_COMMAND=("$MVN" -T 1C clean package -DskipTests $@) echo -e "\nBuilding with..."

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71674856 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -79,7 +80,7 @@ private[mesos] trait

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71674445 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackendUtil.scala --- @@ -131,9 +140,18 @@ private[mesos] object

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-21 Thread skonto
Github user skonto commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71671939 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -47,7 +47,7 @@ import org.apache.spark.util.Utils * * @param loadDefaults

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-19 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71452324 --- Diff: core/src/main/scala/org/apache/spark/deploy/mesos/MesosDriverDescription.scala --- @@ -40,24 +41,28 @@ private[spark] class

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-19 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/14275#discussion_r71452287 --- Diff: core/src/main/scala/org/apache/spark/SparkConf.scala --- @@ -47,7 +47,7 @@ import org.apache.spark.util.Utils * * @param loadDefaults

[GitHub] spark pull request #14275: [SPARK-16637] Unified containerizer

2016-07-19 Thread mgummelt
GitHub user mgummelt opened a pull request: https://github.com/apache/spark/pull/14275 [SPARK-16637] Unified containerizer ## What changes were proposed in this pull request? New config var: spark.mesos.docker.containerizer={"mesos","docker" (default)} This adds