Repository: spark
Updated Branches:
refs/heads/branch-1.5 a2f805729 -> 5dd0c5cd6
[SPARK-9575] [MESOS] Add docuemntation around Mesos shuffle service.
andrewor14
Author: Timothy Chen
Closes #7907 from tnachen/mesos_shuffle.
(cherry picked from commit 741a29f98945538a475579ccc974cd42c1613be4
Repository: spark
Updated Branches:
refs/heads/master 5c99d8bf9 -> 741a29f98
[SPARK-9575] [MESOS] Add docuemntation around Mesos shuffle service.
andrewor14
Author: Timothy Chen
Closes #7907 from tnachen/mesos_shuffle.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: htt
Repository: spark
Updated Branches:
refs/heads/branch-1.5 93fc95934 -> a2f805729
[SPARK-8798] [MESOS] Allow additional uris to be fetched with mesos
Some users like to download additional files in their sandbox that they can
refer to from their spark program, or even later mount these files t
Repository: spark
Updated Branches:
refs/heads/master bab892328 -> 5c99d8bf9
[SPARK-8798] [MESOS] Allow additional uris to be fetched with mesos
Some users like to download additional files in their sandbox that they can
refer to from their spark program, or even later mount these files to an
Repository: spark
Updated Branches:
refs/heads/master 4e3f4b934 -> bab892328
[SPARK-9426] [WEBUI] Job page DAG visualization is not shown
To reproduce the issue, go to the stage page and click DAG Visualization once,
then go to the job page to show the job DAG visualization. You will only see
Repository: spark
Updated Branches:
refs/heads/branch-1.5 d9d4bdea2 -> 93fc95934
[SPARK-9426] [WEBUI] Job page DAG visualization is not shown
To reproduce the issue, go to the stage page and click DAG Visualization once,
then go to the job page to show the job DAG visualization. You will only
Repository: spark
Updated Branches:
refs/heads/master a807fcbe5 -> 4e3f4b934
[SPARK-9829] [WEBUI] Display the update value for peak execution memory
The peak execution memory is not correct because it shows the sum of finished
tasks' values when a task finishes.
This PR fixes it by using the
Repository: spark
Updated Branches:
refs/heads/branch-1.5 402c0ca9a -> d9d4bdea2
[SPARK-9829] [WEBUI] Display the update value for peak execution memory
The peak execution memory is not correct because it shows the sum of finished
tasks' values when a task finishes.
This PR fixes it by using
Repository: spark
Updated Branches:
refs/heads/branch-1.4 6dde38026 -> 89c8aea94
[SPARK-9806] [WEB UI] Don't share ReplayListenerBus between multiple
applications
Author: Rohit Agarwal
Closes #8088 from mindprince/SPARK-9806.
(cherry picked from commit a807fcbe50b2ce18751d80d39e9d21842f7da
Repository: spark
Updated Branches:
refs/heads/branch-1.5 2f909184e -> 402c0ca9a
[SPARK-9806] [WEB UI] Don't share ReplayListenerBus between multiple
applications
Author: Rohit Agarwal
Closes #8088 from mindprince/SPARK-9806.
(cherry picked from commit a807fcbe50b2ce18751d80d39e9d21842f7da
Repository: spark
Updated Branches:
refs/heads/master b85f9a242 -> a807fcbe5
[SPARK-9806] [WEB UI] Don't share ReplayListenerBus between multiple
applications
Author: Rohit Agarwal
Closes #8088 from mindprince/SPARK-9806.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit:
Repository: spark
Updated Branches:
refs/heads/master b1581ac28 -> b85f9a242
[SPARK-8366] maxNumExecutorsNeeded should properly handle failed tasks
Author: xutingjun
Author: meiyoula <1039320...@qq.com>
Closes #6817 from XuTingjun/SPARK-8366.
Project: http://git-wip-us.apache.org/repos/asf
Repository: spark
Updated Branches:
refs/heads/branch-1.5 b994f8928 -> 2f909184e
[SPARK-8366] maxNumExecutorsNeeded should properly handle failed tasks
Author: xutingjun
Author: meiyoula <1039320...@qq.com>
Closes #6817 from XuTingjun/SPARK-8366.
(cherry picked from commit b85f9a242a12e8096
Repository: spark
Updated Branches:
refs/heads/branch-1.5 7024f3eac -> b994f8928
[SPARK-9854] [SQL] RuleExecutor.timeMap should be thread-safe
`RuleExecutor.timeMap` is currently a non-thread-safe mutable HashMap; this can
lead to infinite loops if multiple threads are concurrently modifying
Repository: spark
Updated Branches:
refs/heads/master c3e9a120e -> b1581ac28
[SPARK-9854] [SQL] RuleExecutor.timeMap should be thread-safe
`RuleExecutor.timeMap` is currently a non-thread-safe mutable HashMap; this can
lead to infinite loops if multiple threads are concurrently modifying the
Repository: spark
Updated Branches:
refs/heads/branch-1.5 890c75bc2 -> 7024f3eac
[SPARK-9831] [SQL] fix serialization with empty broadcast
Author: Davies Liu
Closes #8117 from davies/fix_serialization and squashes the following commits:
d21ac71 [Davies Liu] fix serialization with empty broa
Repository: spark
Updated Branches:
refs/heads/master 74a293f45 -> c3e9a120e
[SPARK-9831] [SQL] fix serialization with empty broadcast
Author: Davies Liu
Closes #8117 from davies/fix_serialization and squashes the following commits:
d21ac71 [Davies Liu] fix serialization with empty broadcas
Repository: spark
Updated Branches:
refs/heads/branch-1.5 6ea33f5bf -> 890c75bc2
[SPARK-9713] [ML] Document SparkR MLlib glm() integration in Spark 1.5
This documents the use of R model formulae in the SparkR guide. Also fixes some
bugs in the R api doc.
mengxr
Author: Eric Liang
Closes #
Repository: spark
Updated Branches:
refs/heads/master 3ef0f3292 -> 74a293f45
[SPARK-9713] [ML] Document SparkR MLlib glm() integration in Spark 1.5
This documents the use of R model formulae in the SparkR guide. Also fixes some
bugs in the R api doc.
mengxr
Author: Eric Liang
Closes #8085
Repository: spark
Updated Branches:
refs/heads/branch-1.5 0119edf52 -> 6ea33f5bf
[SPARK-1517] Refactor release scripts to facilitate nightly publishing
This update contains some code changes to the release scripts that allow easier
nightly publishing. I've been using these new scripts on Jenk
Repository: spark
Updated Branches:
refs/heads/master ca8f70e9d -> 3ef0f3292
[SPARK-1517] Refactor release scripts to facilitate nightly publishing
This update contains some code changes to the release scripts that allow easier
nightly publishing. I've been using these new scripts on Jenkins
Repository: spark
Updated Branches:
refs/heads/master afa757c98 -> ca8f70e9d
[SPARK-9649] Fix flaky test MasterSuite again - disable REST
The REST server is not actually used in most tests and so we can disable it. It
is a source of flakiness because it tries to bind to a specific port in vai
Repository: spark
Updated Branches:
refs/heads/branch-1.5 ec7a4b9b0 -> 0119edf52
[SPARK-9649] Fix flaky test MasterSuite again - disable REST
The REST server is not actually used in most tests and so we can disable it. It
is a source of flakiness because it tries to bind to a specific port in
Repository: spark
Updated Branches:
refs/heads/master 5a5bbc299 -> afa757c98
[SPARK-9849] [SQL] DirectParquetOutputCommitter qualified name should be
backward compatible
DirectParquetOutputCommitter was moved in SPARK-9763. However, users can
explicitly set the class as a config option, so w
Repository: spark
Updated Branches:
refs/heads/branch-1.5 b7497e3a2 -> ec7a4b9b0
[SPARK-9849] [SQL] DirectParquetOutputCommitter qualified name should be
backward compatible
DirectParquetOutputCommitter was moved in SPARK-9763. However, users can
explicitly set the class as a config option,
Preparing development version 1.5.0-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b7497e3a
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/b7497e3a
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b74
Repository: spark
Updated Branches:
refs/heads/branch-1.5 18d78a823 -> b7497e3a2
Preparing Spark release v1.5.0-snapshot-20150811
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/158b2ea7
Tree: http://git-wip-us.apache.
Repository: spark
Updated Tags: refs/tags/v1.5.0-snapshot-20150811 [created] 158b2ea7a
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.5.0-snapshot-20150811 [deleted] e9329ef6a
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.5 1067c7369 -> 18d78a823
[SPARK-9074] [LAUNCHER] Allow arbitrary Spark args to be set.
This change allows any Spark argument to be added to the app to
be started using SparkLauncher. Known arguments are properly
validated, while unknown a
Repository: spark
Updated Branches:
refs/heads/master 736af95bd -> 5a5bbc299
[SPARK-9074] [LAUNCHER] Allow arbitrary Spark args to be set.
This change allows any Spark argument to be added to the app to
be started using SparkLauncher. Known arguments are properly
validated, while unknown argum
Repository: spark
Updated Branches:
refs/heads/branch-1.5 725e5c7a4 -> 1067c7369
[HOTFIX] Fix style error caused by ef961ed48a4f45447f0e0ad256b040c7ab2d78d9
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/1067c736
Tree: ht
Repository: spark
Updated Branches:
refs/heads/master 017b5de07 -> 736af95bd
[HOTFIX] Fix style error caused by 017b5de
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/736af95b
Tree: http://git-wip-us.apache.org/repos/asf/
Preparing development version 1.5.0-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/725e5c7a
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/725e5c7a
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/725
Repository: spark
Updated Tags: refs/tags/v1.5.0-snapshot-20150811 [created] e9329ef6a
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.5 ef961ed48 -> 725e5c7a4
Preparing Spark release v1.5.0-snapshot-20150811
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e9329ef6
Tree: http://git-wip-us.apache.
Repository: spark
Updated Branches:
refs/heads/branch-1.5 2273e7432 -> ef961ed48
[SPARK-8925] [MLLIB] Add @since tags to mllib.util
Went thru the history of changes the file MLUtils.scala and picked up the
version that the change went in.
Author: Sudhakar Thota
Author: Sudhakar Thota
Clos
Repository: spark
Updated Branches:
refs/heads/master be3e27164 -> 017b5de07
[SPARK-8925] [MLLIB] Add @since tags to mllib.util
Went thru the history of changes the file MLUtils.scala and picked up the
version that the change went in.
Author: Sudhakar Thota
Author: Sudhakar Thota
Closes #
Repository: spark
Updated Branches:
refs/heads/master 423cdfd83 -> be3e27164
[SPARK-9788] [MLLIB] Fix LDA Binary Compatibility
1. Add âasymmetricDocConcentrationâ and revert docConcentration changes. If
the (internal) doc concentration vector is a single value,
âgetDocConcentration" re
Repository: spark
Updated Branches:
refs/heads/branch-1.5 cdf781db6 -> 2273e7432
[SPARK-9788] [MLLIB] Fix LDA Binary Compatibility
1. Add âasymmetricDocConcentrationâ and revert docConcentration changes. If
the (internal) doc concentration vector is a single value,
âgetDocConcentration
Repository: spark
Updated Branches:
refs/heads/master f16bc68df -> 423cdfd83
Closes #1290
Closes #4934
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/423cdfd8
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/423cdf
Repository: spark
Updated Branches:
refs/heads/branch-1.5 eead87ef2 -> cdf781db6
[SPARK-9824] [CORE] Fix the issue that InternalAccumulator leaks WeakReference
`InternalAccumulator.create` doesn't call `registerAccumulatorForCleanup` to
register itself with ContextCleaner, so `WeakReference`s
Repository: spark
Updated Branches:
refs/heads/master 00c02728a -> f16bc68df
[SPARK-9824] [CORE] Fix the issue that InternalAccumulator leaks WeakReference
`InternalAccumulator.create` doesn't call `registerAccumulatorForCleanup` to
register itself with ContextCleaner, so `WeakReference`s for
Repository: spark
Updated Branches:
refs/heads/master 2a3be4ddf -> 00c02728a
[SPARK-9814] [SQL] EqualNotNull not passing to data sources
Author: hyukjinkwon
Author: ê¶íì§
Closes #8096 from HyukjinKwon/master.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://gi
Repository: spark
Updated Branches:
refs/heads/branch-1.5 e9d1eab92 -> eead87ef2
[SPARK-9814] [SQL] EqualNotNull not passing to data sources
Author: hyukjinkwon
Author: ê¶íì§
Closes #8096 from HyukjinKwon/master.
(cherry picked from commit 00c02728a6c6c4282c389ca90641dd78dd5e3d32)
Sign
Repository: spark
Updated Branches:
refs/heads/branch-1.5 811d23f1c -> e9d1eab92
[SPARK-7726] Add import so Scaladoc doesn't fail.
This is another import needed so Scala 2.11 doc generation doesn't fail.
See SPARK-7726 for more detail. I tested this locally and the 2.11
install goes from faili
Repository: spark
Updated Branches:
refs/heads/master 520ad44b1 -> 2a3be4ddf
[SPARK-7726] Add import so Scaladoc doesn't fail.
This is another import needed so Scala 2.11 doc generation doesn't fail.
See SPARK-7726 for more detail. I tested this locally and the 2.11
install goes from failing t
Repository: spark
Updated Branches:
refs/heads/branch-1.5 767ee1884 -> 811d23f1c
[SPARK-9750] [MLLIB] Improve equals on SparseMatrix and DenseMatrix
Adds unit test for `equals` on `mllib.linalg.Matrix` class and `equals` to both
`SparseMatrix` and `DenseMatrix`. Supports equality testing betw
Repository: spark
Updated Branches:
refs/heads/master 5831294a7 -> 520ad44b1
[SPARK-9750] [MLLIB] Improve equals on SparseMatrix and DenseMatrix
Adds unit test for `equals` on `mllib.linalg.Matrix` class and `equals` to both
`SparseMatrix` and `DenseMatrix`. Supports equality testing between
Repository: spark
Updated Branches:
refs/heads/master 5b8bb1b21 -> 5831294a7
http://git-wip-us.apache.org/repos/asf/spark/blob/5831294a/sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala
--
diff
[SPARK-9646] [SQL] Add metrics for all join and aggregate operators
This PR added metrics for all join and aggregate operators. However, I found
the metrics may be confusing in the following two case:
1. The iterator is not totally consumed and the metric values will be less.
2. Recreating the it
[SPARK-9646] [SQL] Add metrics for all join and aggregate operators
This PR added metrics for all join and aggregate operators. However, I found
the metrics may be confusing in the following two case:
1. The iterator is not totally consumed and the metric values will be less.
2. Recreating the it
Repository: spark
Updated Branches:
refs/heads/branch-1.5 71460b889 -> 767ee1884
http://git-wip-us.apache.org/repos/asf/spark/blob/767ee188/sql/core/src/test/scala/org/apache/spark/sql/execution/metric/SQLMetricsSuite.scala
--
Repository: spark
Updated Branches:
refs/heads/branch-1.5 b077f36ea -> 71460b889
[SPARK-9572] [STREAMING] [PYSPARK] Added StreamingContext.getActiveOrCreate()
in Python
Author: Tathagata Das
Closes #8080 from tdas/SPARK-9572 and squashes the following commits:
64a231d [Tathagata Das] Fix b
Repository: spark
Updated Branches:
refs/heads/master dbd778d84 -> 5b8bb1b21
[SPARK-9572] [STREAMING] [PYSPARK] Added StreamingContext.getActiveOrCreate()
in Python
Author: Tathagata Das
Closes #8080 from tdas/SPARK-9572 and squashes the following commits:
64a231d [Tathagata Das] Fix based
Repository: spark
Updated Branches:
refs/heads/master 8cad854ef -> dbd778d84
[SPARK-8764] [ML] string indexer should take option to handle unseen values
As a precursor to adding a public constructor add an option to handle unseen
values by skipping rather than throwing an exception (default r
Repository: spark
Updated Branches:
refs/heads/master bce72797f -> 8cad854ef
[SPARK-8345] [ML] Add an SQL node as a feature transformer
Implements the transforms which are defined by SQL statement.
Currently we only support SQL syntax like 'SELECT ... FROM __THIS__'
where '__THIS__' represents
Repository: spark
Updated Branches:
refs/heads/branch-1.5 efcae3a70 -> b077f36ea
Fix comment error
API is updated but its doc comment is not updated.
Author: Jeff Zhang
Closes #8097 from zjffdu/dev.
(cherry picked from commit bce72797f3499f14455722600b0d0898d4fd87c9)
Signed-off-by: Reynold
Repository: spark
Updated Branches:
refs/heads/master dfe347d2c -> bce72797f
Fix comment error
API is updated but its doc comment is not updated.
Author: Jeff Zhang
Closes #8097 from zjffdu/dev.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.or
Repository: spark
Updated Branches:
refs/heads/branch-1.5 84ba990f2 -> efcae3a70
[SPARK-9785] [SQL] HashPartitioning compatibility should consider expression
ordering
HashPartitioning compatibility is currently defined w.r.t the _set_ of
expressions, but the ordering of those expressions mat
Repository: spark
Updated Branches:
refs/heads/master d378396f8 -> dfe347d2c
[SPARK-9785] [SQL] HashPartitioning compatibility should consider expression
ordering
HashPartitioning compatibility is currently defined w.r.t the _set_ of
expressions, but the ordering of those expressions matters
Repository: spark
Updated Branches:
refs/heads/master 600031ebe -> d378396f8
http://git-wip-us.apache.org/repos/asf/spark/blob/d378396f/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala
--
Repository: spark
Updated Branches:
refs/heads/branch-1.5 ebbd3b616 -> 84ba990f2
http://git-wip-us.apache.org/repos/asf/spark/blob/84ba990f/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringOperations.scala
--
[SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform.
PlatformDependent.UNSAFE is way too verbose.
Author: Reynold Xin
Closes #8094 from rxin/SPARK-9815 and squashes the following commits:
229b603 [Reynold Xin] [SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform.
Project: http://git
[SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform.
PlatformDependent.UNSAFE is way too verbose.
Author: Reynold Xin
Closes #8094 from rxin/SPARK-9815 and squashes the following commits:
229b603 [Reynold Xin] [SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform.
(cherry picked from
Repository: spark
Updated Branches:
refs/heads/branch-1.5 c7f009040 -> ebbd3b616
[SPARK-9727] [STREAMING] [BUILD] Updated streaming kinesis SBT project name to
be more consistent
Author: Tathagata Das
Closes #8092 from tdas/SPARK-9727 and squashes the following commits:
b1b01fd [Tathagata
Repository: spark
Updated Branches:
refs/heads/master 55752d883 -> 600031ebe
[SPARK-9727] [STREAMING] [BUILD] Updated streaming kinesis SBT project name to
be more consistent
Author: Tathagata Das
Closes #8092 from tdas/SPARK-9727 and squashes the following commits:
b1b01fd [Tathagata Das]
Repository: spark
Updated Branches:
refs/heads/master 0f90d6055 -> 55752d883
[SPARK-9810] [BUILD] Remove individual commit messages from the squash commit
message
For more information, please see the JIRA ticket and the associated dev list
discussion.
https://issues.apache.org/jira/browse/S
68 matches
Mail list logo