Repository: spark
Updated Branches:
refs/heads/branch-1.5 1f7dbcd6f -> 29f2d5a06
[SPARK-3190] [GRAPHX] Fix VertexRDD.count() overflow regression
SPARK-3190 was originally fixed by 96df92906978c5f58e0cc8ff5eebe5b35a08be3b,
but a5ef58113667ff73562ce6db381cff96a0b354b0 introduced a regression du
Repository: spark
Updated Branches:
refs/heads/branch-1.3 265ec35bc -> cd5d1be6e
[SPARK-3190] [GRAPHX] Fix VertexRDD.count() overflow regression
SPARK-3190 was originally fixed by 96df92906978c5f58e0cc8ff5eebe5b35a08be3b,
but a5ef58113667ff73562ce6db381cff96a0b354b0 introduced a regression du
Repository: spark
Updated Branches:
refs/heads/branch-1.4 f904b46c9 -> dea04bf84
[SPARK-3190] [GRAPHX] Fix VertexRDD.count() overflow regression
SPARK-3190 was originally fixed by 96df92906978c5f58e0cc8ff5eebe5b35a08be3b,
but a5ef58113667ff73562ce6db381cff96a0b354b0 introduced a regression du
Repository: spark
Updated Branches:
refs/heads/master 0afa6fbf5 -> 9e952ecbc
[SPARK-3190] [GRAPHX] Fix VertexRDD.count() overflow regression
SPARK-3190 was originally fixed by 96df92906978c5f58e0cc8ff5eebe5b35a08be3b,
but a5ef58113667ff73562ce6db381cff96a0b354b0 introduced a regression during
Repository: spark
Updated Branches:
refs/heads/branch-1.5 ebe42b98c -> 1f7dbcd6f
[SPARK-9521] [DOCS] Addendum. Require Maven 3.3.3+ in the build
Follow on for #7852: Building Spark doc needs to refer to new Maven requirement
too
Author: Sean Owen
Closes #7905 from srowen/SPARK-9521.2 and s
Repository: spark
Updated Branches:
refs/heads/master 5eb89f67e -> 0afa6fbf5
[SPARK-9521] [DOCS] Addendum. Require Maven 3.3.3+ in the build
Follow on for #7852: Building Spark doc needs to refer to new Maven requirement
too
Author: Sean Owen
Closes #7905 from srowen/SPARK-9521.2 and squas
Repository: spark
Updated Branches:
refs/heads/branch-1.5 93076ae39 -> ebe42b98c
[SPARK-9577][SQL] Surface concrete iterator types in various sort classes.
We often return abstract iterator types in various sort-related classes (e.g.
UnsafeKVExternalSorter). It is actually better to return a
Repository: spark
Updated Branches:
refs/heads/master 3b0e44490 -> 5eb89f67e
[SPARK-9577][SQL] Surface concrete iterator types in various sort classes.
We often return abstract iterator types in various sort-related classes (e.g.
UnsafeKVExternalSorter). It is actually better to return a more
Repository: spark
Updated Branches:
refs/heads/branch-1.5 34335719a -> 93076ae39
[SPARK-8416] highlight and topping the executor threads in thread dumping page
https://issues.apache.org/jira/browse/SPARK-8416
To facilitate debugging, I made this patch with three changes:
* render the executo
Repository: spark
Updated Branches:
refs/heads/master 1633d0a26 -> 3b0e44490
[SPARK-8416] highlight and topping the executor threads in thread dumping page
https://issues.apache.org/jira/browse/SPARK-8416
To facilitate debugging, I made this patch with three changes:
* render the executor-th
Repository: spark
Updated Branches:
refs/heads/branch-1.5 73c863ac8 -> 34335719a
[SPARK-9263] Added flags to exclude dependencies when using --packages
While the functionality is there to exclude packages, there are no flags that
allow users to exclude dependencies, in case of dependency conf
Repository: spark
Updated Branches:
refs/heads/master b79b4f5f2 -> 1633d0a26
[SPARK-9263] Added flags to exclude dependencies when using --packages
While the functionality is there to exclude packages, there are no flags that
allow users to exclude dependencies, in case of dependency conflict
Repository: spark
Updated Branches:
refs/heads/branch-1.5 74792e71c -> 73c863ac8
[SPARK-9483] Fix UTF8String.getPrefix for big-endian.
Previous code assumed little-endian.
Author: Matthew Brandyberry
Closes #7902 from mtbrandy/SPARK-9483 and squashes the following commits:
ec31df8 [Matthew
Repository: spark
Updated Branches:
refs/heads/master 7abaaad5b -> b79b4f5f2
[SPARK-9483] Fix UTF8String.getPrefix for big-endian.
Previous code assumed little-endian.
Author: Matthew Brandyberry
Closes #7902 from mtbrandy/SPARK-9483 and squashes the following commits:
ec31df8 [Matthew Bra
Repository: spark
Updated Branches:
refs/heads/master 13675c742 -> 7abaaad5b
Add a prerequisites section for building docs
This puts all the install commands that need to be run in one section instead
of being spread over many paragraphs
cc rxin
Author: Shivaram Venkataraman
Closes #7912
Repository: spark
Updated Branches:
refs/heads/branch-1.5 bc49ca468 -> 74792e71c
Preparing Spark release v1.5.0-snapshot-20150803
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7e7147f3
Tree: http://git-wip-us.apache.
Preparing development version 1.5.0-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/74792e71
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/74792e71
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/747
Repository: spark
Updated Tags: refs/tags/v1.5.0-snapshot-20150803 [created] 7e7147f3b
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.5.0-snapshot-20150803 [deleted] 4c4f638c7
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.5.0-snapshot-20150803 [created] 4c4f638c7
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Preparing development version 1.5.0-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/bc49ca46
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/bc49ca46
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/bc4
Repository: spark
Updated Branches:
refs/heads/branch-1.5 acda9d954 -> bc49ca468
Preparing Spark release v1.5.0-snapshot-20150803
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4c4f638c
Tree: http://git-wip-us.apache.
Repository: spark
Updated Tags: refs/tags/v1.5.0-snapshot-20150803 [deleted] 35264204b
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.5 73fab8849 -> acda9d954
[SPARK-8874] [ML] Add missing methods in Word2Vec
Add missing methods
1. getVectors
2. findSynonyms
to W2Vec scala and python API
mengxr
Author: MechCoder
Closes #7263 from MechCoder/missing_methods_w2vec an
Repository: spark
Updated Branches:
refs/heads/master a2409d1c8 -> 13675c742
[SPARK-8874] [ML] Add missing methods in Word2Vec
Add missing methods
1. getVectors
2. findSynonyms
to W2Vec scala and python API
mengxr
Author: MechCoder
Closes #7263 from MechCoder/missing_methods_w2vec and sq
Repository: spark
Updated Branches:
refs/heads/branch-1.5 6bd12e819 -> 73fab8849
Preparing Spark release v1.5.0-snapshot-20150803
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/35264204
Tree: http://git-wip-us.apache.
Repository: spark
Updated Tags: refs/tags/v1.5.0-snapshot-20150803 [created] 35264204b
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Preparing development version 1.5.0-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/73fab884
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/73fab884
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/73f
http://git-wip-us.apache.org/repos/asf/spark/blob/a2409d1c/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala
--
diff --git
a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala
b/sql/hive/src/mai
http://git-wip-us.apache.org/repos/asf/spark/blob/6bd12e81/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala
--
diff --git
a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveContext.scala
b/sql/hive/src/mai
[SPARK-8064] [SQL] Build against Hive 1.2.1
Cherry picked the parts of the initial SPARK-8064 WiP branch needed to get
sql/hive to compile against hive 1.2.1. That's the ASF release packaged under
org.apache.hive, not any fork.
Tests not run yet: that's what the machines are for
Author: Steve
[SPARK-8064] [SQL] Build against Hive 1.2.1
Cherry picked the parts of the initial SPARK-8064 WiP branch needed to get
sql/hive to compile against hive 1.2.1. That's the ASF release packaged under
org.apache.hive, not any fork.
Tests not run yet: that's what the machines are for
Author: Steve
Repository: spark
Updated Branches:
refs/heads/branch-1.5 db5832708 -> 6bd12e819
http://git-wip-us.apache.org/repos/asf/spark/blob/6bd12e81/sql/hive/src/test/resources/golden/parenthesis_star_by-5-6888c7f7894910538d82eefa23443189
-
Repository: spark
Updated Branches:
refs/heads/master b2e4b85d2 -> a2409d1c8
http://git-wip-us.apache.org/repos/asf/spark/blob/a2409d1c/sql/hive/src/test/resources/golden/parenthesis_star_by-5-6888c7f7894910538d82eefa23443189
-
Repository: spark
Updated Branches:
refs/heads/master 702aa9d7f -> b2e4b85d2
Revert "[SPARK-9372] [SQL] Filter nulls in join keys"
This reverts commit 687c8c37150f4c93f8e57d86bb56321a4891286b.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/rep
Repository: spark
Updated Branches:
refs/heads/branch-1.5 29756ff11 -> db5832708
Revert "[SPARK-9372] [SQL] Filter nulls in join keys"
This reverts commit 687c8c37150f4c93f8e57d86bb56321a4891286b.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org
[SPARK-8735] [SQL] Expose memory usage for shuffles, joins and aggregations
This patch exposes the memory used by internal data structures on the SparkUI.
This tracks memory used by all spilling operations and SQL operators backed by
Tungsten, e.g. `BroadcastHashJoin`, `ExternalSort`, `Generated
[SPARK-8735] [SQL] Expose memory usage for shuffles, joins and aggregations
This patch exposes the memory used by internal data structures on the SparkUI.
This tracks memory used by all spilling operations and SQL operators backed by
Tungsten, e.g. `BroadcastHashJoin`, `ExternalSort`, `Generated
Repository: spark
Updated Branches:
refs/heads/branch-1.5 e7329ab31 -> 29756ff11
http://git-wip-us.apache.org/repos/asf/spark/blob/29756ff1/core/src/test/scala/org/apache/spark/scheduler/TaskContextSuite.scala
--
diff --git
a/
Repository: spark
Updated Branches:
refs/heads/master e4765a468 -> 702aa9d7f
http://git-wip-us.apache.org/repos/asf/spark/blob/702aa9d7/core/src/test/scala/org/apache/spark/scheduler/TaskContextSuite.scala
--
diff --git
a/core
Repository: spark
Updated Branches:
refs/heads/branch-1.5 dc0c8c982 -> e7329ab31
[SPARK-9191] [ML] [Doc] Add ml.PCA user guide and code examples
Add ml.PCA user guide document and code examples for Scala/Java/Python.
Author: Yanbo Liang
Closes #7522 from yanboliang/ml-pca-md and squashes th
Repository: spark
Updated Branches:
refs/heads/branch-1.5 444058d91 -> dc0c8c982
[SPARK-9544] [MLLIB] add Python API for RFormula
Add Python API for RFormula. Similar to other feature transformers in Python.
This is just a thin wrapper over the Scala implementation. ericl MechCoder
Author: X
Repository: spark
Updated Branches:
refs/heads/master 8ca287ebb -> e4765a468
[SPARK-9544] [MLLIB] add Python API for RFormula
Add Python API for RFormula. Similar to other feature transformers in Python.
This is just a thin wrapper over the Scala implementation. ericl MechCoder
Author: Xiang
Repository: spark
Updated Branches:
refs/heads/master ba1c4e138 -> 8ca287ebb
[SPARK-9191] [ML] [Doc] Add ml.PCA user guide and code examples
Add ml.PCA user guide document and code examples for Scala/Java/Python.
Author: Yanbo Liang
Closes #7522 from yanboliang/ml-pca-md and squashes the fo
Repository: spark
Updated Branches:
refs/heads/branch-1.5 b3117d312 -> 444058d91
[SPARK-9558][DOCS]Update docs to follow the increase of memory defaults.
Now the memory defaults of master and slave in Standalone mode and History
Server is 1g, not 512m. So let's update docs.
Author: Kousuke S
Repository: spark
Updated Branches:
refs/heads/master ff9169a00 -> ba1c4e138
[SPARK-9558][DOCS]Update docs to follow the increase of memory defaults.
Now the memory defaults of master and slave in Standalone mode and History
Server is 1g, not 512m. So let's update docs.
Author: Kousuke Sarut
Repository: spark
Updated Branches:
refs/heads/branch-1.5 6d46e9b7c -> b3117d312
[SPARK-5133] [ML] Added featureImportance to RandomForestClassifier and
Regressor
Added featureImportance to RandomForestClassifier and Regressor.
This follows the scikit-learn implementation here:
[https://git
Repository: spark
Updated Branches:
refs/heads/master 703e44bff -> ff9169a00
[SPARK-5133] [ML] Added featureImportance to RandomForestClassifier and
Regressor
Added featureImportance to RandomForestClassifier and Regressor.
This follows the scikit-learn implementation here:
[https://github.
Repository: spark
Updated Branches:
refs/heads/branch-1.5 5452e93f0 -> 6d46e9b7c
[SPARK-9554] [SQL] Enables in-memory partition pruning by default
Author: Cheng Lian
Closes #7895 from liancheng/spark-9554/enable-in-memory-partition-pruning and
squashes the following commits:
67c403e [Cheng
Repository: spark
Updated Branches:
refs/heads/master 7a9d09f0b -> 703e44bff
[SPARK-9554] [SQL] Enables in-memory partition pruning by default
Author: Cheng Lian
Closes #7895 from liancheng/spark-9554/enable-in-memory-partition-pruning and
squashes the following commits:
67c403e [Cheng Lia
Repository: spark
Updated Branches:
refs/heads/branch-1.5 4de833e9e -> 5452e93f0
[SQL][minor] Simplify UnsafeRow.calculateBitSetWidthInBytes.
Author: Reynold Xin
Closes #7897 from rxin/calculateBitSetWidthInBytes and squashes the following
commits:
2e73b3a [Reynold Xin] [SQL][minor] Simpli
Repository: spark
Updated Branches:
refs/heads/master dfe7bd168 -> 7a9d09f0b
[SQL][minor] Simplify UnsafeRow.calculateBitSetWidthInBytes.
Author: Reynold Xin
Closes #7897 from rxin/calculateBitSetWidthInBytes and squashes the following
commits:
2e73b3a [Reynold Xin] [SQL][minor] Simplify
Repository: spark
Updated Branches:
refs/heads/branch-1.5 b41a32718 -> 4de833e9e
[SPARK-9511] [SQL] Fixed Table Name Parsing
The issue was that the tokenizer was parsing "1one" into the numeric 1 using
the code on line 110. I added another case to accept strings that start with a
number and
Repository: spark
Updated Branches:
refs/heads/master b41a32718 -> dfe7bd168
[SPARK-9511] [SQL] Fixed Table Name Parsing
The issue was that the tokenizer was parsing "1one" into the numeric 1 using
the code on line 110. I added another case to accept strings that start with a
number and then
Repository: spark
Updated Branches:
refs/heads/branch-1.5 [created] b41a32718
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/master 69f5a7c93 -> b41a32718
[SPARK-1855] Local checkpointing
Certain use cases of Spark involve RDDs with long lineages that must be
truncated periodically (e.g. GraphX). The existing way of doing it is through
`rdd.checkpoint()`, which is exp
Repository: spark
Updated Branches:
refs/heads/master 8be198c86 -> 69f5a7c93
[SPARK-9528] [ML] Changed RandomForestClassifier to extend
ProbabilisticClassifier
RandomForestClassifier now outputs rawPrediction based on tree probabilities,
plus probability column computed from normalized rawPr
Repository: spark
Updated Branches:
refs/heads/branch-1.3 cc5f711c0 -> 265ec35bc
[SPARK-7563] (backport for 1.3) OutputCommitCoordinator.stop() should only run
on the driver
Backport of "[SPARK-7563] OutputCommitCoordinator.stop() should only run on the
driver" for 1.3
Author: Sean Owen
C
Repository: spark
Updated Branches:
refs/heads/master 191bf2689 -> 8be198c86
Two minor comments from code review on 191bf2689.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8be198c8
Tree: http://git-wip-us.apache.org/rep
Repository: spark
Updated Branches:
refs/heads/master 137f47865 -> 191bf2689
[SPARK-9518] [SQL] cleanup generated UnsafeRowJoiner and fix bug
Currently, when copy the bitsets, we didn't consider that the row1 may not sit
in the beginning of byte array.
cc rxin
Author: Davies Liu
Closes #7
Repository: spark
Updated Branches:
refs/heads/master 95dccc633 -> 137f47865
[SPARK-9551][SQL] add a cheap version of copy for UnsafeRow to reuse a copy
buffer
Author: Wenchen Fan
Closes #7885 from cloud-fan/cheap-copy and squashes the following commits:
0900ca1 [Wenchen Fan] replace == wi
Repository: spark
Updated Branches:
refs/heads/master 1ebd41b14 -> 95dccc633
[SPARK-8873] [MESOS] Clean up shuffle files if external shuffle service is used
This patch builds directly on #7820, which is largely written by tnachen. The
only addition is one commit for cleaning up the code. Ther
Repository: spark
Updated Branches:
refs/heads/master 98d6d9c7a -> 1ebd41b14
http://git-wip-us.apache.org/repos/asf/spark/blob/1ebd41b1/sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/sortBasedIterators.scala
-
[SPARK-9240] [SQL] Hybrid aggregate operator using unsafe row
This PR adds a base aggregation iterator `AggregationIterator`, which is used
to create `SortBasedAggregationIterator` (for sort-based aggregation) and
`UnsafeHybridAggregationIterator` (first it tries hash-based aggregation and
fall
Repository: spark
Updated Branches:
refs/heads/master 608353c8e -> 98d6d9c7a
[SPARK-9549][SQL] fix bugs in expressions
JIRA: https://issues.apache.org/jira/browse/SPARK-9549
This PR fix the following bugs:
1. `UnaryMinus`'s codegen version would fail to compile when the input is
`Long.MinVa
65 matches
Mail list logo